2024-03-24T10:24:29.732 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-24T10:24:29.732 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619065 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --name pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619065/orig.config.yaml 2024-03-24T10:24:29.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-24T10:24:29.859 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619065 branch: wip-batrick-testing-20240323.003144-squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7619065' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240323.003144-squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 21b3bd672163092b4e542f772797fcba02d3d4de ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 21b3bd672163092b4e542f772797fcba02d3d4de kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240323.003144-squid sha1: d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4284 sha1: 21b3bd672163092b4e542f772797fcba02d3d4de sleep_before_teardown: 0 subset: 405/512 suite: fs suite_branch: wip-batrick-testing-20240323.003144-squid suite_path: /home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+cIHDwY8U0EG/QVKcu4mEQyG6lmrBcSXKFkNSaqOxQngRIFVMNHH7tCcE5kkppM8cdRQgCqNYI5vijS2YXNxY= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8RPjlYa+F/10nV5T5gkm0sOMk3Ife3t5Y6xpb/8+Y+gI1MI6jyMxWfQNeWmc1e0S57tx3IUSitDqhXkunBVNw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: - /cephfs/home/pdonnell/src/github.com_batrick_ceph_wip-batrick-testing-20240323.003144-squid/qa/suites/fs/functional/overrides/pg_health.yaml meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-24_04:56:01 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-24T10:24:29.859 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa; will attempt to use it 2024-03-24T10:24:29.860 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa/tasks 2024-03-24T10:24:29.860 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-24T10:24:29.862 INFO:teuthology.task.internal:Checking packages... 2024-03-24T10:24:29.885 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '21b3bd672163092b4e542f772797fcba02d3d4de' 2024-03-24T10:24:29.885 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-24T10:24:29.886 INFO:teuthology.packaging:ref: None 2024-03-24T10:24:29.886 INFO:teuthology.packaging:tag: None 2024-03-24T10:24:29.886 INFO:teuthology.packaging:branch: wip-batrick-testing-20240323.003144-squid 2024-03-24T10:24:29.886 INFO:teuthology.packaging:sha1: 21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:24:29.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240323.003144-squid 2024-03-24T10:24:30.031 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1855.g21b3bd67 2024-03-24T10:24:30.032 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-24T10:24:30.039 INFO:teuthology.task.internal:no buildpackages task found 2024-03-24T10:24:30.039 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-24T10:24:30.177 INFO:teuthology.task.internal:Saving configuration 2024-03-24T10:24:30.194 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-24T10:24:30.214 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-24T10:24:30.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619065', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-24 10:19:04.133733', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+cIHDwY8U0EG/QVKcu4mEQyG6lmrBcSXKFkNSaqOxQngRIFVMNHH7tCcE5kkppM8cdRQgCqNYI5vijS2YXNxY='} 2024-03-24T10:24:30.260 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619065', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-24 10:19:04.135391', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8RPjlYa+F/10nV5T5gkm0sOMk3Ife3t5Y6xpb/8+Y+gI1MI6jyMxWfQNeWmc1e0S57tx3IUSitDqhXkunBVNw='} 2024-03-24T10:24:30.260 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-24T10:24:30.266 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-24T10:24:30.266 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-24T10:24:30.266 INFO:teuthology.run_tasks:Running task console_log... 2024-03-24T10:24:30.349 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f56d2b5b160>, signals=[15]) 2024-03-24T10:24:30.350 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-24T10:24:30.356 INFO:teuthology.task.internal:Opening connections... 2024-03-24T10:24:30.356 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:24:30.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:24:30.448 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:24:30.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:24:30.534 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-24T10:24:30.543 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2024-03-24T10:24:30.560 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2024-03-24T10:24:30.560 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="CentOS Stream" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="9" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:ID="centos" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="9" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:24:30.616 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:24:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:24:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:24:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:24:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:24:30.617 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2024-03-24T10:24:30.640 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-03-24T10:24:30.658 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-03-24T10:24:30.658 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-03-24T10:24:30.716 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-03-24T10:24:30.717 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-24T10:24:30.717 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-03-24T10:24:30.717 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-24T10:24:30.717 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-24T10:24:30.717 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-24T10:24:30.717 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-03-24T10:24:30.740 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-24T10:24:30.750 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-24T10:24:30.773 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-24T10:24:30.773 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2024-03-24T10:24:30.776 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-03-24T10:24:30.792 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-24T10:24:30.839 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-24T10:24:30.840 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2024-03-24T10:24:30.842 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-03-24T10:24:30.865 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-24T10:24:30.919 INFO:teuthology.run_tasks:Running task kernel... 2024-03-24T10:24:30.933 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-24T10:24:30.933 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-03-24T10:24:30.933 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-03-24T10:24:30.934 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-24T10:24:30.934 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-24T10:24:30.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:24:30.951 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-03-24T10:24:30.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:24:30.952 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-03-24T10:24:31.008 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-361.el9.x86_64 2024-03-24T10:24:31.009 INFO:teuthology.task.kernel:Running kernel on smithi072: 5.14.0-361.el9.x86_64 2024-03-24T10:24:31.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2024-03-24T10:24:31.010 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-361.el9.x86_64 2024-03-24T10:24:31.010 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.14.0-361.el9.x86_64 2024-03-24T10:24:31.010 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2024-03-24T10:24:33.198 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-24T10:24:34.082 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-24T10:24:34.589 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2024-03-24T10:24:35.499 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2024-03-24T10:24:35.608 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-24T10:24:37.116 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.0 MB 00:01 2024-03-24T10:24:57.386 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 930 kB/s | 19 MB 00:20 2024-03-24T10:24:59.035 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 927 kB/s | 19 MB 00:20 2024-03-24T10:25:01.655 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.1 MB 00:00 2024-03-24T10:25:03.062 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 16 kB 00:00 2024-03-24T10:25:03.996 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-03-24T10:25:08.871 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-03-24T10:25:10.545 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 777 kB/s | 6.1 MB 00:08 2024-03-24T10:25:10.894 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-24T10:25:10.894 INFO:teuthology.orchestra.run.smithi079.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-24T10:25:10.990 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-03-24T10:25:10.999 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-03-24T10:25:10.999 INFO:teuthology.orchestra.run.smithi079.stdout: Package Architecture Version Repository Size 2024-03-24T10:25:10.999 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-03-24T10:25:10.999 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:25:11.000 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 76 M 2024-03-24T10:25:11.001 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 123 M 2024-03-24T10:25:11.001 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-03-24T10:25:11.172 INFO:teuthology.orchestra.run.smithi079.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 425 kB/s | 44 kB 00:00 2024-03-24T10:25:11.764 INFO:teuthology.orchestra.run.smithi079.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 21 MB/s | 15 MB 00:00 2024-03-24T10:25:12.047 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-03-24T10:25:12.214 INFO:teuthology.orchestra.run.smithi079.stdout:(3/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 29 MB/s | 33 MB 00:01 2024-03-24T10:25:12.698 INFO:teuthology.orchestra.run.smithi079.stdout:(4/4): kernel-modules-core-5.14.0-430.el9.x86_6 18 MB/s | 27 MB 00:01 2024-03-24T10:25:12.698 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:25:12.698 INFO:teuthology.orchestra.run.smithi079.stdout:Total 45 MB/s | 76 MB 00:01 2024-03-24T10:25:13.371 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-03-24T10:25:13.437 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-24T10:25:13.743 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-03-24T10:25:13.743 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-03-24T10:25:14.759 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-03-24T10:25:14.759 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-03-24T10:25:17.262 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-03-24T10:25:17.972 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-24T10:25:18.064 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-24T10:25:18.268 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-24T10:25:20.401 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-24T10:25:20.401 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-24T10:25:20.507 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-24T10:25:20.522 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-24T10:25:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: Package Architecture Version Repository Size 2024-03-24T10:25:20.522 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout:Install 4 Packages 2024-03-24T10:25:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:25:20.524 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 76 M 2024-03-24T10:25:20.524 INFO:teuthology.orchestra.run.smithi072.stdout:Installed size: 123 M 2024-03-24T10:25:20.524 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-24T10:25:20.663 INFO:teuthology.orchestra.run.smithi072.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 450 kB/s | 44 kB 00:00 2024-03-24T10:25:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-24T10:25:20.932 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-24T10:25:21.138 INFO:teuthology.orchestra.run.smithi072.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 26 MB/s | 15 MB 00:00 2024-03-24T10:25:21.705 INFO:teuthology.orchestra.run.smithi072.stdout:(3/4): kernel-modules-core-5.14.0-430.el9.x86_6 26 MB/s | 27 MB 00:01 2024-03-24T10:25:22.289 INFO:teuthology.orchestra.run.smithi072.stdout:(4/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 19 MB/s | 33 MB 00:01 2024-03-24T10:25:22.289 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:25:22.289 INFO:teuthology.orchestra.run.smithi072.stdout:Total 43 MB/s | 76 MB 00:01 2024-03-24T10:25:22.955 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-24T10:25:23.346 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-24T10:25:23.346 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-24T10:25:24.357 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-24T10:25:24.357 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-24T10:25:25.661 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-24T10:25:25.798 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:25:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-24T10:25:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-24T10:25:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-24T10:25:30.377 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-24T10:25:30.556 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-24T10:25:30.559 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:25:35.315 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-24T10:25:35.360 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:25:40.129 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:25:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:25:59.699 INFO:teuthology.orchestra.run.smithi079.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-24T10:25:59.699 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:25:59.742 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:00.131 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:00.131 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-24T10:26:00.131 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-24T10:26:00.131 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-24T10:26:00.555 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:00.555 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:26:00.555 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-03-24T10:26:00.556 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-24T10:26:00.556 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-24T10:26:00.556 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-24T10:26:00.556 INFO:teuthology.orchestra.run.smithi079.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-24T10:26:00.556 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:26:00.556 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-03-24T10:26:00.905 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-03-24T10:26:00.999 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-24T10:26:00.999 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-24T10:26:00.999 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-24T10:26:00.999 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-24T10:26:00.999 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-24T10:26:01.000 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-24T10:26:01.000 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-03-24T10:26:01.000 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q kernel | sort -rV | head -n 1 2024-03-24T10:26:01.079 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-24T10:26:01.079 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-24T10:26:01.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2-tools 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2-tools 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.06 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 68.el9 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Group : Unspecified 2024-03-24T10:26:01.113 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 8264254 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : builder@centos.org 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Support tools for GRUB. 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-24T10:26:01.114 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-24T10:26:01.115 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2024-03-24T10:26:01.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:26:01.115 INFO:teuthology.orchestra.run.smithi079.stdout:This subpackage provides tools for support of all platforms. 2024-03-24T10:26:01.116 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-24T10:26:01.116 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 5.14.0-430.el9.x86_64 2024-03-24T10:26:01.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-24T10:26:01.754 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-03-24T10:26:03.130 INFO:teuthology.orchestra.run.smithi079.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-24T10:26:03.165 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-03-24T10:26:03.166 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-03-24T10:26:03.181 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.QgRbD9H5qB 2024-03-24T10:26:03.181 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QgRbD9H5qB 2024-03-24T10:26:03.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.QgRbD9H5qB 2024-03-24T10:26:03.390 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.QgRbD9H5qB is 6KB 2024-03-24T10:26:03.438 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.QgRbD9H5qB 2024-03-24T10:26:03.452 DEBUG:teuthology.orchestra.run.smithi079:> sudo /bin/ls /boot/loader/entries || true 2024-03-24T10:26:03.516 INFO:teuthology.orchestra.run.smithi079.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-24T10:26:03.516 INFO:teuthology.orchestra.run.smithi079.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-24T10:26:03.516 INFO:teuthology.orchestra.run.smithi079.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-24T10:26:03.516 INFO:teuthology.orchestra.run.smithi079.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-24T10:26:03.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-24T10:26:03.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-03-24T10:26:11.403 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:11.403 INFO:teuthology.orchestra.run.smithi072.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-24T10:26:11.403 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:26:11.448 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-24T10:26:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-24T10:26:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-24T10:26:12.298 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-24T10:26:12.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:26:12.298 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-24T10:26:12.298 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-24T10:26:12.299 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-24T10:26:12.299 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-24T10:26:12.299 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-24T10:26:12.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:26:12.299 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-24T10:26:12.731 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-03-24T10:26:12.866 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-24T10:26:12.866 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-24T10:26:12.867 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-24T10:26:12.867 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-24T10:26:12.867 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-24T10:26:12.867 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-24T10:26:12.867 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi072.front.sepia.ceph.com, path=None, version=distro) 2024-03-24T10:26:12.867 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2024-03-24T10:26:12.946 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-24T10:26:12.947 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-24T10:26:12.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo rpm -qi grub2-tools 2024-03-24T10:26:12.985 INFO:teuthology.orchestra.run.smithi072.stdout:Name : grub2-tools 2024-03-24T10:26:12.985 INFO:teuthology.orchestra.run.smithi072.stdout:Epoch : 1 2024-03-24T10:26:12.985 INFO:teuthology.orchestra.run.smithi072.stdout:Version : 2.06 2024-03-24T10:26:12.985 INFO:teuthology.orchestra.run.smithi072.stdout:Release : 68.el9 2024-03-24T10:26:12.985 INFO:teuthology.orchestra.run.smithi072.stdout:Architecture: x86_64 2024-03-24T10:26:12.985 INFO:teuthology.orchestra.run.smithi072.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Group : Unspecified 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Size : 8264254 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:License : GPLv3+ 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Packager : builder@centos.org 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Vendor : CentOS 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Summary : Support tools for GRUB. 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:Description : 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:26:12.986 INFO:teuthology.orchestra.run.smithi072.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-24T10:26:12.987 INFO:teuthology.orchestra.run.smithi072.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-24T10:26:12.987 INFO:teuthology.orchestra.run.smithi072.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-24T10:26:12.987 INFO:teuthology.orchestra.run.smithi072.stdout:hardware devices. 2024-03-24T10:26:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:26:12.987 INFO:teuthology.orchestra.run.smithi072.stdout:This subpackage provides tools for support of all platforms. 2024-03-24T10:26:12.988 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-24T10:26:12.988 INFO:teuthology.task.kernel:Updating grub on smithi072 to boot 5.14.0-430.el9.x86_64 2024-03-24T10:26:12.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-24T10:26:13.597 INFO:teuthology.orchestra.run.smithi072.stderr:Generating grub configuration file ... 2024-03-24T10:26:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-24T10:26:15.125 INFO:teuthology.orchestra.run.smithi072.stderr:done 2024-03-24T10:26:15.127 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2024-03-24T10:26:15.161 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.XZLewqmkDY 2024-03-24T10:26:15.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XZLewqmkDY 2024-03-24T10:26:15.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.XZLewqmkDY 2024-03-24T10:26:15.371 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.XZLewqmkDY is 6KB 2024-03-24T10:26:15.420 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.XZLewqmkDY 2024-03-24T10:26:15.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo /bin/ls /boot/loader/entries || true 2024-03-24T10:26:15.498 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-24T10:26:15.498 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-24T10:26:15.498 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-24T10:26:15.498 INFO:teuthology.orchestra.run.smithi072.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-24T10:26:15.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-24T10:26:15.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo shutdown -r now 2024-03-24T10:26:33.688 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-24T10:26:33.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-03-24T10:26:33.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:26:45.662 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-24T10:26:45.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:26:45.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:27:20.223 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-24T10:27:29.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:27:29.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:27:33.694 DEBUG:teuthology.orchestra.remote:timed out 2024-03-24T10:27:42.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-03-24T10:27:42.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:27:43.192 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-03-24T10:27:43.559 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-03-24T10:27:43.559 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-430.el9.x86_64"... 2024-03-24T10:27:43.559 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-03-24T10:27:43.573 INFO:teuthology.orchestra.run.smithi079.stdout:5.14.0-430.el9.x86_64 2024-03-24T10:27:43.573 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-24T10:27:43.574 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-24T10:27:43.574 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-24T10:27:44.575 DEBUG:teuthology.parallel:result is None 2024-03-24T10:27:47.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-24T10:27:59.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:27:59.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:28:02.690 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.72 2024-03-24T10:28:17.692 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:28:17.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:28:18.064 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-03-24T10:28:18.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:28:18.534 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-430.el9.x86_64"... 2024-03-24T10:28:18.534 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2024-03-24T10:28:18.551 INFO:teuthology.orchestra.run.smithi072.stdout:5.14.0-430.el9.x86_64 2024-03-24T10:28:18.551 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-24T10:28:18.551 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-24T10:28:18.553 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-24T10:28:19.554 DEBUG:teuthology.parallel:result is None 2024-03-24T10:28:19.555 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-24T10:28:19.561 INFO:teuthology.task.internal:Creating test directory... 2024-03-24T10:28:19.562 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-24T10:28:19.564 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-24T10:28:19.583 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-24T10:28:19.599 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-24T10:28:19.633 INFO:teuthology.task.internal:Creating archive directory... 2024-03-24T10:28:19.633 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-24T10:28:19.636 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-24T10:28:19.670 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-24T10:28:19.678 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-24T10:28:19.678 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-24T10:28:19.706 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-24T10:28:19.806 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:28:19.817 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:28:19.844 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:28:19.876 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-24T10:28:19.877 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-24T10:28:19.885 INFO:teuthology.task.internal:Configuring sudo... 2024-03-24T10:28:19.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-24T10:28:19.887 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-24T10:28:19.916 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-24T10:28:19.925 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-24T10:28:19.926 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-24T10:28:19.959 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-24T10:28:19.975 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:28:20.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:28:20.117 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:28:20.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:28:20.202 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:28:20.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-24T10:28:20.269 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:28:20.315 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-24T10:28:20.369 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:28:20.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-24T10:28:20.499 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:28:20.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-24T10:28:20.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2024-03-24T10:28:20.569 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-03-24T10:28:20.611 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-24T10:28:20.656 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-24T10:28:21.172 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-24T10:28:21.180 INFO:teuthology.task.internal:Starting timer... 2024-03-24T10:28:21.180 INFO:teuthology.run_tasks:Running task pcp... 2024-03-24T10:28:21.220 INFO:teuthology.run_tasks:Running task selinux... 2024-03-24T10:28:21.251 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-24T10:28:21.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2024-03-24T10:28:21.322 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2024-03-24T10:28:21.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-03-24T10:28:21.375 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-03-24T10:28:21.377 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-24T10:28:21.377 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2024-03-24T10:28:21.407 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2024-03-24T10:28:21.407 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-03-24T10:28:21.444 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-03-24T10:28:21.444 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi079.front.sepia.ceph.com': 'permissive'} 2024-03-24T10:28:21.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-24T10:28:21.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:28:21.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-24T10:28:21.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:28:21.513 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-24T10:28:21.513 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2024-03-24T10:28:21.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-03-24T10:28:21.595 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-24T10:28:21.606 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-24T10:28:21.610 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-24T10:28:21.729 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-24T10:28:21.744 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-24T10:28:21.745 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi079.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-24T10:32:51.354 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com')] 2024-03-24T10:32:51.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:32:51.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:32:51.461 DEBUG:teuthology.orchestra.run.smithi072:> true 2024-03-24T10:32:51.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2024-03-24T10:32:51.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-03-24T10:32:51.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-24T10:32:51.651 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-03-24T10:32:51.725 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-03-24T10:32:51.725 INFO:teuthology.run_tasks:Running task clock... 2024-03-24T10:32:51.736 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-24T10:32:51.737 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-24T10:32:51.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T10:32:51.740 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-24T10:32:51.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-24T10:32:51.773 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-24T10:32:51.791 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-24T10:32:51.797 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-24T10:32:51.814 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-24T10:32:51.822 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2024-03-24T10:32:51.837 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2024-03-24T10:32:51.843 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-03-24T10:32:51.853 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-24T10:32:51.857 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-03-24T10:32:51.871 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-24T10:32:51.874 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-24T10:32:51.890 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-24T10:32:51.931 INFO:teuthology.orchestra.run.smithi072.stderr:bash: line 1: ntpq: command not found 2024-03-24T10:32:51.934 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-24T10:32:51.934 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2024-03-24T10:32:51.934 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.935 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.935 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.935 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.945 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-03-24T10:32:51.949 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-24T10:32:51.949 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-03-24T10:32:51.949 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.949 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.949 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.949 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-24T10:32:51.949 INFO:teuthology.run_tasks:Running task install... 2024-03-24T10:32:51.971 DEBUG:teuthology.task.install:project ceph 2024-03-24T10:32:51.972 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}} 2024-03-24T10:32:51.972 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'} 2024-03-24T10:32:51.972 INFO:teuthology.task.install:Using flavor: default 2024-03-24T10:32:51.986 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-24T10:32:51.986 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-24T10:32:51.987 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'tag': None, 'wait_for_package': False} 2024-03-24T10:32:51.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:32:51.990 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'tag': None, 'wait_for_package': False} 2024-03-24T10:32:51.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:32:52.155 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/ 2024-03-24T10:32:52.155 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1855.g21b3bd67 2024-03-24T10:32:52.215 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/ 2024-03-24T10:32:52.215 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1855.g21b3bd67 2024-03-24T10:32:52.269 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-24T10:32:52.270 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:32:52.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-24T10:32:52.300 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-24T10:32:52.300 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/21b3bd672163092b4e542f772797fcba02d3d4de/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-24T10:32:52.340 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240323.003144-squid/21b3bd672163092b4e542f772797fcba02d3d4de/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-24T10:32:52.340 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:32:52.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-24T10:32:52.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-24T10:32:52.370 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-24T10:32:52.370 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/21b3bd672163092b4e542f772797fcba02d3d4de/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-24T10:32:52.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-24T10:32:52.447 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-24T10:32:52.514 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-03-24T10:32:52.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-03-24T10:32:52.518 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-24T10:32:52.584 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2024-03-24T10:32:52.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2024-03-24T10:32:52.750 INFO:teuthology.orchestra.run.smithi079.stdout:74 files removed 2024-03-24T10:32:52.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-24T10:32:52.827 INFO:teuthology.orchestra.run.smithi072.stdout:74 files removed 2024-03-24T10:32:52.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-24T10:32:53.498 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 244 kB/s | 83 kB 00:00 2024-03-24T10:32:53.538 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 180 kB/s | 83 kB 00:00 2024-03-24T10:32:53.933 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-03-24T10:32:53.939 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 28 kB/s | 10 kB 00:00 2024-03-24T10:32:54.264 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2024-03-24T10:32:54.286 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-03-24T10:32:54.733 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-24T10:32:54.808 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-24T10:32:56.184 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS-9 - BaseOS 5.8 MB/s | 2.0 MB 00:00 2024-03-24T10:32:56.414 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2024-03-24T10:32:57.316 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-03-24T10:32:57.610 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.0 MB 00:01 2024-03-24T10:33:13.857 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-24T10:33:19.368 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - AppStream 918 kB/s | 19 MB 00:21 2024-03-24T10:33:20.864 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 6.1 MB 00:03 2024-03-24T10:33:22.324 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-03-24T10:33:23.311 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-24T10:33:23.794 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-03-24T10:33:24.908 INFO:teuthology.orchestra.run.smithi072.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 16 kB 00:00 2024-03-24T10:33:27.020 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-03-24T10:33:28.725 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-03-24T10:33:31.069 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-24T10:33:31.070 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-24T10:33:31.082 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-24T10:33:31.082 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-24T10:33:31.083 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-24T10:33:31.084 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-24T10:33:31.086 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-24T10:33:31.088 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-24T10:33:31.089 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-24T10:33:31.167 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-03-24T10:33:31.179 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================================ 2024-03-24T10:33:31.179 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-03-24T10:33:31.179 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================================ 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 6.6 k 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 5.3 M 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 888 k 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 145 k 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 1.5 M 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 138 k 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 1.8 M 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 7.4 M 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 49 k 2024-03-24T10:33:31.180 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 9.8 M 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 47 M 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 264 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 748 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 219 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 27 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 18 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 32 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 744 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 127 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-24T10:33:31.181 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 161 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 320 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 298 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 99 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 85 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 3.1 M 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 170 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-24T10:33:31.182 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-24T10:33:31.183 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 3.4 M 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 3.1 M 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-24T10:33:31.184 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 21 M 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 31 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 2.4 M 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 248 k 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 4.7 M 2024-03-24T10:33:31.185 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 17 M 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 15 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 25 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 163 k 2024-03-24T10:33:31.186 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 499 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 5.1 M 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-24T10:33:31.187 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 45 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 131 k 2024-03-24T10:33:31.188 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-24T10:33:31.189 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-24T10:33:31.190 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-24T10:33:31.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-24T10:33:31.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-03-24T10:33:31.193 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-24T10:33:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:33:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-03-24T10:33:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================================ 2024-03-24T10:33:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:Install 150 Packages 2024-03-24T10:33:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 24 Packages 2024-03-24T10:33:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:33:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 224 M 2024-03-24T10:33:31.195 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-03-24T10:33:31.846 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-03-24T10:33:32.451 INFO:teuthology.orchestra.run.smithi079.stdout:(1/174): ceph-19.0.0-1855.g21b3bd67.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-03-24T10:33:32.751 INFO:teuthology.orchestra.run.smithi079.stdout:(2/174): ceph-fuse-19.0.0-1855.g21b3bd67.el9.x8 2.9 MB/s | 888 kB 00:00 2024-03-24T10:33:32.835 INFO:teuthology.orchestra.run.smithi079.stdout:(3/174): ceph-immutable-object-cache-19.0.0-185 1.7 MB/s | 145 kB 00:00 2024-03-24T10:33:33.610 INFO:teuthology.orchestra.run.smithi079.stdout:(4/174): ceph-mds-19.0.0-1855.g21b3bd67.el9.x86 3.0 MB/s | 2.4 MB 00:00 2024-03-24T10:33:34.129 INFO:teuthology.orchestra.run.smithi079.stdout:(5/174): ceph-mgr-19.0.0-1855.g21b3bd67.el9.x86 2.9 MB/s | 1.5 MB 00:00 2024-03-24T10:33:34.274 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-24T10:33:34.275 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-24T10:33:34.288 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-24T10:33:34.289 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-24T10:33:34.294 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-24T10:33:34.294 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-24T10:33:34.295 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-24T10:33:34.295 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-24T10:33:34.296 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-24T10:33:34.376 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-24T10:33:34.407 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-03-24T10:33:34.407 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 6.6 k 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 5.3 M 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 888 k 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 145 k 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 1.5 M 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 138 k 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 1.8 M 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 7.4 M 2024-03-24T10:33:34.408 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 49 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 9.8 M 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 47 M 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 264 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 748 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 219 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 27 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 18 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-24T10:33:34.409 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 32 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 744 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 127 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 161 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 320 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 298 k 2024-03-24T10:33:34.410 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 99 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 85 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 3.1 M 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 170 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-24T10:33:34.411 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 3.4 M 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 3.1 M 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-24T10:33:34.412 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-24T10:33:34.413 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-24T10:33:34.413 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-24T10:33:34.413 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-24T10:33:34.413 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-24T10:33:34.413 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 21 M 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 31 k 2024-03-24T10:33:34.414 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 2.4 M 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 248 k 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 4.7 M 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 17 M 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1855.g21b3bd67.el9 ceph-noarch 15 k 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 25 k 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-24T10:33:34.415 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 163 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-24T10:33:34.416 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 499 k 2024-03-24T10:33:34.417 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-24T10:33:34.417 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 5.1 M 2024-03-24T10:33:34.417 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-24T10:33:34.419 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-24T10:33:34.419 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-24T10:33:34.419 INFO:teuthology.orchestra.run.smithi072.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-24T10:33:34.419 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-24T10:33:34.419 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-24T10:33:34.420 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 45 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:19.0.0-1855.g21b3bd67.el9 ceph 131 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-24T10:33:34.421 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-24T10:33:34.422 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-24T10:33:34.423 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-24T10:33:34.424 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-24T10:33:34.425 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-24T10:33:34.426 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout:============================================================================================ 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout:Install 150 Packages 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 24 Packages 2024-03-24T10:33:34.427 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:33:34.430 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 224 M 2024-03-24T10:33:34.430 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-24T10:33:34.663 INFO:teuthology.orchestra.run.smithi079.stdout:(6/174): ceph-base-19.0.0-1855.g21b3bd67.el9.x8 2.1 MB/s | 5.3 MB 00:02 2024-03-24T10:33:35.023 INFO:teuthology.orchestra.run.smithi072.stdout:(1/174): ceph-19.0.0-1855.g21b3bd67.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-03-24T10:33:35.761 INFO:teuthology.orchestra.run.smithi079.stdout:(7/174): ceph-mon-19.0.0-1855.g21b3bd67.el9.x86 2.9 MB/s | 4.7 MB 00:01 2024-03-24T10:33:36.023 INFO:teuthology.orchestra.run.smithi072.stdout:(2/174): ceph-fuse-19.0.0-1855.g21b3bd67.el9.x8 888 kB/s | 888 kB 00:01 2024-03-24T10:33:36.193 INFO:teuthology.orchestra.run.smithi072.stdout:(3/174): ceph-immutable-object-cache-19.0.0-185 868 kB/s | 145 kB 00:00 2024-03-24T10:33:38.034 INFO:teuthology.orchestra.run.smithi072.stdout:(4/174): ceph-mds-19.0.0-1855.g21b3bd67.el9.x86 1.3 MB/s | 2.4 MB 00:01 2024-03-24T10:33:39.491 INFO:teuthology.orchestra.run.smithi072.stdout:(5/174): ceph-mgr-19.0.0-1855.g21b3bd67.el9.x86 1.0 MB/s | 1.5 MB 00:01 2024-03-24T10:33:39.560 INFO:teuthology.orchestra.run.smithi079.stdout:(8/174): ceph-osd-19.0.0-1855.g21b3bd67.el9.x86 3.4 MB/s | 17 MB 00:04 2024-03-24T10:33:39.644 INFO:teuthology.orchestra.run.smithi079.stdout:(9/174): ceph-selinux-19.0.0-1855.g21b3bd67.el9 303 kB/s | 25 kB 00:00 2024-03-24T10:33:40.825 INFO:teuthology.orchestra.run.smithi072.stdout:(6/174): ceph-base-19.0.0-1855.g21b3bd67.el9.x8 901 kB/s | 5.3 MB 00:06 2024-03-24T10:33:41.609 INFO:teuthology.orchestra.run.smithi072.stdout:(7/174): ceph-common-19.0.0-1855.g21b3bd67.el9. 3.0 MB/s | 21 MB 00:06 2024-03-24T10:33:41.727 INFO:teuthology.orchestra.run.smithi079.stdout:(10/174): ceph-common-19.0.0-1855.g21b3bd67.el9 2.1 MB/s | 21 MB 00:09 2024-03-24T10:33:42.086 INFO:teuthology.orchestra.run.smithi079.stdout:(11/174): cephfs-mirror-19.0.0-1855.g21b3bd67.e 612 kB/s | 219 kB 00:00 2024-03-24T10:33:42.169 INFO:teuthology.orchestra.run.smithi079.stdout:(12/174): cephfs-shell-19.0.0-1855.g21b3bd67.el 325 kB/s | 27 kB 00:00 2024-03-24T10:33:42.253 INFO:teuthology.orchestra.run.smithi079.stdout:(13/174): libcephfs-devel-19.0.0-1855.g21b3bd67 382 kB/s | 32 kB 00:00 2024-03-24T10:33:42.978 INFO:teuthology.orchestra.run.smithi079.stdout:(14/174): libcephfs2-19.0.0-1855.g21b3bd67.el9. 1.0 MB/s | 744 kB 00:00 2024-03-24T10:33:43.236 INFO:teuthology.orchestra.run.smithi079.stdout:(15/174): libcephsqlite-19.0.0-1855.g21b3bd67.e 632 kB/s | 163 kB 00:00 2024-03-24T10:33:43.412 INFO:teuthology.orchestra.run.smithi079.stdout:(16/174): librados-devel-19.0.0-1855.g21b3bd67. 724 kB/s | 127 kB 00:00 2024-03-24T10:33:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:(17/174): ceph-radosgw-19.0.0-1855.g21b3bd67.el 1.3 MB/s | 9.8 MB 00:07 2024-03-24T10:33:44.095 INFO:teuthology.orchestra.run.smithi079.stdout:(18/174): libradosstriper1-19.0.0-1855.g21b3bd6 731 kB/s | 499 kB 00:00 2024-03-24T10:33:44.179 INFO:teuthology.orchestra.run.smithi079.stdout:(19/174): python3-ceph-argparse-19.0.0-1855.g21 542 kB/s | 45 kB 00:00 2024-03-24T10:33:44.301 INFO:teuthology.orchestra.run.smithi072.stdout:(8/174): ceph-mon-19.0.0-1855.g21b3bd67.el9.x86 999 kB/s | 4.7 MB 00:04 2024-03-24T10:33:44.393 INFO:teuthology.orchestra.run.smithi072.stdout:(9/174): ceph-selinux-19.0.0-1855.g21b3bd67.el9 274 kB/s | 25 kB 00:00 2024-03-24T10:33:44.479 INFO:teuthology.orchestra.run.smithi079.stdout:(20/174): python3-ceph-common-19.0.0-1855.g21b3 438 kB/s | 131 kB 00:00 2024-03-24T10:33:44.704 INFO:teuthology.orchestra.run.smithi079.stdout:(21/174): python3-cephfs-19.0.0-1855.g21b3bd67. 717 kB/s | 161 kB 00:00 2024-03-24T10:33:45.071 INFO:teuthology.orchestra.run.smithi079.stdout:(22/174): python3-rados-19.0.0-1855.g21b3bd67.e 873 kB/s | 320 kB 00:00 2024-03-24T10:33:45.463 INFO:teuthology.orchestra.run.smithi079.stdout:(23/174): python3-rbd-19.0.0-1855.g21b3bd67.el9 761 kB/s | 298 kB 00:00 2024-03-24T10:33:45.639 INFO:teuthology.orchestra.run.smithi079.stdout:(24/174): python3-rgw-19.0.0-1855.g21b3bd67.el9 567 kB/s | 99 kB 00:00 2024-03-24T10:33:45.997 INFO:teuthology.orchestra.run.smithi079.stdout:(25/174): rbd-fuse-19.0.0-1855.g21b3bd67.el9.x8 238 kB/s | 85 kB 00:00 2024-03-24T10:33:46.702 INFO:teuthology.orchestra.run.smithi072.stdout:(10/174): ceph-radosgw-19.0.0-1855.g21b3bd67.el 1.9 MB/s | 9.8 MB 00:05 2024-03-24T10:33:46.894 INFO:teuthology.orchestra.run.smithi072.stdout:(11/174): cephfs-mirror-19.0.0-1855.g21b3bd67.e 1.1 MB/s | 219 kB 00:00 2024-03-24T10:33:47.003 INFO:teuthology.orchestra.run.smithi072.stdout:(12/174): cephfs-shell-19.0.0-1855.g21b3bd67.el 249 kB/s | 27 kB 00:00 2024-03-24T10:33:47.111 INFO:teuthology.orchestra.run.smithi072.stdout:(13/174): libcephfs-devel-19.0.0-1855.g21b3bd67 292 kB/s | 32 kB 00:00 2024-03-24T10:33:47.430 INFO:teuthology.orchestra.run.smithi079.stdout:(26/174): librgw2-19.0.0-1855.g21b3bd67.el9.x86 1.3 MB/s | 5.1 MB 00:03 2024-03-24T10:33:47.593 INFO:teuthology.orchestra.run.smithi079.stdout:(27/174): rbd-nbd-19.0.0-1855.g21b3bd67.el9.x86 1.1 MB/s | 170 kB 00:00 2024-03-24T10:33:47.673 INFO:teuthology.orchestra.run.smithi079.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1855.g 377 kB/s | 31 kB 00:00 2024-03-24T10:33:47.713 INFO:teuthology.orchestra.run.smithi072.stdout:(14/174): libcephfs2-19.0.0-1855.g21b3bd67.el9. 1.2 MB/s | 744 kB 00:00 2024-03-24T10:33:47.815 INFO:teuthology.orchestra.run.smithi079.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1855.g21b3bd6 976 kB/s | 138 kB 00:00 2024-03-24T10:33:47.964 INFO:teuthology.orchestra.run.smithi072.stdout:(15/174): libcephsqlite-19.0.0-1855.g21b3bd67.e 652 kB/s | 163 kB 00:00 2024-03-24T10:33:48.081 INFO:teuthology.orchestra.run.smithi072.stdout:(16/174): librados-devel-19.0.0-1855.g21b3bd67. 1.1 MB/s | 127 kB 00:00 2024-03-24T10:33:48.557 INFO:teuthology.orchestra.run.smithi072.stdout:(17/174): libradosstriper1-19.0.0-1855.g21b3bd6 1.0 MB/s | 499 kB 00:00 2024-03-24T10:33:48.718 INFO:teuthology.orchestra.run.smithi079.stdout:(30/174): ceph-mgr-dashboard-19.0.0-1855.g21b3b 2.0 MB/s | 1.8 MB 00:00 2024-03-24T10:33:49.140 INFO:teuthology.orchestra.run.smithi079.stdout:(31/174): rbd-mirror-19.0.0-1855.g21b3bd67.el9. 1.0 MB/s | 3.1 MB 00:03 2024-03-24T10:33:49.342 INFO:teuthology.orchestra.run.smithi079.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1855.g21 1.2 MB/s | 248 kB 00:00 2024-03-24T10:33:49.424 INFO:teuthology.orchestra.run.smithi079.stdout:(33/174): ceph-mgr-rook-19.0.0-1855.g21b3bd67.e 591 kB/s | 49 kB 00:00 2024-03-24T10:33:49.516 INFO:teuthology.orchestra.run.smithi079.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1855.g2 167 kB/s | 15 kB 00:00 2024-03-24T10:33:49.816 INFO:teuthology.orchestra.run.smithi079.stdout:(35/174): ceph-volume-19.0.0-1855.g21b3bd67.el9 879 kB/s | 264 kB 00:00 2024-03-24T10:33:50.475 INFO:teuthology.orchestra.run.smithi079.stdout:(36/174): cephadm-19.0.0-1855.g21b3bd67.el9.noa 1.1 MB/s | 748 kB 00:00 2024-03-24T10:33:50.550 INFO:teuthology.orchestra.run.smithi079.stdout:(37/174): cephfs-top-19.0.0-1855.g21b3bd67.el9. 243 kB/s | 18 kB 00:00 2024-03-24T10:33:50.692 INFO:teuthology.orchestra.run.smithi079.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-03-24T10:33:50.742 INFO:teuthology.orchestra.run.smithi079.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 18 MB/s | 920 kB 00:00 2024-03-24T10:33:50.776 INFO:teuthology.orchestra.run.smithi079.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 3.1 MB/s | 106 kB 00:00 2024-03-24T10:33:50.809 INFO:teuthology.orchestra.run.smithi079.stdout:(41/174): flex-2.6.4-9.el9.x86_64.rpm 9.1 MB/s | 307 kB 00:00 2024-03-24T10:33:50.843 INFO:teuthology.orchestra.run.smithi079.stdout:(42/174): flexiblas-3.0.4-8.el9.x86_64.rpm 948 kB/s | 32 kB 00:00 2024-03-24T10:33:50.935 INFO:teuthology.orchestra.run.smithi079.stdout:(43/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-03-24T10:33:51.005 INFO:teuthology.orchestra.run.smithi079.stdout:(44/174): flexiblas-openblas-openmp-3.0.4-8.el9 248 kB/s | 17 kB 00:00 2024-03-24T10:33:51.069 INFO:teuthology.orchestra.run.smithi079.stdout:(45/174): libaio-devel-0.3.111-13.el9.x86_64.rp 157 kB/s | 10 kB 00:00 2024-03-24T10:33:51.103 INFO:teuthology.orchestra.run.smithi079.stdout:(46/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.7 MB/s | 159 kB 00:00 2024-03-24T10:33:51.137 INFO:teuthology.orchestra.run.smithi079.stdout:(47/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-24T10:33:51.188 INFO:teuthology.orchestra.run.smithi079.stdout:(48/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-24T10:33:51.228 INFO:teuthology.orchestra.run.smithi079.stdout:(49/174): libtool-2.4.6-45.el9.x86_64.rpm 14 MB/s | 578 kB 00:00 2024-03-24T10:33:51.262 INFO:teuthology.orchestra.run.smithi079.stdout:(50/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2024-03-24T10:33:51.304 INFO:teuthology.orchestra.run.smithi079.stdout:(51/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.7 MB/s | 282 kB 00:00 2024-03-24T10:33:51.338 INFO:teuthology.orchestra.run.smithi079.stdout:(52/174): lua-5.4.4-4.el9.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2024-03-24T10:33:51.371 INFO:teuthology.orchestra.run.smithi079.stdout:(53/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 6.4 MB/s | 217 kB 00:00 2024-03-24T10:33:51.413 INFO:teuthology.orchestra.run.smithi079.stdout:(54/174): openblas-0.3.21-2.el9.x86_64.rpm 820 kB/s | 34 kB 00:00 2024-03-24T10:33:51.415 INFO:teuthology.orchestra.run.smithi072.stdout:(18/174): librgw2-19.0.0-1855.g21b3bd67.el9.x86 1.8 MB/s | 5.1 MB 00:02 2024-03-24T10:33:51.508 INFO:teuthology.orchestra.run.smithi072.stdout:(19/174): python3-ceph-argparse-19.0.0-1855.g21 493 kB/s | 45 kB 00:00 2024-03-24T10:33:51.547 INFO:teuthology.orchestra.run.smithi079.stdout:(55/174): openblas-openmp-0.3.21-2.el9.x86_64.r 36 MB/s | 4.7 MB 00:00 2024-03-24T10:33:51.614 INFO:teuthology.orchestra.run.smithi079.stdout:(56/174): postgresql-13.11-1.el9.x86_64.rpm 23 MB/s | 1.5 MB 00:00 2024-03-24T10:33:51.616 INFO:teuthology.orchestra.run.smithi072.stdout:(20/174): python3-ceph-common-19.0.0-1855.g21b3 1.2 MB/s | 131 kB 00:00 2024-03-24T10:33:51.665 INFO:teuthology.orchestra.run.smithi079.stdout:(57/174): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2024-03-24T10:33:51.698 INFO:teuthology.orchestra.run.smithi079.stdout:(58/174): postgresql-private-libs-13.11-1.el9.x 3.9 MB/s | 134 kB 00:00 2024-03-24T10:33:51.840 INFO:teuthology.orchestra.run.smithi079.stdout:(59/174): postgresql-server-13.11-1.el9.x86_64. 40 MB/s | 5.7 MB 00:00 2024-03-24T10:33:51.891 INFO:teuthology.orchestra.run.smithi079.stdout:(60/174): protobuf-3.14.0-13.el9.x86_64.rpm 20 MB/s | 1.0 MB 00:00 2024-03-24T10:33:51.924 INFO:teuthology.orchestra.run.smithi079.stdout:(61/174): python3-attrs-20.3.0-7.el9.noarch.rpm 2.3 MB/s | 78 kB 00:00 2024-03-24T10:33:51.951 INFO:teuthology.orchestra.run.smithi072.stdout:(21/174): ceph-osd-19.0.0-1855.g21b3bd67.el9.x8 1.5 MB/s | 17 MB 00:11 2024-03-24T10:33:51.976 INFO:teuthology.orchestra.run.smithi072.stdout:(22/174): python3-cephfs-19.0.0-1855.g21b3bd67. 449 kB/s | 161 kB 00:00 2024-03-24T10:33:52.069 INFO:teuthology.orchestra.run.smithi079.stdout:(62/174): python3-babel-2.9.1-2.el9.noarch.rpm 41 MB/s | 5.8 MB 00:00 2024-03-24T10:33:52.110 INFO:teuthology.orchestra.run.smithi079.stdout:(63/174): python3-jsonpatch-1.21-16.el9.noarch. 586 kB/s | 24 kB 00:00 2024-03-24T10:33:52.118 INFO:teuthology.orchestra.run.smithi072.stdout:(23/174): python3-rados-19.0.0-1855.g21b3bd67.e 1.9 MB/s | 320 kB 00:00 2024-03-24T10:33:52.141 INFO:teuthology.orchestra.run.smithi079.stdout:(64/174): python3-jsonpointer-2.0-4.el9.noarch. 544 kB/s | 18 kB 00:00 2024-03-24T10:33:52.152 INFO:teuthology.orchestra.run.smithi072.stdout:(24/174): python3-rbd-19.0.0-1855.g21b3bd67.el9 1.7 MB/s | 298 kB 00:00 2024-03-24T10:33:52.166 INFO:teuthology.orchestra.run.smithi079.stdout:(65/174): python3-mako-1.1.4-6.el9.noarch.rpm 5.7 MB/s | 144 kB 00:00 2024-03-24T10:33:52.177 INFO:teuthology.orchestra.run.smithi072.stdout:(25/174): python3-rgw-19.0.0-1855.g21b3bd67.el9 1.6 MB/s | 99 kB 00:00 2024-03-24T10:33:52.203 INFO:teuthology.orchestra.run.smithi079.stdout:(66/174): python3-markupsafe-1.1.1-12.el9.x86_6 946 kB/s | 32 kB 00:00 2024-03-24T10:33:52.269 INFO:teuthology.orchestra.run.smithi072.stdout:(26/174): rbd-fuse-19.0.0-1855.g21b3bd67.el9.x8 726 kB/s | 85 kB 00:00 2024-03-24T10:33:52.317 INFO:teuthology.orchestra.run.smithi079.stdout:(67/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2024-03-24T10:33:52.409 INFO:teuthology.orchestra.run.smithi079.stdout:(68/174): ceph-mgr-diskprediction-local-19.0.0- 2.0 MB/s | 7.4 MB 00:03 2024-03-24T10:33:52.428 INFO:teuthology.orchestra.run.smithi072.stdout:(27/174): rbd-nbd-19.0.0-1855.g21b3bd67.el9.x86 1.0 MB/s | 170 kB 00:00 2024-03-24T10:33:52.434 INFO:teuthology.orchestra.run.smithi079.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 217 kB 00:00 2024-03-24T10:33:52.460 INFO:teuthology.orchestra.run.smithi079.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-24T10:33:52.485 INFO:teuthology.orchestra.run.smithi079.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 69 kB 00:00 2024-03-24T10:33:52.510 INFO:teuthology.orchestra.run.smithi079.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 821 kB/s | 41 kB 00:00 2024-03-24T10:33:52.517 INFO:teuthology.orchestra.run.smithi072.stdout:(28/174): ceph-grafana-dashboards-19.0.0-1855.g 376 kB/s | 31 kB 00:00 2024-03-24T10:33:52.536 INFO:teuthology.orchestra.run.smithi079.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.6 MB/s | 238 kB 00:00 2024-03-24T10:33:52.561 INFO:teuthology.orchestra.run.smithi079.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-24T10:33:52.586 INFO:teuthology.orchestra.run.smithi079.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-03-24T10:33:52.613 INFO:teuthology.orchestra.run.smithi079.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 952 kB/s | 47 kB 00:00 2024-03-24T10:33:52.614 INFO:teuthology.orchestra.run.smithi072.stdout:(29/174): ceph-mgr-cephadm-19.0.0-1855.g21b3bd6 1.3 MB/s | 138 kB 00:00 2024-03-24T10:33:52.637 INFO:teuthology.orchestra.run.smithi079.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 854 kB/s | 43 kB 00:00 2024-03-24T10:33:52.804 INFO:teuthology.orchestra.run.smithi079.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 233 kB/s | 39 kB 00:00 2024-03-24T10:33:52.965 INFO:teuthology.orchestra.run.smithi072.stdout:(30/174): rbd-mirror-19.0.0-1855.g21b3bd67.el9. 3.9 MB/s | 3.1 MB 00:00 2024-03-24T10:33:52.988 INFO:teuthology.orchestra.run.smithi079.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-24T10:33:53.012 INFO:teuthology.orchestra.run.smithi079.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 198 kB/s | 41 kB 00:00 2024-03-24T10:33:53.055 INFO:teuthology.orchestra.run.smithi079.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 300 kB 00:00 2024-03-24T10:33:53.080 INFO:teuthology.orchestra.run.smithi079.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 842 kB/s | 56 kB 00:00 2024-03-24T10:33:53.114 INFO:teuthology.orchestra.run.smithi079.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2024-03-24T10:33:53.139 INFO:teuthology.orchestra.run.smithi079.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 754 kB/s | 44 kB 00:00 2024-03-24T10:33:53.173 INFO:teuthology.orchestra.run.smithi079.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-24T10:33:53.199 INFO:teuthology.orchestra.run.smithi079.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-03-24T10:33:53.240 INFO:teuthology.orchestra.run.smithi079.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-03-24T10:33:53.265 INFO:teuthology.orchestra.run.smithi079.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-24T10:33:53.291 INFO:teuthology.orchestra.run.smithi079.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-24T10:33:53.316 INFO:teuthology.orchestra.run.smithi079.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-03-24T10:33:53.524 INFO:teuthology.orchestra.run.smithi072.stdout:(31/174): ceph-mgr-dashboard-19.0.0-1855.g21b3b 2.0 MB/s | 1.8 MB 00:00 2024-03-24T10:33:53.542 INFO:teuthology.orchestra.run.smithi079.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 750 kB/s | 187 kB 00:00 2024-03-24T10:33:53.576 INFO:teuthology.orchestra.run.smithi079.stdout:(92/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-03-24T10:33:53.617 INFO:teuthology.orchestra.run.smithi079.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-03-24T10:33:53.636 INFO:teuthology.orchestra.run.smithi079.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-03-24T10:33:53.683 INFO:teuthology.orchestra.run.smithi072.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1855.g21 1.5 MB/s | 248 kB 00:00 2024-03-24T10:33:53.703 INFO:teuthology.orchestra.run.smithi079.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 258 kB/s | 21 kB 00:00 2024-03-24T10:33:53.726 INFO:teuthology.orchestra.run.smithi079.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 276 kB/s | 25 kB 00:00 2024-03-24T10:33:53.767 INFO:teuthology.orchestra.run.smithi072.stdout:(33/174): ceph-mgr-rook-19.0.0-1855.g21b3bd67.e 590 kB/s | 49 kB 00:00 2024-03-24T10:33:53.842 INFO:teuthology.orchestra.run.smithi079.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-03-24T10:33:53.850 INFO:teuthology.orchestra.run.smithi072.stdout:(34/174): ceph-prometheus-alerts-19.0.0-1855.g2 183 kB/s | 15 kB 00:00 2024-03-24T10:33:53.901 INFO:teuthology.orchestra.run.smithi079.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-03-24T10:33:53.960 INFO:teuthology.orchestra.run.smithi079.stdout:(99/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 16 MB/s | 4.1 MB 00:00 2024-03-24T10:33:53.985 INFO:teuthology.orchestra.run.smithi079.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.5 MB/s | 216 kB 00:00 2024-03-24T10:33:54.009 INFO:teuthology.orchestra.run.smithi072.stdout:(35/174): ceph-volume-19.0.0-1855.g21b3bd67.el9 1.6 MB/s | 264 kB 00:00 2024-03-24T10:33:54.015 INFO:teuthology.orchestra.run.smithi079.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 694 kB/s | 35 kB 00:00 2024-03-24T10:33:54.036 INFO:teuthology.orchestra.run.smithi079.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 886 kB/s | 44 kB 00:00 2024-03-24T10:33:54.061 INFO:teuthology.orchestra.run.smithi079.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-24T10:33:54.145 INFO:teuthology.orchestra.run.smithi079.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-03-24T10:33:54.253 INFO:teuthology.orchestra.run.smithi079.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-03-24T10:33:54.353 INFO:teuthology.orchestra.run.smithi079.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-03-24T10:33:54.404 INFO:teuthology.orchestra.run.smithi079.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 389 kB/s | 19 kB 00:00 2024-03-24T10:33:54.429 INFO:teuthology.orchestra.run.smithi079.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.7 MB/s | 309 kB 00:00 2024-03-24T10:33:54.460 INFO:teuthology.orchestra.run.smithi072.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 4.9 MB/s | 7.4 MB 00:01 2024-03-24T10:33:54.480 INFO:teuthology.orchestra.run.smithi079.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 515 kB/s | 26 kB 00:00 2024-03-24T10:33:54.494 INFO:teuthology.orchestra.run.smithi072.stdout:(37/174): cephadm-19.0.0-1855.g21b3bd67.el9.noa 1.5 MB/s | 748 kB 00:00 2024-03-24T10:33:54.530 INFO:teuthology.orchestra.run.smithi079.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 971 kB/s | 49 kB 00:00 2024-03-24T10:33:54.561 INFO:teuthology.orchestra.run.smithi072.stdout:(38/174): cephfs-top-19.0.0-1855.g21b3bd67.el9. 181 kB/s | 18 kB 00:00 2024-03-24T10:33:54.672 INFO:teuthology.orchestra.run.smithi079.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 475 kB/s | 67 kB 00:00 2024-03-24T10:33:54.678 INFO:teuthology.orchestra.run.smithi072.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 7.8 MB/s | 920 kB 00:00 2024-03-24T10:33:54.712 INFO:teuthology.orchestra.run.smithi072.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 662 kB 00:00 2024-03-24T10:33:54.738 INFO:teuthology.orchestra.run.smithi072.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-24T10:33:54.739 INFO:teuthology.orchestra.run.smithi079.stdout:(112/174): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-03-24T10:33:54.763 INFO:teuthology.orchestra.run.smithi072.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.9 MB/s | 307 kB 00:00 2024-03-24T10:33:54.764 INFO:teuthology.orchestra.run.smithi079.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-24T10:33:54.790 INFO:teuthology.orchestra.run.smithi072.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 612 kB/s | 32 kB 00:00 2024-03-24T10:33:54.823 INFO:teuthology.orchestra.run.smithi079.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 9.8 MB/s | 838 kB 00:00 2024-03-24T10:33:54.856 INFO:teuthology.orchestra.run.smithi079.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-03-24T10:33:54.882 INFO:teuthology.orchestra.run.smithi079.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 738 kB/s | 43 kB 00:00 2024-03-24T10:33:54.901 INFO:teuthology.orchestra.run.smithi072.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-03-24T10:33:54.907 INFO:teuthology.orchestra.run.smithi079.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-03-24T10:33:54.925 INFO:teuthology.orchestra.run.smithi072.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 130 kB/s | 17 kB 00:00 2024-03-24T10:33:54.932 INFO:teuthology.orchestra.run.smithi079.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-03-24T10:33:54.950 INFO:teuthology.orchestra.run.smithi072.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 198 kB/s | 10 kB 00:00 2024-03-24T10:33:54.958 INFO:teuthology.orchestra.run.smithi079.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-03-24T10:33:54.976 INFO:teuthology.orchestra.run.smithi072.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-24T10:33:55.001 INFO:teuthology.orchestra.run.smithi079.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-03-24T10:33:55.002 INFO:teuthology.orchestra.run.smithi072.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 876 kB/s | 44 kB 00:00 2024-03-24T10:33:55.025 INFO:teuthology.orchestra.run.smithi079.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-03-24T10:33:55.035 INFO:teuthology.orchestra.run.smithi072.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-24T10:33:55.050 INFO:teuthology.orchestra.run.smithi079.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 705 kB/s | 35 kB 00:00 2024-03-24T10:33:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2024-03-24T10:33:55.075 INFO:teuthology.orchestra.run.smithi079.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 4.0 MB/s | 203 kB 00:00 2024-03-24T10:33:55.087 INFO:teuthology.orchestra.run.smithi072.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 930 kB/s | 46 kB 00:00 2024-03-24T10:33:55.112 INFO:teuthology.orchestra.run.smithi072.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-03-24T10:33:55.117 INFO:teuthology.orchestra.run.smithi079.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-03-24T10:33:55.146 INFO:teuthology.orchestra.run.smithi072.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-03-24T10:33:55.159 INFO:teuthology.orchestra.run.smithi079.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-03-24T10:33:55.173 INFO:teuthology.orchestra.run.smithi072.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 217 kB 00:00 2024-03-24T10:33:55.198 INFO:teuthology.orchestra.run.smithi072.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 680 kB/s | 34 kB 00:00 2024-03-24T10:33:55.226 INFO:teuthology.orchestra.run.smithi079.stdout:(126/174): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-03-24T10:33:55.244 INFO:teuthology.orchestra.run.smithi079.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-03-24T10:33:55.268 INFO:teuthology.orchestra.run.smithi079.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 553 kB/s | 23 kB 00:00 2024-03-24T10:33:55.286 INFO:teuthology.orchestra.run.smithi079.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 463 kB/s | 19 kB 00:00 2024-03-24T10:33:55.302 INFO:teuthology.orchestra.run.smithi079.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 584 kB/s | 20 kB 00:00 2024-03-24T10:33:55.333 INFO:teuthology.orchestra.run.smithi072.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2024-03-24T10:33:55.336 INFO:teuthology.orchestra.run.smithi079.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-03-24T10:33:55.378 INFO:teuthology.orchestra.run.smithi079.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-03-24T10:33:55.382 INFO:teuthology.orchestra.run.smithi072.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 8.3 MB/s | 1.5 MB 00:00 2024-03-24T10:33:55.411 INFO:teuthology.orchestra.run.smithi079.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-03-24T10:33:55.426 INFO:teuthology.orchestra.run.smithi072.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 8.7 MB/s | 811 kB 00:00 2024-03-24T10:33:55.429 INFO:teuthology.orchestra.run.smithi079.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-03-24T10:33:55.451 INFO:teuthology.orchestra.run.smithi072.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2024-03-24T10:33:55.462 INFO:teuthology.orchestra.run.smithi079.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-03-24T10:33:55.487 INFO:teuthology.orchestra.run.smithi079.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-03-24T10:33:55.530 INFO:teuthology.orchestra.run.smithi079.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-03-24T10:33:55.556 INFO:teuthology.orchestra.run.smithi079.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 419 kB/s | 28 kB 00:00 2024-03-24T10:33:55.580 INFO:teuthology.orchestra.run.smithi079.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-03-24T10:33:55.601 INFO:teuthology.orchestra.run.smithi072.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 32 MB/s | 5.7 MB 00:00 2024-03-24T10:33:55.606 INFO:teuthology.orchestra.run.smithi079.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-03-24T10:33:55.639 INFO:teuthology.orchestra.run.smithi079.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-03-24T10:33:55.644 INFO:teuthology.orchestra.run.smithi072.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-03-24T10:33:55.665 INFO:teuthology.orchestra.run.smithi079.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 611 kB/s | 36 kB 00:00 2024-03-24T10:33:55.669 INFO:teuthology.orchestra.run.smithi072.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-24T10:33:55.690 INFO:teuthology.orchestra.run.smithi079.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-03-24T10:33:55.740 INFO:teuthology.orchestra.run.smithi079.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-24T10:33:55.765 INFO:teuthology.orchestra.run.smithi079.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-24T10:33:55.791 INFO:teuthology.orchestra.run.smithi079.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-03-24T10:33:55.816 INFO:teuthology.orchestra.run.smithi079.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-03-24T10:33:55.820 INFO:teuthology.orchestra.run.smithi072.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-03-24T10:33:55.837 INFO:teuthology.orchestra.run.smithi072.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 148 kB/s | 24 kB 00:00 2024-03-24T10:33:55.847 INFO:teuthology.orchestra.run.smithi079.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-03-24T10:33:55.859 INFO:teuthology.orchestra.run.smithi072.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 536 kB/s | 18 kB 00:00 2024-03-24T10:33:55.880 INFO:teuthology.orchestra.run.smithi072.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 144 kB 00:00 2024-03-24T10:33:55.897 INFO:teuthology.orchestra.run.smithi072.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 745 kB/s | 32 kB 00:00 2024-03-24T10:33:55.992 INFO:teuthology.orchestra.run.smithi079.stdout:(149/174): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-03-24T10:33:56.056 INFO:teuthology.orchestra.run.smithi072.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-03-24T10:33:56.081 INFO:teuthology.orchestra.run.smithi072.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-24T10:33:56.107 INFO:teuthology.orchestra.run.smithi072.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-03-24T10:33:56.150 INFO:teuthology.orchestra.run.smithi072.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 69 kB 00:00 2024-03-24T10:33:56.177 INFO:teuthology.orchestra.run.smithi072.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 592 kB/s | 41 kB 00:00 2024-03-24T10:33:56.202 INFO:teuthology.orchestra.run.smithi072.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 4.4 MB/s | 238 kB 00:00 2024-03-24T10:33:56.236 INFO:teuthology.orchestra.run.smithi072.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2024-03-24T10:33:56.262 INFO:teuthology.orchestra.run.smithi072.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.5 MB/s | 211 kB 00:00 2024-03-24T10:33:56.296 INFO:teuthology.orchestra.run.smithi072.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 803 kB/s | 47 kB 00:00 2024-03-24T10:33:56.321 INFO:teuthology.orchestra.run.smithi072.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 722 kB/s | 43 kB 00:00 2024-03-24T10:33:56.555 INFO:teuthology.orchestra.run.smithi072.stdout:(78/174): python3-toml-0.10.2-6.el9.noarch.rpm 165 kB/s | 39 kB 00:00 2024-03-24T10:33:57.047 INFO:teuthology.orchestra.run.smithi072.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-24T10:33:57.072 INFO:teuthology.orchestra.run.smithi072.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 79 kB/s | 41 kB 00:00 2024-03-24T10:33:57.207 INFO:teuthology.orchestra.run.smithi072.stdout:(81/174): socat-1.7.4.1-5.el9.x86_64.rpm 2.2 MB/s | 300 kB 00:00 2024-03-24T10:33:57.224 INFO:teuthology.orchestra.run.smithi072.stdout:(82/174): uuid-1.6.2-55.el9.x86_64.rpm 374 kB/s | 56 kB 00:00 2024-03-24T10:33:57.249 INFO:teuthology.orchestra.run.smithi072.stdout:(83/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-24T10:33:57.266 INFO:teuthology.orchestra.run.smithi072.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-24T10:33:57.319 INFO:teuthology.orchestra.run.smithi072.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-24T10:33:57.334 INFO:teuthology.orchestra.run.smithi072.stdout:(86/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-24T10:33:57.411 INFO:teuthology.orchestra.run.smithi072.stdout:(87/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-24T10:33:57.437 INFO:teuthology.orchestra.run.smithi072.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-03-24T10:33:57.462 INFO:teuthology.orchestra.run.smithi072.stdout:(89/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-24T10:33:57.488 INFO:teuthology.orchestra.run.smithi072.stdout:(90/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2024-03-24T10:33:58.347 INFO:teuthology.orchestra.run.smithi072.stdout:(91/174): jq-1.6-16.el9.x86_64.rpm 212 kB/s | 187 kB 00:00 2024-03-24T10:33:59.047 INFO:teuthology.orchestra.run.smithi072.stdout:(92/174): libgfortran-11.4.1-3.el9.x86_64.rpm 515 kB/s | 803 kB 00:01 2024-03-24T10:33:59.181 INFO:teuthology.orchestra.run.smithi072.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 234 kB/s | 195 kB 00:00 2024-03-24T10:33:59.258 INFO:teuthology.orchestra.run.smithi079.stdout:(150/174): ceph-test-19.0.0-1855.g21b3bd67.el9. 2.4 MB/s | 47 MB 00:19 2024-03-24T10:33:59.374 INFO:teuthology.orchestra.run.smithi072.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 112 kB/s | 21 kB 00:00 2024-03-24T10:33:59.383 INFO:teuthology.orchestra.run.smithi079.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.6 MB/s | 321 kB 00:00 2024-03-24T10:33:59.449 INFO:teuthology.orchestra.run.smithi072.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 526 kB/s | 25 kB 00:00 2024-03-24T10:33:59.658 INFO:teuthology.orchestra.run.smithi072.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 20 MB/s | 4.1 MB 00:00 2024-03-24T10:33:59.742 INFO:teuthology.orchestra.run.smithi072.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-03-24T10:33:59.775 INFO:teuthology.orchestra.run.smithi079.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2024-03-24T10:33:59.823 INFO:teuthology.orchestra.run.smithi072.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-03-24T10:33:59.893 INFO:teuthology.orchestra.run.smithi072.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.8 MB/s | 216 kB 00:00 2024-03-24T10:33:59.942 INFO:teuthology.orchestra.run.smithi079.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-03-24T10:33:59.943 INFO:teuthology.orchestra.run.smithi072.stdout:(100/174): python3-requests-2.25.1-8.el9.noarch 139 kB/s | 125 kB 00:00 2024-03-24T10:33:59.961 INFO:teuthology.orchestra.run.smithi072.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 517 kB/s | 35 kB 00:00 2024-03-24T10:33:59.992 INFO:teuthology.orchestra.run.smithi079.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 847 kB/s | 42 kB 00:00 2024-03-24T10:34:00.004 INFO:teuthology.orchestra.run.smithi072.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 733 kB/s | 44 kB 00:00 2024-03-24T10:34:00.038 INFO:teuthology.orchestra.run.smithi072.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-24T10:34:00.059 INFO:teuthology.orchestra.run.smithi079.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 3.6 MB/s | 248 kB 00:00 2024-03-24T10:34:00.097 INFO:teuthology.orchestra.run.smithi072.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 241 kB/s | 22 kB 00:00 2024-03-24T10:34:00.126 INFO:teuthology.orchestra.run.smithi079.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-03-24T10:34:00.185 INFO:teuthology.orchestra.run.smithi079.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 624 kB/s | 36 kB 00:00 2024-03-24T10:34:00.252 INFO:teuthology.orchestra.run.smithi079.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-24T10:34:00.335 INFO:teuthology.orchestra.run.smithi079.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-24T10:34:00.394 INFO:teuthology.orchestra.run.smithi079.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 395 kB/s | 23 kB 00:00 2024-03-24T10:34:00.406 INFO:teuthology.orchestra.run.smithi072.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-03-24T10:34:00.469 INFO:teuthology.orchestra.run.smithi079.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 108 kB 00:00 2024-03-24T10:34:00.519 INFO:teuthology.orchestra.run.smithi079.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-24T10:34:00.579 INFO:teuthology.orchestra.run.smithi079.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-24T10:34:00.582 INFO:teuthology.orchestra.run.smithi072.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-24T10:34:00.645 INFO:teuthology.orchestra.run.smithi079.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 961 kB/s | 64 kB 00:00 2024-03-24T10:34:00.649 INFO:teuthology.orchestra.run.smithi072.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 292 kB/s | 19 kB 00:00 2024-03-24T10:34:00.704 INFO:teuthology.orchestra.run.smithi079.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 489 kB/s | 29 kB 00:00 2024-03-24T10:34:00.799 INFO:teuthology.orchestra.run.smithi072.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 786 kB/s | 309 kB 00:00 2024-03-24T10:34:00.810 INFO:teuthology.orchestra.run.smithi079.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-03-24T10:34:00.875 INFO:teuthology.orchestra.run.smithi072.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-24T10:34:00.912 INFO:teuthology.orchestra.run.smithi079.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 20 MB/s | 2.2 MB 00:00 2024-03-24T10:34:00.951 INFO:teuthology.orchestra.run.smithi072.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-03-24T10:34:01.055 INFO:teuthology.orchestra.run.smithi079.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 16 MB/s | 2.3 MB 00:00 2024-03-24T10:34:01.130 INFO:teuthology.orchestra.run.smithi079.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 6.1 MB/s | 465 kB 00:00 2024-03-24T10:34:01.188 INFO:teuthology.orchestra.run.smithi079.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 536 kB/s | 31 kB 00:00 2024-03-24T10:34:01.264 INFO:teuthology.orchestra.run.smithi079.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2024-03-24T10:34:01.372 INFO:teuthology.orchestra.run.smithi079.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 687 kB/s | 74 kB 00:00 2024-03-24T10:34:01.793 INFO:teuthology.orchestra.run.smithi072.stdout:(111/174): ceph-test-19.0.0-1855.g21b3bd67.el9. 2.7 MB/s | 47 MB 00:17 2024-03-24T10:34:01.806 INFO:teuthology.orchestra.run.smithi079.stdout:(173/174): librbd1-19.0.0-1855.g21b3bd67.el9.x8 552 kB/s | 3.1 MB 00:05 2024-03-24T10:34:01.818 INFO:teuthology.orchestra.run.smithi072.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 78 kB/s | 67 kB 00:00 2024-03-24T10:34:01.919 INFO:teuthology.orchestra.run.smithi072.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 4.4 MB 00:01 2024-03-24T10:34:02.038 INFO:teuthology.orchestra.run.smithi072.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.8 MB/s | 838 kB 00:00 2024-03-24T10:34:02.064 INFO:teuthology.orchestra.run.smithi079.stdout:(174/174): librados2-19.0.0-1855.g21b3bd67.el9. 557 kB/s | 3.4 MB 00:06 2024-03-24T10:34:02.070 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:34:02.071 INFO:teuthology.orchestra.run.smithi079.stdout:Total 7.3 MB/s | 224 MB 00:30 2024-03-24T10:34:02.078 INFO:teuthology.orchestra.run.smithi072.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-03-24T10:34:02.104 INFO:teuthology.orchestra.run.smithi072.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 647 kB/s | 43 kB 00:00 2024-03-24T10:34:02.148 INFO:teuthology.orchestra.run.smithi072.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 466 kB/s | 32 kB 00:00 2024-03-24T10:34:02.173 INFO:teuthology.orchestra.run.smithi072.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 217 kB/s | 15 kB 00:00 2024-03-24T10:34:02.199 INFO:teuthology.orchestra.run.smithi072.stdout:(119/174): luarocks-3.9.2-1.el9.noarch.rpm 373 kB/s | 151 kB 00:00 2024-03-24T10:34:02.233 INFO:teuthology.orchestra.run.smithi072.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-24T10:34:02.306 INFO:teuthology.orchestra.run.smithi072.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-03-24T10:34:02.334 INFO:teuthology.orchestra.run.smithi072.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 350 kB/s | 35 kB 00:00 2024-03-24T10:34:02.367 INFO:teuthology.orchestra.run.smithi072.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.8 MB/s | 303 kB 00:00 2024-03-24T10:34:02.393 INFO:teuthology.orchestra.run.smithi072.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.3 MB/s | 203 kB 00:00 2024-03-24T10:34:02.452 INFO:teuthology.orchestra.run.smithi072.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-24T10:34:02.477 INFO:teuthology.orchestra.run.smithi072.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 127 kB/s | 11 kB 00:00 2024-03-24T10:34:02.522 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-03-24T10:34:02.545 INFO:teuthology.orchestra.run.smithi072.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-03-24T10:34:02.570 INFO:teuthology.orchestra.run.smithi072.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 150 kB/s | 18 kB 00:00 2024-03-24T10:34:02.595 INFO:teuthology.orchestra.run.smithi072.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 197 kB/s | 23 kB 00:00 2024-03-24T10:34:02.621 INFO:teuthology.orchestra.run.smithi072.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 256 kB/s | 19 kB 00:00 2024-03-24T10:34:02.663 INFO:teuthology.orchestra.run.smithi072.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-03-24T10:34:02.689 INFO:teuthology.orchestra.run.smithi072.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 687 kB/s | 46 kB 00:00 2024-03-24T10:34:02.732 INFO:teuthology.orchestra.run.smithi072.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-03-24T10:34:02.766 INFO:teuthology.orchestra.run.smithi072.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 746 kB/s | 58 kB 00:00 2024-03-24T10:34:02.796 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-03-24T10:34:02.796 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-03-24T10:34:02.800 INFO:teuthology.orchestra.run.smithi072.stdout:(135/174): python3-kubernetes-26.1.0-2.el9.noar 5.0 MB/s | 1.0 MB 00:00 2024-03-24T10:34:02.834 INFO:teuthology.orchestra.run.smithi072.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-03-24T10:34:02.860 INFO:teuthology.orchestra.run.smithi072.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 176 kB/s | 16 kB 00:00 2024-03-24T10:34:02.885 INFO:teuthology.orchestra.run.smithi072.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-03-24T10:34:02.911 INFO:teuthology.orchestra.run.smithi072.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 370 kB/s | 28 kB 00:00 2024-03-24T10:34:02.936 INFO:teuthology.orchestra.run.smithi072.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 404 kB/s | 31 kB 00:00 2024-03-24T10:34:02.962 INFO:teuthology.orchestra.run.smithi072.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-24T10:34:02.987 INFO:teuthology.orchestra.run.smithi072.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 778 kB/s | 59 kB 00:00 2024-03-24T10:34:03.013 INFO:teuthology.orchestra.run.smithi072.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 469 kB/s | 36 kB 00:00 2024-03-24T10:34:03.038 INFO:teuthology.orchestra.run.smithi072.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 670 kB/s | 51 kB 00:00 2024-03-24T10:34:03.064 INFO:teuthology.orchestra.run.smithi072.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.9 MB/s | 230 kB 00:00 2024-03-24T10:34:03.089 INFO:teuthology.orchestra.run.smithi072.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-03-24T10:34:03.123 INFO:teuthology.orchestra.run.smithi072.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.9 MB/s | 427 kB 00:00 2024-03-24T10:34:03.142 INFO:teuthology.orchestra.run.smithi072.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 256 kB/s | 20 kB 00:00 2024-03-24T10:34:03.176 INFO:teuthology.orchestra.run.smithi072.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-24T10:34:03.259 INFO:teuthology.orchestra.run.smithi072.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-03-24T10:34:03.344 INFO:teuthology.orchestra.run.smithi072.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-03-24T10:34:04.128 INFO:teuthology.orchestra.run.smithi072.stdout:(152/174): librados2-19.0.0-1855.g21b3bd67.el9. 3.4 MB/s | 3.4 MB 00:00 2024-03-24T10:34:04.778 INFO:teuthology.orchestra.run.smithi072.stdout:(153/174): librbd1-19.0.0-1855.g21b3bd67.el9.x8 2.0 MB/s | 3.1 MB 00:01 2024-03-24T10:34:04.815 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-03-24T10:34:04.815 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-03-24T10:34:05.412 INFO:teuthology.orchestra.run.smithi072.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 66 kB/s | 42 kB 00:00 2024-03-24T10:34:06.295 INFO:teuthology.orchestra.run.smithi072.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 282 kB/s | 248 kB 00:00 2024-03-24T10:34:06.913 INFO:teuthology.orchestra.run.smithi072.stdout:(156/174): NetworkManager-1.47.2-1.el9.x86_64.r 661 kB/s | 2.3 MB 00:03 2024-03-24T10:34:06.988 INFO:teuthology.orchestra.run.smithi072.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 103 kB/s | 71 kB 00:00 2024-03-24T10:34:07.047 INFO:teuthology.orchestra.run.smithi072.stdout:(158/174): NetworkManager-libnm-1.47.2-1.el9.x8 643 kB/s | 1.8 MB 00:02 2024-03-24T10:34:07.581 INFO:teuthology.orchestra.run.smithi072.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 55 kB/s | 36 kB 00:00 2024-03-24T10:34:07.856 INFO:teuthology.orchestra.run.smithi072.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 222 kB/s | 192 kB 00:00 2024-03-24T10:34:08.015 INFO:teuthology.orchestra.run.smithi072.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 264 kB/s | 256 kB 00:00 2024-03-24T10:34:08.149 INFO:teuthology.orchestra.run.smithi072.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 41 kB/s | 23 kB 00:00 2024-03-24T10:34:08.599 INFO:teuthology.orchestra.run.smithi072.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 146 kB/s | 108 kB 00:00 2024-03-24T10:34:08.826 INFO:teuthology.orchestra.run.smithi072.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 191 kB/s | 155 kB 00:00 2024-03-24T10:34:08.910 INFO:teuthology.orchestra.run.smithi072.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 178 kB/s | 136 kB 00:00 2024-03-24T10:34:09.277 INFO:teuthology.orchestra.run.smithi072.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 94 kB/s | 64 kB 00:00 2024-03-24T10:34:09.436 INFO:teuthology.orchestra.run.smithi072.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 49 kB/s | 29 kB 00:00 2024-03-24T10:34:11.012 INFO:teuthology.orchestra.run.smithi072.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 590 kB/s | 1.2 MB 00:02 2024-03-24T10:34:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-03-24T10:34:11.808 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-24T10:34:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-24T10:34:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-24T10:34:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-24T10:34:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-24T10:34:11.993 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-24T10:34:12.026 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-24T10:34:12.052 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-24T10:34:12.098 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-24T10:34:12.370 INFO:teuthology.orchestra.run.smithi072.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 342 kB/s | 465 kB 00:01 2024-03-24T10:34:12.422 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-24T10:34:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 10/198 2024-03-24T10:34:12.590 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 10/198 2024-03-24T10:34:12.653 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 11/198 2024-03-24T10:34:12.729 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 11/198 2024-03-24T10:34:12.765 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.0.0-1855.g21b3bd67.el9.x86_64 12/198 2024-03-24T10:34:12.779 INFO:teuthology.orchestra.run.smithi072.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 630 kB/s | 2.2 MB 00:03 2024-03-24T10:34:12.807 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-24T10:34:12.980 INFO:teuthology.orchestra.run.smithi072.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 51 kB/s | 31 kB 00:00 2024-03-24T10:34:12.996 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-24T10:34:13.038 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-24T10:34:13.069 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 16/198 2024-03-24T10:34:13.088 INFO:teuthology.orchestra.run.smithi072.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 640 kB/s | 2.3 MB 00:03 2024-03-24T10:34:13.114 INFO:teuthology.orchestra.run.smithi072.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 556 kB/s | 74 kB 00:00 2024-03-24T10:34:13.162 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 16/198 2024-03-24T10:34:13.185 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86 17/198 2024-03-24T10:34:13.250 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86 17/198 2024-03-24T10:34:13.288 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-24T10:34:13.311 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-24T10:34:13.332 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-24T10:34:13.521 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-24T10:34:13.553 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-24T10:34:13.584 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-24T10:34:13.766 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-24T10:34:13.923 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-24T10:34:13.981 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-24T10:34:14.066 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-24T10:34:14.116 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-24T10:34:14.330 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-24T10:34:14.436 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-24T10:34:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-24T10:34:14.564 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-24T10:34:14.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-24T10:34:14.634 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-24T10:34:14.706 INFO:teuthology.orchestra.run.smithi072.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 571 kB/s | 1.1 MB 00:01 2024-03-24T10:34:14.706 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-24T10:34:14.711 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:34:14.711 INFO:teuthology.orchestra.run.smithi072.stdout:Total 5.6 MB/s | 224 MB 00:40 2024-03-24T10:34:14.760 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-24T10:34:14.800 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-24T10:34:14.864 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-24T10:34:14.899 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-24T10:34:14.967 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-24T10:34:15.001 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-24T10:34:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-24T10:34:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-24T10:34:15.134 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.0.0-1855.g21b3bd67.el9. 39/198 2024-03-24T10:34:15.164 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-24T10:34:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.0.0-1855.g21b3bd67.el 40/198 2024-03-24T10:34:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.0.0-1855.g21b3bd67.el9.x86_6 41/198 2024-03-24T10:34:15.276 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-24T10:34:15.321 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-24T10:34:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-24T10:34:15.441 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-24T10:34:15.441 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-24T10:34:15.525 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-24T10:34:15.581 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-24T10:34:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-24T10:34:16.169 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-24T10:34:16.246 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-24T10:34:16.290 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-24T10:34:16.298 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-24T10:34:16.332 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-24T10:34:16.372 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-24T10:34:16.409 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.0.0-1855.g21b3bd67.el9.x86_6 53/198 2024-03-24T10:34:16.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-24T10:34:16.709 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-24T10:34:16.907 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-24T10:34:16.993 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-24T10:34:17.037 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-24T10:34:17.193 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-24T10:34:17.241 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-24T10:34:17.295 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-24T10:34:17.359 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-24T10:34:17.393 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-24T10:34:17.429 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-24T10:34:17.475 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-24T10:34:17.511 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-24T10:34:17.525 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-24T10:34:17.525 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-24T10:34:17.554 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-24T10:34:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-24T10:34:17.730 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-24T10:34:17.778 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-24T10:34:17.808 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-24T10:34:17.849 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-24T10:34:17.943 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-24T10:34:18.017 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-24T10:34:18.057 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-24T10:34:18.083 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-24T10:34:18.108 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-24T10:34:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-24T10:34:18.341 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-24T10:34:18.457 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-24T10:34:18.500 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-24T10:34:18.549 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-24T10:34:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-24T10:34:18.794 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-24T10:34:18.842 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-24T10:34:18.965 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-24T10:34:19.004 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-24T10:34:19.036 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-24T10:34:19.067 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-24T10:34:19.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-24T10:34:19.129 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-24T10:34:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-24T10:34:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-24T10:34:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-24T10:34:19.315 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-24T10:34:19.350 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-24T10:34:19.383 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-24T10:34:19.424 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-24T10:34:19.459 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-24T10:34:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-24T10:34:19.630 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-24T10:34:19.673 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-24T10:34:19.705 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-24T10:34:19.753 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-24T10:34:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-24T10:34:19.899 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-24T10:34:20.624 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-24T10:34:20.674 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-24T10:34:20.700 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-24T10:34:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-24T10:34:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-24T10:34:20.901 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-24T10:34:21.068 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-24T10:34:21.099 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-24T10:34:21.177 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-24T10:34:21.813 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-24T10:34:22.206 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-24T10:34:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-24T10:34:23.511 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-24T10:34:23.543 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-24T10:34:23.574 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-24T10:34:23.602 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-24T10:34:23.911 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-24T10:34:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 124/198 2024-03-24T10:34:24.034 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 124/198 2024-03-24T10:34:24.062 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 125/198 2024-03-24T10:34:24.098 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-24T10:34:24.549 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-24T10:34:24.577 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 128/198 2024-03-24T10:34:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 128/198 2024-03-24T10:34:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 129/198 2024-03-24T10:34:24.817 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-24T10:34:24.955 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-24T10:34:24.999 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-24T10:34:25.037 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-24T10:34:25.046 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-24T10:34:25.096 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-24T10:34:25.150 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-24T10:34:25.189 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-24T10:34:25.223 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-24T10:34:25.277 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-24T10:34:25.632 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-24T10:34:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 10/198 2024-03-24T10:34:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 10/198 2024-03-24T10:34:25.898 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 11/198 2024-03-24T10:34:25.972 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 11/198 2024-03-24T10:34:26.018 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:19.0.0-1855.g21b3bd67.el9.x86_64 12/198 2024-03-24T10:34:26.075 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-24T10:34:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-24T10:34:26.313 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-24T10:34:26.334 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 16/198 2024-03-24T10:34:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 16/198 2024-03-24T10:34:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86 17/198 2024-03-24T10:34:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86 17/198 2024-03-24T10:34:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-24T10:34:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-24T10:34:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-24T10:34:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-24T10:34:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-24T10:34:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-24T10:34:26.851 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 130/198 2024-03-24T10:34:26.893 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 130/198 2024-03-24T10:34:27.265 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-24T10:34:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-24T10:34:27.404 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-24T10:34:27.427 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 130/198 2024-03-24T10:34:27.472 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 131/198 2024-03-24T10:34:27.549 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 131/198 2024-03-24T10:34:27.549 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-24T10:34:27.549 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-24T10:34:27.549 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:27.569 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-24T10:34:27.590 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 132/198 2024-03-24T10:34:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-24T10:34:27.871 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-24T10:34:27.986 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-24T10:34:28.087 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-24T10:34:28.117 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-24T10:34:28.150 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-24T10:34:28.189 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-24T10:34:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-24T10:34:28.319 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-24T10:34:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-24T10:34:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-24T10:34:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-24T10:34:28.529 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-24T10:34:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-24T10:34:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-24T10:34:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-24T10:34:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:19.0.0-1855.g21b3bd67.el9. 39/198 2024-03-24T10:34:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:19.0.0-1855.g21b3bd67.el 40/198 2024-03-24T10:34:28.794 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:19.0.0-1855.g21b3bd67.el9.x86_6 41/198 2024-03-24T10:34:28.872 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-24T10:34:28.919 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-24T10:34:28.993 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-24T10:34:29.136 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-24T10:34:29.191 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-24T10:34:29.709 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-24T10:34:29.799 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-24T10:34:29.896 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-24T10:34:29.973 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-24T10:34:29.982 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-24T10:34:30.019 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-24T10:34:30.077 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-24T10:34:30.110 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:19.0.0-1855.g21b3bd67.el9.x86_6 53/198 2024-03-24T10:34:30.142 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-24T10:34:30.411 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-24T10:34:30.602 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-24T10:34:30.679 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-24T10:34:30.724 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-24T10:34:30.857 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-24T10:34:30.906 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-24T10:34:30.969 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-24T10:34:31.042 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-24T10:34:31.081 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-24T10:34:31.113 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-24T10:34:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-24T10:34:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-24T10:34:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-24T10:34:31.284 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-24T10:34:31.427 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-24T10:34:31.468 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-24T10:34:31.498 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-24T10:34:31.541 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-24T10:34:31.635 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-24T10:34:31.673 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-24T10:34:31.701 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-24T10:34:31.738 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-24T10:34:31.769 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-24T10:34:31.866 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-24T10:34:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-24T10:34:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-24T10:34:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-24T10:34:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-24T10:34:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-24T10:34:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-24T10:34:32.495 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-24T10:34:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-24T10:34:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-24T10:34:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-24T10:34:32.761 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-24T10:34:32.788 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-24T10:34:32.823 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-24T10:34:32.862 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-24T10:34:32.911 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-24T10:34:32.944 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-24T10:34:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-24T10:34:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-24T10:34:33.427 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-24T10:34:33.591 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-24T10:34:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-24T10:34:33.709 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-24T10:34:33.798 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-24T10:34:33.842 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-24T10:34:33.883 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-24T10:34:33.934 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-24T10:34:34.040 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-24T10:34:34.099 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-24T10:34:34.826 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-24T10:34:34.881 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-24T10:34:34.908 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-24T10:34:34.956 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-24T10:34:35.046 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-24T10:34:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-24T10:34:35.249 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-24T10:34:35.285 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-24T10:34:35.372 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-24T10:34:36.021 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-24T10:34:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-24T10:34:37.376 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-24T10:34:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-24T10:34:37.500 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-24T10:34:37.533 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-24T10:34:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-24T10:34:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-24T10:34:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 124/198 2024-03-24T10:34:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 124/198 2024-03-24T10:34:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 125/198 2024-03-24T10:34:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-24T10:34:38.529 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-24T10:34:38.558 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 128/198 2024-03-24T10:34:38.638 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 128/198 2024-03-24T10:34:38.669 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 129/198 2024-03-24T10:34:39.355 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 132/198 2024-03-24T10:34:39.355 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-03-24T10:34:39.355 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-03-24T10:34:39.355 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-03-24T10:34:39.356 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-03-24T10:34:39.356 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-03-24T10:34:39.356 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-03-24T10:34:39.356 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-03-24T10:34:39.356 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:39.519 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 133/198 2024-03-24T10:34:39.535 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 133/198 2024-03-24T10:34:39.536 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:39.536 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-24T10:34:39.536 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:40.925 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 130/198 2024-03-24T10:34:40.964 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 130/198 2024-03-24T10:34:40.998 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 134/198 2024-03-24T10:34:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 134/198 2024-03-24T10:34:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-24T10:34:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-24T10:34:41.024 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-24T10:34:41.024 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:41.249 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 135/198 2024-03-24T10:34:41.271 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 135/198 2024-03-24T10:34:41.271 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:41.271 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-24T10:34:41.271 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-24T10:34:41.272 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-24T10:34:41.272 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:41.500 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 130/198 2024-03-24T10:34:41.546 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 131/198 2024-03-24T10:34:41.644 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 131/198 2024-03-24T10:34:41.644 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-24T10:34:41.644 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-24T10:34:41.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:34:41.682 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 132/198 2024-03-24T10:34:41.708 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 136/198 2024-03-24T10:34:41.730 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 136/198 2024-03-24T10:34:41.731 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:41.731 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-24T10:34:41.731 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-24T10:34:41.731 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-24T10:34:41.731 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:41.827 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-24T10:34:42.286 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 138/198 2024-03-24T10:34:42.317 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 138/198 2024-03-24T10:34:42.341 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1855.g21b3bd67.e 139/198 2024-03-24T10:34:42.392 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1855.g21b3bd67. 140/198 2024-03-24T10:34:42.416 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noa 141/198 2024-03-24T10:34:42.647 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noa 141/198 2024-03-24T10:34:42.675 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.n 142/198 2024-03-24T10:34:43.636 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.n 142/198 2024-03-24T10:34:43.667 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b 143/198 2024-03-24T10:34:43.767 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b 143/198 2024-03-24T10:34:43.930 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1855.g21b3bd67.el 144/198 2024-03-24T10:34:43.953 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 145/198 2024-03-24T10:34:43.976 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 145/198 2024-03-24T10:34:43.976 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:43.976 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-24T10:34:43.976 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-24T10:34:43.976 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-24T10:34:43.976 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:44.021 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 146/198 2024-03-24T10:34:44.031 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 146/198 2024-03-24T10:34:44.080 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.0.0-1855.g21b3bd67.el9.x86_64 147/198 2024-03-24T10:34:44.940 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-24T10:34:44.973 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 149/198 2024-03-24T10:34:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 149/198 2024-03-24T10:34:44.996 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:44.996 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-24T10:34:44.996 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-24T10:34:44.996 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-24T10:34:44.996 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:45.041 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1855.g21b3b 150/198 2024-03-24T10:34:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1855.g21b3b 150/198 2024-03-24T10:34:45.066 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:45.066 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-24T10:34:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 151/198 2024-03-24T10:34:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 151/198 2024-03-24T10:34:45.130 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:45.130 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-24T10:34:45.130 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-24T10:34:45.131 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-24T10:34:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:45.434 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 152/198 2024-03-24T10:34:45.456 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 152/198 2024-03-24T10:34:45.456 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:45.456 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-24T10:34:45.456 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-24T10:34:45.456 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-24T10:34:45.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:34:49.889 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.0.0-1855.g21b3bd67.el9.x86_64 153/198 2024-03-24T10:34:49.930 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 154/198 2024-03-24T10:34:49.961 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 155/198 2024-03-24T10:34:49.988 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-24T10:34:50.170 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.0.0-1855.g21b3bd67.el9.x86_64 157/198 2024-03-24T10:34:50.288 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-24T10:34:50.329 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 159/198 2024-03-24T10:34:50.384 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-24T10:34:50.437 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-24T10:34:50.473 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-24T10:34:50.505 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.0.0-1855.g21b3bd67.el9.x86_ 163/198 2024-03-24T10:34:50.546 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-24T10:34:50.576 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-24T10:34:50.646 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-24T10:34:50.701 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-24T10:34:50.725 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-24T10:34:51.324 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-24T10:34:51.366 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-24T10:34:51.385 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-24T10:34:52.197 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.0.0-1855.g21b3bd67.el9.noarch 170/198 2024-03-24T10:34:52.289 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-24T10:34:52.328 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-24T10:34:52.422 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-24T10:34:52.450 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-24T10:34:52.475 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-24T10:34:52.501 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-24T10:34:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-24T10:34:52.529 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-24T10:34:52.615 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-24T10:34:52.645 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-24T10:34:52.645 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-24T10:34:52.713 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-24T10:34:52.748 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-24T10:34:52.773 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-24T10:34:52.799 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-24T10:34:52.824 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-24T10:34:52.857 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-24T10:34:52.896 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-24T10:34:52.946 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-24T10:34:52.971 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-24T10:34:53.005 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-24T10:34:53.030 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-24T10:34:53.056 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-24T10:34:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-24T10:34:53.066 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-24T10:34:53.242 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-24T10:34:53.242 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-24T10:34:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-24T10:34:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-24T10:34:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-24T10:34:53.409 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-24T10:34:53.434 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-24T10:34:53.503 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-24T10:34:57.005 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 132/198 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /root 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2024-03-24T10:34:57.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:34:57.173 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 133/198 2024-03-24T10:34:57.188 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 133/198 2024-03-24T10:34:57.188 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:57.188 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-24T10:34:57.188 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:34:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-24T10:34:58.658 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.0.0-1855.g21b3bd67.el9.x86_64 1/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 2/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 3/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 4/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1855.g21b3b 5/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 6/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 7/198 2024-03-24T10:34:58.659 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 8/198 2024-03-24T10:34:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 9/198 2024-03-24T10:34:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 10/198 2024-03-24T10:34:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 11/198 2024-03-24T10:34:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.0.0-1855.g21b3bd67.el9.x86_64 12/198 2024-03-24T10:34:58.660 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 13/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.0.0-1855.g21b3bd67.el9.x86_64 14/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.0.0-1855.g21b3bd67.el9.x86_ 15/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 16/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 17/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.0.0-1855.g21b3bd67.el9.x86_6 18/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86 19/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 20/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1855.g21b3bd67.el 21/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.0.0-1855.g21b3bd67.el9. 22/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.0.0-1855.g21b3bd67.el9.x86_6 23/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.0.0-1855.g21b3bd67.el9.x86_64 24/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 25/198 2024-03-24T10:34:58.661 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 26/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 27/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 28/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 29/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1855.g21b3bd67. 30/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noa 31/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.n 32/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b 33/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1855.g21b3bd67.el 34/198 2024-03-24T10:34:58.662 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 35/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1855.g21b3bd67.e 36/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 37/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 38/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.0.0-1855.g21b3bd67.el9.noarch 39/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-24T10:34:58.663 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-24T10:34:58.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-24T10:34:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-24T10:34:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-24T10:34:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-24T10:34:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-24T10:34:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-24T10:34:58.665 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-24T10:34:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-24T10:34:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-24T10:34:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-24T10:34:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-24T10:34:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-24T10:34:58.666 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-24T10:34:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-24T10:34:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-24T10:34:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-24T10:34:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-24T10:34:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-24T10:34:58.668 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-24T10:34:58.669 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-24T10:34:58.670 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-24T10:34:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-24T10:34:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-24T10:34:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-24T10:34:58.672 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-24T10:34:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-24T10:34:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-24T10:34:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-24T10:34:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-24T10:34:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-24T10:34:58.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-24T10:34:58.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-24T10:34:58.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-24T10:34:58.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 151/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 153/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-24T10:34:58.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-24T10:34:58.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-24T10:34:58.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-24T10:34:58.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-24T10:34:58.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-24T10:34:58.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-24T10:34:58.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-24T10:34:58.691 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 134/198 2024-03-24T10:34:58.714 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 134/198 2024-03-24T10:34:58.714 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:58.714 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-24T10:34:58.714 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-24T10:34:58.715 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-24T10:34:58.715 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:34:58.941 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 135/198 2024-03-24T10:34:58.963 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 135/198 2024-03-24T10:34:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-24T10:34:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-24T10:34:58.963 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-24T10:34:58.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:34:59.401 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 136/198 2024-03-24T10:34:59.423 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 136/198 2024-03-24T10:34:59.423 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:34:59.423 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-24T10:34:59.423 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-24T10:34:59.423 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-24T10:34:59.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:34:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-24T10:34:59.958 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 138/198 2024-03-24T10:34:59.990 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 138/198 2024-03-24T10:35:00.022 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1855.g21b3bd67.e 139/198 2024-03-24T10:35:00.082 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1855.g21b3bd67. 140/198 2024-03-24T10:35:00.115 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noa 141/198 2024-03-24T10:35:00.346 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noa 141/198 2024-03-24T10:35:00.374 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.n 142/198 2024-03-24T10:35:01.339 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.n 142/198 2024-03-24T10:35:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b 143/198 2024-03-24T10:35:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b 143/198 2024-03-24T10:35:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1855.g21b3bd67.el 144/198 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: acl-2.3.1-4.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-24T10:35:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-24T10:35:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: jq-1.6-16.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-24T10:35:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-24T10:35:01.663 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.11-1.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-24T10:35:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-24T10:35:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-24T10:35:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-24T10:35:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-3.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-24T10:35:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-24T10:35:01.670 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 145/198 2024-03-24T10:35:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-24T10:35:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:01.670 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-03-24T10:35:01.687 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 145/198 2024-03-24T10:35:01.687 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:35:01.687 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-24T10:35:01.688 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-24T10:35:01.688 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-24T10:35:01.688 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:01.732 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 146/198 2024-03-24T10:35:01.743 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 146/198 2024-03-24T10:35:01.796 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:19.0.0-1855.g21b3bd67.el9.x86_64 147/198 2024-03-24T10:35:02.180 DEBUG:teuthology.parallel:result is None 2024-03-24T10:35:02.639 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-24T10:35:02.671 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 149/198 2024-03-24T10:35:02.694 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 149/198 2024-03-24T10:35:02.694 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:35:02.694 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-24T10:35:02.695 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-24T10:35:02.695 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-24T10:35:02.695 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:02.739 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1855.g21b3b 150/198 2024-03-24T10:35:02.761 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1855.g21b3b 150/198 2024-03-24T10:35:02.761 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:35:02.761 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-24T10:35:02.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:02.815 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 151/198 2024-03-24T10:35:02.838 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 151/198 2024-03-24T10:35:02.838 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:35:02.838 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-24T10:35:02.838 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-24T10:35:02.838 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-24T10:35:02.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:03.142 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 152/198 2024-03-24T10:35:03.164 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 152/198 2024-03-24T10:35:03.165 INFO:teuthology.orchestra.run.smithi072.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-24T10:35:03.165 INFO:teuthology.orchestra.run.smithi072.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-24T10:35:03.165 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-24T10:35:03.165 INFO:teuthology.orchestra.run.smithi072.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-24T10:35:03.165 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:07.611 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:19.0.0-1855.g21b3bd67.el9.x86_64 153/198 2024-03-24T10:35:07.663 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 154/198 2024-03-24T10:35:07.694 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 155/198 2024-03-24T10:35:07.729 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-24T10:35:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-shell-2:19.0.0-1855.g21b3bd67.el9.x86_64 157/198 2024-03-24T10:35:08.034 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-24T10:35:08.076 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 159/198 2024-03-24T10:35:08.146 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-24T10:35:08.196 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-24T10:35:08.233 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-24T10:35:08.265 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:19.0.0-1855.g21b3bd67.el9.x86_ 163/198 2024-03-24T10:35:08.306 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-24T10:35:08.345 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-24T10:35:08.418 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-24T10:35:08.489 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-24T10:35:08.523 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-24T10:35:09.146 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-24T10:35:09.189 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-24T10:35:09.209 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-24T10:35:10.041 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:19.0.0-1855.g21b3bd67.el9.noarch 170/198 2024-03-24T10:35:10.138 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-24T10:35:10.187 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-24T10:35:10.278 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-24T10:35:10.321 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-24T10:35:10.347 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-24T10:35:10.373 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-24T10:35:10.408 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-24T10:35:10.408 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-24T10:35:10.514 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-24T10:35:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-24T10:35:10.544 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-24T10:35:10.622 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-24T10:35:10.667 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-24T10:35:10.708 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-24T10:35:10.742 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-24T10:35:10.775 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-24T10:35:10.821 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-24T10:35:10.877 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-24T10:35:10.923 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-24T10:35:10.953 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-24T10:35:10.987 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-24T10:35:11.013 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-24T10:35:11.040 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-24T10:35:11.046 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-24T10:35:11.047 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-24T10:35:11.227 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-24T10:35:11.227 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-24T10:35:11.327 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-24T10:35:11.352 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-24T10:35:11.385 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-24T10:35:11.420 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-24T10:35:11.454 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-24T10:35:11.521 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-24T10:35:20.054 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-24T10:35:20.054 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:19.0.0-1855.g21b3bd67.el9.x86_64 1/198 2024-03-24T10:35:20.054 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 2/198 2024-03-24T10:35:20.054 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 3/198 2024-03-24T10:35:20.054 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 4/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1855.g21b3b 5/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 6/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 7/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 8/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 9/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 10/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 11/198 2024-03-24T10:35:20.055 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:19.0.0-1855.g21b3bd67.el9.x86_64 12/198 2024-03-24T10:35:20.056 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 13/198 2024-03-24T10:35:20.056 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-shell-2:19.0.0-1855.g21b3bd67.el9.x86_64 14/198 2024-03-24T10:35:20.056 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:19.0.0-1855.g21b3bd67.el9.x86_ 15/198 2024-03-24T10:35:20.056 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 16/198 2024-03-24T10:35:20.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 17/198 2024-03-24T10:35:20.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:19.0.0-1855.g21b3bd67.el9.x86_6 18/198 2024-03-24T10:35:20.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86 19/198 2024-03-24T10:35:20.057 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 20/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1855.g21b3bd67.el 21/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:19.0.0-1855.g21b3bd67.el9. 22/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:19.0.0-1855.g21b3bd67.el9.x86_6 23/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:19.0.0-1855.g21b3bd67.el9.x86_64 24/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 25/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 26/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 27/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 28/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 29/198 2024-03-24T10:35:20.058 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1855.g21b3bd67. 30/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noa 31/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.n 32/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b 33/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1855.g21b3bd67.el 34/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 35/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1855.g21b3bd67.e 36/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 37/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 38/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:19.0.0-1855.g21b3bd67.el9.noarch 39/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-24T10:35:20.059 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-24T10:35:20.060 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-24T10:35:20.061 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-24T10:35:20.062 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-24T10:35:20.063 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-24T10:35:20.064 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-24T10:35:20.065 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-24T10:35:20.066 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-24T10:35:20.067 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-24T10:35:20.067 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-24T10:35:20.067 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-24T10:35:20.067 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-24T10:35:20.068 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-24T10:35:20.069 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 151/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 153/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-24T10:35:20.070 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-24T10:35:20.071 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-24T10:35:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-24T10:35:20.073 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: acl-2.3.1-4.el9.x86_64 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-24T10:35:23.120 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-24T10:35:23.121 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.2-8.el9.noarch 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.7.4-5.el9.x86_64 2024-03-24T10:35:23.122 INFO:teuthology.orchestra.run.smithi072.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.123 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-shell-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:19.0.0-1855.g21b3bd67.el9.noarch 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.4-9.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-24T10:35:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-16.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-24T10:35:23.125 INFO:teuthology.orchestra.run.smithi072.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: lua-5.4.4-4.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-24T10:35:23.126 INFO:teuthology.orchestra.run.smithi072.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-13.11-1.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-24T10:35:23.127 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-24T10:35:23.128 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-24T10:35:23.129 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-24T10:35:23.130 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-24T10:35:23.130 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-24T10:35:23.130 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-24T10:35:23.130 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-24T10:35:23.130 INFO:teuthology.orchestra.run.smithi072.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ply-3.11-14.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-24T10:35:23.133 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-24T10:35:23.134 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.135 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:19.0.0-1855.g21b3bd67.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: re2-1:20211101-3.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:23.136 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-24T10:35:23.714 DEBUG:teuthology.parallel:result is None 2024-03-24T10:35:23.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:35:23.939 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-24T10:35:23.962 INFO:teuthology.orchestra.run.smithi072.stdout:19.0.0-1855.g21b3bd67.el9 2024-03-24T10:35:23.963 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1855.g21b3bd67.el9 2024-03-24T10:35:23.963 INFO:teuthology.task.install:The correct ceph version 19.0.0-1855.g21b3bd67 is installed. 2024-03-24T10:35:23.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=21b3bd672163092b4e542f772797fcba02d3d4de 2024-03-24T10:35:24.110 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-24T10:35:24.139 INFO:teuthology.orchestra.run.smithi079.stdout:19.0.0-1855.g21b3bd67.el9 2024-03-24T10:35:24.139 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1855.g21b3bd67.el9 2024-03-24T10:35:24.139 INFO:teuthology.task.install:The correct ceph version 19.0.0-1855.g21b3bd67 is installed. 2024-03-24T10:35:24.141 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-24T10:35:24.141 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:24.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-24T10:35:24.173 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:24.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-24T10:35:24.212 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-24T10:35:24.212 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:24.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2024-03-24T10:35:24.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-24T10:35:24.310 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:24.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-03-24T10:35:24.340 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-24T10:35:24.408 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-24T10:35:24.408 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:24.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-24T10:35:24.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-24T10:35:24.507 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:24.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-24T10:35:24.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-24T10:35:24.602 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-24T10:35:24.603 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:24.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2024-03-24T10:35:24.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-24T10:35:24.698 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:24.698 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-03-24T10:35:24.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-24T10:35:24.793 INFO:teuthology.run_tasks:Running task ceph... 2024-03-24T10:35:24.910 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-24T10:35:24.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2024-03-24T10:35:24.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-03-24T10:35:24.941 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-24T10:35:24.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-24T10:35:24.979 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-24T10:35:25.011 INFO:tasks.ceph:Creating extra log directories... 2024-03-24T10:35:25.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-24T10:35:25.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-24T10:35:25.089 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-24T10:35:25.089 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-24T10:35:25.089 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-24T10:35:25.089 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:25.089 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-24T10:35:25.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-24T10:35:25.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-24T10:35:25.272 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:25.272 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-24T10:35:25.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-24T10:35:25.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-24T10:35:25.439 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-24T10:35:25.440 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-24T10:35:25.440 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi/7619065', 'branch': 'wip-batrick-testing-20240323.003144-squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7619065', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-03-24_04:56:01-fs-wip-batrick-testing-20240323.003144-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240323.003144-squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240323.003144-squid', 'sha1': 'd39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4284, 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'sleep_before_teardown': 0, 'subset': '405/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240323.003144-squid', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_d39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': 'd39ab7bb1f1162ec7b83b4f13a6bb876d4baf21b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+cIHDwY8U0EG/QVKcu4mEQyG6lmrBcSXKFkNSaqOxQngRIFVMNHH7tCcE5kkppM8cdRQgCqNYI5vijS2YXNxY=', 'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8RPjlYa+F/10nV5T5gkm0sOMk3Ife3t5Y6xpb/8+Y+gI1MI6jyMxWfQNeWmc1e0S57tx3IUSitDqhXkunBVNw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '21b3bd672163092b4e542f772797fcba02d3d4de', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': ['/cephfs/home/pdonnell/src/github.com_batrick_ceph_wip-batrick-testing-20240323.003144-squid/qa/suites/fs/functional/overrides/pg_health.yaml'], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-24_04:56:01', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-24T10:35:25.440 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-24T10:35:25.464 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-24T10:35:25.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2024-03-24T10:35:25.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-03-24T10:35:25.569 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:25.569 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2024-03-24T10:35:25.591 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-24T10:35:25.592 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2024-03-24T10:35:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-24T10:35:25.646 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:25.646 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-03-24T10:35:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-24 10:35:11.873699151 +0000 2024-03-24T10:35:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-24 10:32:26.202436009 +0000 2024-03-24T10:35:25.647 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-24 10:32:26.202436009 +0000 2024-03-24T10:35:25.647 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-24 10:32:26.202436009 +0000 2024-03-24T10:35:25.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-24T10:35:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-24T10:35:25.711 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-24T10:35:25.712 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000259273 s, 2.0 MB/s 2024-03-24T10:35:25.712 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-24T10:35:25.769 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-24 10:35:11.873699151 +0000 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-24 10:32:26.547428873 +0000 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-24 10:32:26.547428873 +0000 2024-03-24T10:35:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-24 10:32:26.547428873 +0000 2024-03-24T10:35:25.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-24T10:35:25.889 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-24T10:35:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-24T10:35:25.890 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000240676 s, 2.1 MB/s 2024-03-24T10:35:25.891 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-24T10:35:25.946 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2024-03-24T10:35:26.003 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-24T10:35:26.003 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-03-24T10:35:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:26.003 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-24 10:35:11.874699131 +0000 2024-03-24T10:35:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-24 10:32:26.910421365 +0000 2024-03-24T10:35:26.004 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-24 10:32:26.910421365 +0000 2024-03-24T10:35:26.004 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-24 10:32:26.910421365 +0000 2024-03-24T10:35:26.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-24T10:35:26.068 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-24T10:35:26.068 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-24T10:35:26.069 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000228076 s, 2.2 MB/s 2024-03-24T10:35:26.070 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-24T10:35:26.126 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2024-03-24T10:35:26.183 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-24T10:35:26.183 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:26.183 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-24T10:35:26.184 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:26.184 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:26.184 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2024-03-24 10:35:11.874699131 +0000 2024-03-24T10:35:26.184 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2024-03-24 10:32:27.264414044 +0000 2024-03-24T10:35:26.184 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2024-03-24 10:32:27.264414044 +0000 2024-03-24T10:35:26.184 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: 2024-03-24 10:32:27.264414044 +0000 2024-03-24T10:35:26.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-24T10:35:26.249 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2024-03-24T10:35:26.249 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2024-03-24T10:35:26.249 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000162758 s, 3.1 MB/s 2024-03-24T10:35:26.250 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-24T10:35:26.304 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:26.305 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:26.305 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-03-24T10:35:26.322 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-24T10:35:26.322 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-03-24T10:35:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-24T10:35:26.379 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:26.379 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-24T10:35:26.380 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:26.380 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:26.380 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-03-24 10:34:53.861675020 +0000 2024-03-24T10:35:26.380 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-03-24 10:32:22.971484258 +0000 2024-03-24T10:35:26.380 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-03-24 10:32:22.971484258 +0000 2024-03-24T10:35:26.380 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-03-24 10:32:22.971484258 +0000 2024-03-24T10:35:26.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-24T10:35:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-03-24T10:35:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-03-24T10:35:26.450 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.00019065 s, 2.7 MB/s 2024-03-24T10:35:26.451 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-24T10:35:26.508 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-03-24T10:35:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-24T10:35:26.566 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:26.566 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-24T10:35:26.566 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:26.566 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:26.567 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-03-24 10:34:53.861675020 +0000 2024-03-24T10:35:26.567 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-03-24 10:32:23.322476119 +0000 2024-03-24T10:35:26.567 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-03-24 10:32:23.322476119 +0000 2024-03-24T10:35:26.567 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-03-24 10:32:23.322476119 +0000 2024-03-24T10:35:26.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-24T10:35:26.637 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-03-24T10:35:26.637 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-03-24T10:35:26.637 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000181215 s, 2.8 MB/s 2024-03-24T10:35:26.638 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-24T10:35:26.694 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-03-24T10:35:26.750 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-24T10:35:26.751 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:26.751 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-24T10:35:26.751 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:26.751 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:26.751 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-03-24 10:34:53.861675020 +0000 2024-03-24T10:35:26.752 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-03-24 10:32:23.678467864 +0000 2024-03-24T10:35:26.752 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-03-24 10:32:23.678467864 +0000 2024-03-24T10:35:26.752 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-03-24 10:32:23.678467864 +0000 2024-03-24T10:35:26.752 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-24T10:35:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-03-24T10:35:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-03-24T10:35:26.819 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000241307 s, 2.1 MB/s 2024-03-24T10:35:26.820 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-24T10:35:26.876 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-03-24T10:35:26.931 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-24T10:35:26.931 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-24T10:35:26.931 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-03-24T10:35:26.931 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-24T10:35:26.932 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-03-24T10:35:26.932 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-03-24 10:34:53.862674997 +0000 2024-03-24T10:35:26.932 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-03-24 10:32:24.014460072 +0000 2024-03-24T10:35:26.932 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-03-24 10:32:24.014460072 +0000 2024-03-24T10:35:26.932 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-03-24 10:32:24.014460072 +0000 2024-03-24T10:35:26.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-24T10:35:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-03-24T10:35:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-03-24T10:35:26.996 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000197747 s, 2.6 MB/s 2024-03-24T10:35:26.997 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-24T10:35:27.052 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:27.053 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-24T10:35:27.053 INFO:tasks.ceph:Generating config... 2024-03-24T10:35:27.054 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-24T10:35:27.054 INFO:tasks.ceph:[client] debug client = 20 2024-03-24T10:35:27.054 INFO:tasks.ceph:[client] debug ms = 1 2024-03-24T10:35:27.054 INFO:tasks.ceph:[client] pid file = 2024-03-24T10:35:27.054 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-24T10:35:27.054 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-24T10:35:27.054 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-24T10:35:27.055 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-24T10:35:27.056 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-24T10:35:27.056 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-24T10:35:27.056 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-24T10:35:27.056 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-24T10:35:27.056 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-24T10:35:27.056 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-24T10:35:27.056 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-24T10:35:27.057 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-24T10:35:27.057 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-24T10:35:27.057 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-24T10:35:27.057 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-24T10:35:27.057 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-24T10:35:27.057 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-24T10:35:27.057 INFO:tasks.ceph:Setting up mon.a... 2024-03-24T10:35:27.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-24T10:35:27.114 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2024-03-24T10:35:27.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-24T10:35:27.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-24T10:35:27.233 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]')] 2024-03-24T10:35:27.233 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-24T10:35:27.234 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:27.234 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-24T10:35:27.297 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 0cd6a1e7-49c4-4ce2-8320-31fe22775d9b 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = quincy 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 0cd6a1e7-49c4-4ce2-8320-31fe22775d9b 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2024-03-24T10:35:27.383720+0000 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:created 2024-03-24T10:35:27.383720+0000 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 17 (quincy) 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-03-24T10:35:27.383 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-03-24T10:35:27.384 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-24T10:35:27.385 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-24T10:35:27.440 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0cd6a1e7-49c4-4ce2-8320-31fe22775d9b... 2024-03-24T10:35:27.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-24T10:35:27.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-24T10:35:27.532 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2024-03-24T10:35:27.532 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2024-03-24T10:35:27.532 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-24T10:35:27.532 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2024-03-24T10:35:27.532 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.532 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2024-03-24T10:35:27.533 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2024-03-24T10:35:27.534 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2024-03-24T10:35:27.535 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on skipped message = False 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 0cd6a1e7-49c4-4ce2-8320-31fe22775d9b 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.536 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug trim objects = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.537 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2024-03-24T10:35:27.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.538 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2024-03-24T10:35:27.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.538 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2024-03-24T10:35:27.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.539 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2024-03-24T10:35:27.539 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2024-03-24T10:35:27.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.539 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2024-03-24T10:35:27.540 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-03-24T10:35:27.541 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2024-03-24T10:35:27.542 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-24T10:35:27.543 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: mon down mkfs grace = 300 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2024-03-24T10:35:27.544 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = "" 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-03-24T10:35:27.545 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-03-24T10:35:27.546 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-03-24T10:35:27.554 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-03-24T10:35:27.554 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2024-03-24T10:35:27.554 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2024-03-24T10:35:27.554 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2024-03-24T10:35:27.555 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2024-03-24T10:35:27.557 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-03-24T10:35:27.557 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-03-24T10:35:27.557 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-24T10:35:27.557 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-03-24T10:35:27.557 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.558 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-03-24T10:35:27.558 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-03-24T10:35:27.559 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.560 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.72,172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790]" 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on skipped message = False 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = 0cd6a1e7-49c4-4ce2-8320-31fe22775d9b 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-03-24T10:35:27.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-03-24T10:35:27.562 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 20 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 20 2024-03-24T10:35:27.563 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 10 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-03-24T10:35:27.564 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-03-24T10:35:27.565 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-24T10:35:27.566 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: mon down mkfs grace = 300 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: mon op complaint time = 120 2024-03-24T10:35:27.567 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: client mount timeout = 600 2024-03-24T10:35:27.568 INFO:teuthology.orchestra.run.smithi079.stdout: debug client = 20 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = "" 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-03-24T10:35:27.577 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout:[mds] 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds = 20 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: debug mds balancer = 20 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug frag = True 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: mds debug scatterstat = True 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: mds op complaint time = 180 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: mds verify scatter = True 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: osd op complaint time = 180 2024-03-24T10:35:27.578 INFO:teuthology.orchestra.run.smithi079.stdout: rados mon op timeout = 900 2024-03-24T10:35:27.579 INFO:teuthology.orchestra.run.smithi079.stdout: rados osd op timeout = 900 2024-03-24T10:35:27.579 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-24T10:35:27.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-24T10:35:27.653 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-24T10:35:27.653 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:27.653 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-24T10:35:27.668 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:27.668 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-24T10:35:27.726 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:35:27.726 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:27.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-24T10:35:27.727 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-24T10:35:27.807 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:27.807 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:27.861 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:35:27.862 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:27.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-24T10:35:27.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-24T10:35:27.902 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:27.903 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:27.957 INFO:tasks.ceph:Setting up mon nodes... 2024-03-24T10:35:27.958 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-24T10:35:27.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-24T10:35:28.015 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-24T10:35:28.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-24T10:35:28.078 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-24T10:35:28.081 INFO:tasks.ceph:Setting up mds nodes... 2024-03-24T10:35:28.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-24T10:35:28.142 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-24T10:35:28.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-24T10:35:28.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-24T10:35:28.266 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-24T10:35:28.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-24T10:35:28.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-24T10:35:28.351 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-24T10:35:28.354 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-24T10:35:28.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-24T10:35:28.478 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-24T10:35:28.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-24T10:35:28.511 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-24T10:35:28.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-24T10:35:28.559 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-24T10:35:28.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-24T10:35:28.655 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-24T10:35:28.671 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-24T10:35:28.713 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-24T10:35:28.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-24T10:35:28.814 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-24T10:35:28.826 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-24T10:35:28.826 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-24T10:35:28.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-24T10:35:28.854 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:28.854 INFO:tasks.ceph:role: osd.0 2024-03-24T10:35:28.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:35:28.854 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:28.928 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:29.414 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-03-24T10:35:29.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-03-24T10:35:29.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-24T10:35:29.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-24T10:35:29.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-24T10:35:29.631 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:29.631 INFO:tasks.ceph:role: osd.1 2024-03-24T10:35:29.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:35:29.632 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:29.705 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:29.706 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:29.706 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:29.706 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:30.175 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-03-24T10:35:30.175 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-03-24T10:35:30.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-24T10:35:30.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-24T10:35:30.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-24T10:35:30.395 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:30.395 INFO:tasks.ceph:role: osd.2 2024-03-24T10:35:30.395 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:35:30.395 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-24T10:35:30.470 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:30.471 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:30.963 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-03-24T10:35:30.963 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-03-24T10:35:30.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-24T10:35:31.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-24T10:35:31.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-24T10:35:31.169 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:31.169 INFO:tasks.ceph:role: osd.3 2024-03-24T10:35:31.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:35:31.169 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-24T10:35:31.244 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:31.245 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:31.723 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2024-03-24T10:35:31.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2024-03-24T10:35:31.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-24T10:35:31.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-24T10:35:31.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:31.996+0000 7f08fcd02640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-24T10:35:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:31.996+0000 7f08fcd02640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-24T10:35:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:31.996+0000 7f08fcd02640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-24T10:35:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:31.996+0000 7f08fcd02640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-24T10:35:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:31.996+0000 7f08fcd02640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-24T10:35:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:32.003+0000 7f08fcd02640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-24T10:35:34.850 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-24T10:35:34.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:34.970+0000 7f26a7611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-24T10:35:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:34.971+0000 7f26a7611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-24T10:35:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:34.971+0000 7f26a7611640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-24T10:35:34.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:34.971+0000 7f26a7611640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-24T10:35:34.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:34.971+0000 7f26a7611640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-24T10:35:34.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:34.971+0000 7f26a7611640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-24T10:35:37.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-24T10:35:37.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:37.946 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:37.945+0000 7fbf73c19640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-24T10:35:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:37.945+0000 7fbf73c19640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-24T10:35:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:37.945+0000 7fbf73c19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-24T10:35:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:37.945+0000 7fbf73c19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-24T10:35:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:37.945+0000 7fbf73c19640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-24T10:35:37.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:37.946+0000 7fbf73c19640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-24T10:35:40.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-24T10:35:40.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:40.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:40.915+0000 7f0f88211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-24T10:35:40.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:40.916+0000 7f0f88211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-24T10:35:40.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:40.916+0000 7f0f88211640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-24T10:35:40.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:40.916+0000 7f0f88211640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-24T10:35:40.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:40.916+0000 7f0f88211640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-24T10:35:40.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:35:40.916+0000 7f0f88211640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-24T10:35:43.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-24T10:35:43.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-24T10:35:43.834 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:43.834 INFO:tasks.ceph:role: osd.4 2024-03-24T10:35:43.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:35:43.835 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-24T10:35:43.911 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:43.913 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:43.914 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:44.427 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-03-24T10:35:44.429 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-03-24T10:35:44.429 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-24T10:35:44.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-24T10:35:44.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-24T10:35:44.657 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:44.657 INFO:tasks.ceph:role: osd.5 2024-03-24T10:35:44.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:35:44.658 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:44.735 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:45.181 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-03-24T10:35:45.187 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-03-24T10:35:45.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-24T10:35:45.294 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-24T10:35:45.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-24T10:35:45.392 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:45.392 INFO:tasks.ceph:role: osd.6 2024-03-24T10:35:45.392 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:35:45.392 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:45.466 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:45.467 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:45.948 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-03-24T10:35:45.950 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-03-24T10:35:45.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-24T10:35:46.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-24T10:35:46.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-24T10:35:46.204 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-24T10:35:46.205 INFO:tasks.ceph:role: osd.7 2024-03-24T10:35:46.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:35:46.205 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-24T10:35:46.279 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-24T10:35:46.279 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-24T10:35:46.279 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-24T10:35:46.279 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-24T10:35:46.279 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-24T10:35:46.279 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-03-24T10:35:46.280 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-24T10:35:46.280 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-24T10:35:46.280 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-24T10:35:46.280 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-24T10:35:46.798 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-03-24T10:35:46.800 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-03-24T10:35:46.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-24T10:35:46.945 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-24T10:35:46.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:47.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:47.078+0000 7f287de11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-24T10:35:47.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:47.078+0000 7f287de11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-24T10:35:47.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:47.078+0000 7f287de11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-24T10:35:47.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:47.078+0000 7f287de11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-24T10:35:47.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:47.078+0000 7f287de11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-24T10:35:47.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:47.079+0000 7f287de11640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-24T10:35:49.927 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-24T10:35:49.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:50.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:50.049+0000 7f7466506640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-24T10:35:50.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:50.049+0000 7f7466506640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-24T10:35:50.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:50.049+0000 7f7466506640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-24T10:35:50.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:50.049+0000 7f7466506640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-24T10:35:50.050 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:50.049+0000 7f7466506640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-24T10:35:50.051 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:50.050+0000 7f7466506640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-24T10:35:52.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-24T10:35:52.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:53.019+0000 7f94433bd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-24T10:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:53.019+0000 7f94433bd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-24T10:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:53.019+0000 7f94433bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-24T10:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:53.019+0000 7f94433bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-24T10:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:53.019+0000 7f94433bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-24T10:35:53.020 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:53.020+0000 7f94433bd640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-24T10:35:55.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:35:55.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:35:55.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-24T10:35:55.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:35:56.000 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:56.000+0000 7f0cd6e1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-24T10:35:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:56.000+0000 7f0cd6e1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-24T10:35:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:56.000+0000 7f0cd6e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-24T10:35:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:56.000+0000 7f0cd6e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-24T10:35:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:56.000+0000 7f0cd6e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-24T10:35:56.001 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:35:56.000+0000 7f0cd6e1b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-24T10:35:58.859 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-24T10:35:58.890 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-24T10:35:58.891 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:58.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-24T10:35:58.922 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:58.922 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-24T10:35:58.993 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:58.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-24T10:35:59.063 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:59.063 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-24T10:35:59.133 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:59.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-24T10:35:59.203 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:59.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-24T10:35:59.271 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:59.271 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-24T10:35:59.339 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-24T10:35:59.370 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-24T10:35:59.441 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-24T10:35:59.511 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-24T10:35:59.580 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-24T10:35:59.651 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.651 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-24T10:35:59.719 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-24T10:35:59.788 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:59.789 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-24T10:35:59.805 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:35:59.805 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-24T10:35:59.862 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.862 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-24T10:35:59.877 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:35:59.878 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-24T10:35:59.932 INFO:tasks.ceph:Adding keys to all mons... 2024-03-24T10:35:59.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-24T10:35:59.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-24T10:35:59.975 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBm+vP0ABAAeRjI7NBGqi5ZhLrvCpTXyA== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmYuKLCBAAUVObgf4K/UTjpRCCnmO//Q== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBm8+zpDxAA+GTpCIIqGefAob5k2BG/uQ== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDzAQBmstltOxAAOg4CR6yJpWD+67CDewMfdQ== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD2AQBmnp7tORAAqJA+zaC5+Pc8VBCAgJAQbg== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD5AQBmpW9sOBAA6xIhF2gFdwZVOn4T5NFfmg== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQD8AQBmtXGoNhAAeZAL6Q3WFjsgb0HLwTZ2pg== 2024-03-24T10:35:59.976 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmSGa1BBAAsEceO3i3PO1gR0njPHhmrA== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmc+gDFRAAQZqdWedSlu83X3SE5kDtRQ== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmfJOXHBAAAUvZrTh4shSDwUxQPT3VOw== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQADAgBm2hW/BBAAlZVzBNY4hKJLvybCequNeg== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAGAgBmrn8AAxAAY3zq7Comu5loRoFG8WM3hA== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAJAgBm+N81ARAAPFSPPtf8sY9QDOH6D3NbuQ== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAMAgBmfbcQABAAbyJFdXYxxks+pVo221+Mvg== 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-03-24T10:35:59.977 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmpt8/IRAAYiR002bSEWemiqCVbKgVlw== 2024-03-24T10:35:59.978 INFO:teuthology.orchestra.run.smithi072.stdout:[client.2] 2024-03-24T10:35:59.978 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmRCscJxAAsDCJbFkj5lk8KskSdPKHXg== 2024-03-24T10:35:59.978 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2024-03-24T10:35:59.978 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBm/PGSKhAA4OzSekjwyyhs7sAfnpjmLQ== 2024-03-24T10:35:59.978 INFO:teuthology.orchestra.run.smithi072.stdout:[client.3] 2024-03-24T10:35:59.978 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmlj9mMBAAOlOs3oGb8P6bDh0H0KWATQ== 2024-03-24T10:35:59.998 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2024-03-24T10:35:59.998 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBm+vP0ABAAeRjI7NBGqi5ZhLrvCpTXyA== 2024-03-24T10:35:59.998 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.a] 2024-03-24T10:35:59.998 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmYuKLCBAAUVObgf4K/UTjpRCCnmO//Q== 2024-03-24T10:35:59.998 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.c] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBm8+zpDxAA+GTpCIIqGefAob5k2BG/uQ== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDzAQBmstltOxAAOg4CR6yJpWD+67CDewMfdQ== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQD2AQBmnp7tORAAqJA+zaC5+Pc8VBCAgJAQbg== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQD5AQBmpW9sOBAA6xIhF2gFdwZVOn4T5NFfmg== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQD8AQBmtXGoNhAAeZAL6Q3WFjsgb0HLwTZ2pg== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmSGa1BBAAsEceO3i3PO1gR0njPHhmrA== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.b] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmc+gDFRAAQZqdWedSlu83X3SE5kDtRQ== 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout:[mds.d] 2024-03-24T10:35:59.999 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmfJOXHBAAAUvZrTh4shSDwUxQPT3VOw== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQADAgBm2hW/BBAAlZVzBNY4hKJLvybCequNeg== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAGAgBmrn8AAxAAY3zq7Comu5loRoFG8WM3hA== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAJAgBm+N81ARAAPFSPPtf8sY9QDOH6D3NbuQ== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAMAgBmfbcQABAAbyJFdXYxxks+pVo221+Mvg== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmpt8/IRAAYiR002bSEWemiqCVbKgVlw== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[client.2] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmRCscJxAAsDCJbFkj5lk8KskSdPKHXg== 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2024-03-24T10:36:00.000 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBm/PGSKhAA4OzSekjwyyhs7sAfnpjmLQ== 2024-03-24T10:36:00.001 INFO:teuthology.orchestra.run.smithi079.stdout:[client.3] 2024-03-24T10:36:00.001 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQDwAQBmlj9mMBAAOlOs3oGb8P6bDh0H0KWATQ== 2024-03-24T10:36:00.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-24T10:36:00.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-24T10:36:00.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.320 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-24T10:36:00.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-24T10:36:00.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.488 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.545 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-24T10:36:00.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.603 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.763 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-24T10:36:00.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.875 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:00.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-24T10:36:01.044 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-24T10:36:01.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-24T10:36:01.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-24T10:36:01.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-24T10:36:01.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-24T10:36:01.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-24T10:36:01.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-24T10:36:01.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-24T10:36:01.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-24T10:36:01.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-24T10:36:01.543 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:36:01.545 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-24T10:36:01.598 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-24T10:36:01.599 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-24T10:36:01.599 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-24T10:36:01.601 INFO:tasks.ceph.mon.a:Started 2024-03-24T10:36:01.601 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-24T10:36:01.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-24T10:36:01.640 INFO:tasks.ceph.mon.b:Started 2024-03-24T10:36:01.641 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-24T10:36:01.641 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-24T10:36:01.642 INFO:tasks.ceph.mon.c:Started 2024-03-24T10:36:01.643 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-24T10:36:01.643 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-24T10:36:01.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-24T10:36:01.645 INFO:tasks.ceph.mgr.y:Started 2024-03-24T10:36:01.645 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-24T10:36:01.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-24T10:36:01.647 INFO:tasks.ceph.mgr.x:Started 2024-03-24T10:36:01.648 INFO:tasks.ceph:Setting crush tunables to default 2024-03-24T10:36:01.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2024-03-24T10:36:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.749+0000 7f9caa38a640 1 Processor -- start 2024-03-24T10:36:01.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9caa38a640 1 -- start start 2024-03-24T10:36:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9caa38a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 0x7f9ca406dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9caa38a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca4072310 con 0x7f9ca406e1c0 2024-03-24T10:36:01.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9caa38a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ca4162300 con 0x7f9ca4147a50 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9caa38a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9ca4162b20 con 0x7f9ca406fba0 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9ca8927640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9ca406e1c0 0x7f9ca40727a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60554/0 (socket says 172.21.15.72:60554) 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.750+0000 7f9ca8927640 1 -- 172.21.15.72:0/1277026515 learned_addr learned my addr 172.21.15.72:0/1277026515 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.751+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 0x7f9ca406dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.751+0000 7f9ca37fe640 1 -- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 msgr2=0x7f9ca406dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.751+0000 7f9ca37fe640 1 -- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 msgr2=0x7f9ca406dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.751+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 0x7f9ca406dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-24T10:36:01.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.751+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 0x7f9ca406dc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-24T10:36:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.927+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 697799337 0 0) 0x7f9ca4072310 con 0x7f9ca406e1c0 2024-03-24T10:36:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.927+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c8c003520 con 0x7f9ca406e1c0 2024-03-24T10:36:01.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640382273 0 0) 0x7f9ca4162300 con 0x7f9ca4147a50 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ca4072310 con 0x7f9ca4147a50 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3333690972 0 0) 0x7f9c8c003520 con 0x7f9ca406e1c0 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 msgr2=0x7f9ca406dc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 --2- 172.21.15.72:0/1277026515 >> v2:172.21.15.79:3300/0 conn(0x7f9ca406fba0 0x7f9ca406dc80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 >> v1:172.21.15.79:6789/0 conn(0x7f9ca4147a50 legacy=0x7f9ca4161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca4162560 con 0x7f9ca406e1c0 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f9c9c0019f0 con 0x7f9ca406e1c0 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 >> v1:172.21.15.72:6789/0 conn(0x7f9ca406e1c0 legacy=0x7f9ca40727a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c8c003b00 0x7f9c8c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c0047c0 0x7f9c8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c005180 0x7f9c8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca4162b20 con 0x7f9c8c0047c0 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c8c00c0b0 con 0x7f9c8c005180 2024-03-24T10:36:01.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9c8c00c270 con 0x7f9c8c003b00 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca3fff640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c8c003b00 0x7f9c8c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c0047c0 0x7f9c8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca8927640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c005180 0x7f9c8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca37fe640 1 -- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c8c003b00 msgr2=0x7f9c8c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c8c003b00 0x7f9c8c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.928+0000 7f9ca37fe640 1 -- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c005180 msgr2=0x7f9c8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.929+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c005180 0x7f9c8c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.929+0000 7f9ca37fe640 1 -- 172.21.15.72:0/1277026515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8c003520 con 0x7f9c8c0047c0 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.929+0000 7f9ca8927640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c005180 0x7f9c8c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:01.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.929+0000 7f9ca8927640 1 -- 172.21.15.72:0/1277026515 reap_dead start 2024-03-24T10:36:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.929+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c0047c0 0x7f9c8c004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c98006fd0 tx=0x7f9c8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc68d8b09d4118b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:01.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98033680 con 0x7f9c8c0047c0 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c980337e0 con 0x7f9c8c0047c0 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9ca2ffd640 1 -- 172.21.15.72:0/1277026515 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98033b90 con 0x7f9c8c0047c0 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 -- 172.21.15.72:0/1277026515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c0047c0 msgr2=0x7f9c8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c0047c0 0x7f9c8c004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9c98006fd0 tx=0x7f9c8c0057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 -- 172.21.15.72:0/1277026515 shutdown_connections 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 --2- 172.21.15.72:0/1277026515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c8c0047c0 0x7f9c8c004c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 -- 172.21.15.72:0/1277026515 >> 172.21.15.72:0/1277026515 conn(0x7f9ca40b29c0 msgr2=0x7f9ca40b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 -- 172.21.15.72:0/1277026515 shutdown_connections 2024-03-24T10:36:01.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.931+0000 7f9caa38a640 1 -- 172.21.15.72:0/1277026515 wait complete. 2024-03-24T10:36:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.933+0000 7f9caa38a640 1 Processor -- start 2024-03-24T10:36:01.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.933+0000 7f9caa38a640 1 -- start start 2024-03-24T10:36:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9caa38a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c0047c0 0x7f9ca4142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9caa38a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 0x7f9ca40c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9caa38a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ca40c7820 0x7f9ca40c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9caa38a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca40c81e0 con 0x7f9ca4160a20 2024-03-24T10:36:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9caa38a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9ca415e740 con 0x7f9c8c0047c0 2024-03-24T10:36:01.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9caa38a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca41428b0 con 0x7f9ca40c7820 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 0x7f9ca40c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c0047c0 0x7f9ca4142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 0x7f9ca40c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50674/0 (socket says 172.21.15.72:50674) 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca8927640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ca40c7820 0x7f9ca40c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca37fe640 1 -- 172.21.15.72:0/1063662066 learned_addr learned my addr 172.21.15.72:0/1063662066 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca8927640 1 -- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c0047c0 msgr2=0x7f9ca4142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca8927640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c0047c0 0x7f9ca4142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca8927640 1 -- 172.21.15.72:0/1063662066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 msgr2=0x7f9ca40c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca8927640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 0x7f9ca40c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.934+0000 7f9ca8927640 1 -- 172.21.15.72:0/1063662066 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca40c6e90 con 0x7f9ca40c7820 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.935+0000 7f9ca37fe640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 0x7f9ca40c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:01.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.935+0000 7f9ca8927640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ca40c7820 0x7f9ca40c7ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40d1eb0 tx=0x7f9c9c00ae70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.936+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c007800 con 0x7f9ca40c7820 2024-03-24T10:36:01.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.936+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c9c007980 con 0x7f9ca40c7820 2024-03-24T10:36:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.936+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ca40c7170 con 0x7f9ca40c7820 2024-03-24T10:36:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.936+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c013630 con 0x7f9ca40c7820 2024-03-24T10:36:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.936+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ca415e3d0 con 0x7f9ca40c7820 2024-03-24T10:36:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.937+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c9c013790 con 0x7f9ca40c7820 2024-03-24T10:36:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.937+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9c9c01dad0 con 0x7f9ca40c7820 2024-03-24T10:36:01.938 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.938+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ca4075330 con 0x7f9ca40c7820 2024-03-24T10:36:01.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:01.942+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9c9c00a3d0 con 0x7f9ca40c7820 2024-03-24T10:36:02.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.026+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9ca415e8d0 con 0x7f9ca40c7820 2024-03-24T10:36:02.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.034+0000 7f9ca0ff9640 1 -- 172.21.15.72:0/1063662066 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9c9c01d460 con 0x7f9ca40c7820 2024-03-24T10:36:02.034 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2024-03-24T10:36:02.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.034+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ca40c7820 msgr2=0x7f9ca40c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.034+0000 7f9caa38a640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ca40c7820 0x7f9ca40c7ca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ca40d1eb0 tx=0x7f9c9c00ae70 comp rx=0 tx=0).stop 2024-03-24T10:36:02.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 shutdown_connections 2024-03-24T10:36:02.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9ca40c7820 0x7f9ca40c7ca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ca4160a20 0x7f9ca40c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 --2- 172.21.15.72:0/1063662066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c8c0047c0 0x7f9ca4142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 >> 172.21.15.72:0/1063662066 conn(0x7f9ca40b29c0 msgr2=0x7f9ca40b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:02.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 shutdown_connections 2024-03-24T10:36:02.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:02.035+0000 7f9caa38a640 1 -- 172.21.15.72:0/1063662066 wait complete. 2024-03-24T10:36:02.046 INFO:tasks.ceph:check_enable_crimson: False 2024-03-24T10:36:02.046 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-24T10:36:02.047 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:36:02.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-24T10:36:02.075 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:36:02.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-24T10:36:02.142 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:36:02.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-24T10:36:02.209 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:36:02.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-24T10:36:02.276 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:36:02.276 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-24T10:36:02.304 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:36:02.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-24T10:36:02.371 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:36:02.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-24T10:36:02.387 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:02.386+0000 7f212942b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-24T10:36:02.413 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:36:02.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-24T10:36:02.443 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:02.443+0000 7f212942b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-24T10:36:02.445 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:02.444+0000 7f8cfd271040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-24T10:36:02.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 658c0c97-d37e-4108-a44d-a1bffd4431f0 0 2024-03-24T10:36:02.498 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:02.498+0000 7f8cfd271040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-24T10:36:02.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.612+0000 7fa28f2d4640 1 Processor -- start 2024-03-24T10:36:02.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.612+0000 7fa28f2d4640 1 -- start start 2024-03-24T10:36:02.614 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28f2d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 0x7fa2880cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28f2d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa2880b1b40 0x7fa2880cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28f2d4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2880cc8b0 con 0x7fa28815c1b0 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28f2d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa2880cdd60 con 0x7fa2880b1b40 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28f2d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa2880cf970 con 0x7fa2880b1700 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 0x7fa2880cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 0x7fa2880cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50150/0 (socket says 172.21.15.79:50150) 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 -- 172.21.15.79:0/2144613419 learned_addr learned my addr 172.21.15.79:0/2144613419 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28d871640 1 --2- 172.21.15.79:0/2144613419 >> v2:172.21.15.79:3300/0 conn(0x7fa2880b1b40 0x7fa2880cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 -- 172.21.15.79:0/2144613419 >> v2:172.21.15.79:3300/0 conn(0x7fa2880b1b40 msgr2=0x7fa2880cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 --2- 172.21.15.79:0/2144613419 >> v2:172.21.15.79:3300/0 conn(0x7fa2880b1b40 0x7fa2880cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 -- 172.21.15.79:0/2144613419 >> v1:172.21.15.72:6789/0 conn(0x7fa28815c1b0 legacy=0x7fa2880cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.613+0000 7fa28c86f640 1 -- 172.21.15.79:0/2144613419 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2880cfc10 con 0x7fa2880b1700 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.614+0000 7fa28c86f640 1 --2- 172.21.15.79:0/2144613419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 0x7fa2880cd2e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa278009870 tx=0x7fa27802ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcceff47807a3007 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:02.615 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.614+0000 7fa27ffff640 1 -- 172.21.15.79:0/2144613419 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27802f840 con 0x7fa2880b1700 2024-03-24T10:36:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.614+0000 7fa27ffff640 1 -- 172.21.15.79:0/2144613419 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27802f9a0 con 0x7fa2880b1700 2024-03-24T10:36:02.616 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.614+0000 7fa27ffff640 1 -- 172.21.15.79:0/2144613419 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27802fd30 con 0x7fa2880b1700 2024-03-24T10:36:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 -- 172.21.15.79:0/2144613419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 msgr2=0x7fa2880cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/2144613419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 0x7fa2880cd2e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa278009870 tx=0x7fa27802ba20 comp rx=0 tx=0).stop 2024-03-24T10:36:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 -- 172.21.15.79:0/2144613419 shutdown_connections 2024-03-24T10:36:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/2144613419 >> v2:172.21.15.79:3300/0 conn(0x7fa2880b1b40 0x7fa2880cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/2144613419 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1700 0x7fa2880cd2e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.620 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 -- 172.21.15.79:0/2144613419 >> 172.21.15.79:0/2144613419 conn(0x7fa2880d1da0 msgr2=0x7fa2880d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:02.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 -- 172.21.15.79:0/2144613419 shutdown_connections 2024-03-24T10:36:02.621 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.615+0000 7fa28f2d4640 1 -- 172.21.15.79:0/2144613419 wait complete. 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.616+0000 7fa28f2d4640 1 Processor -- start 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.616+0000 7fa28f2d4640 1 -- start start 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.616+0000 7fa28f2d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2880b1700 0x7fa2880cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28f2d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 0x7fa2880c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28f2d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa28815c1b0 0x7fa288157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28f2d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa2880cb750 con 0x7fa28815c1b0 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28f2d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2880c96c0 con 0x7fa2880b1700 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28f2d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa2880c99a0 con 0x7fa2880b1b40 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 0x7fa2880c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 0x7fa2880c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50156/0 (socket says 172.21.15.79:50156) 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 -- 172.21.15.79:0/4109542535 learned_addr learned my addr 172.21.15.79:0/4109542535 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:02.622 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28d070640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2880b1700 0x7fa2880cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28d871640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa28815c1b0 0x7fa288157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 -- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2880b1700 msgr2=0x7fa2880cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2880b1700 0x7fa2880cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 -- 172.21.15.79:0/4109542535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa28815c1b0 msgr2=0x7fa288157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa28815c1b0 0x7fa288157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 -- 172.21.15.79:0/4109542535 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2780094d0 con 0x7fa2880b1b40 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28d070640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2880b1700 0x7fa2880cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28c86f640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 0x7fa2880c8e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa278000c00 tx=0x7fa278004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278037c40 con 0x7fa2880b1b40 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa278037da0 con 0x7fa2880b1b40 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2880c9c80 con 0x7fa2880b1b40 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.617+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278041640 con 0x7fa2880b1b40 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.618+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2880ca240 con 0x7fa2880b1b40 2024-03-24T10:36:02.623 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.618+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2780417a0 con 0x7fa2880b1b40 2024-03-24T10:36:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.618+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa27803c070 con 0x7fa2880b1b40 2024-03-24T10:36:02.624 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.618+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa288067d70 con 0x7fa2880b1b40 2024-03-24T10:36:02.625 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.620+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa27804b460 con 0x7fa2880b1b40 2024-03-24T10:36:02.693 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.692+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "658c0c97-d37e-4108-a44d-a1bffd4431f0", "id": 0} v 0) -- 0x7fa2880aeb30 con 0x7fa2880b1b40 2024-03-24T10:36:02.696 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.695+0000 7fa27dffb640 1 -- 172.21.15.79:0/4109542535 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "658c0c97-d37e-4108-a44d-a1bffd4431f0", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa278041b90 con 0x7fa2880b1b40 2024-03-24T10:36:02.696 INFO:teuthology.orchestra.run.smithi079.stdout:0 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 msgr2=0x7fa2880c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 0x7fa2880c8e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa278000c00 tx=0x7fa278004730 comp rx=0 tx=0).stop 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 shutdown_connections 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa28815c1b0 0x7fa288157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa2880b1b40 0x7fa2880c8e70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 --2- 172.21.15.79:0/4109542535 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2880b1700 0x7fa2880cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 >> 172.21.15.79:0/4109542535 conn(0x7fa2880d1da0 msgr2=0x7fa2880b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 shutdown_connections 2024-03-24T10:36:02.697 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.696+0000 7fa28f2d4640 1 -- 172.21.15.79:0/4109542535 wait complete. 2024-03-24T10:36:02.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 26bee6bd-24f4-454d-ab96-a1a3dfa826a4 1 2024-03-24T10:36:02.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.807+0000 7efe6fd81640 1 Processor -- start 2024-03-24T10:36:02.807 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.807+0000 7efe6fd81640 1 -- start start 2024-03-24T10:36:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6fd81640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efe681622d0 0x7efe680b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6fd81640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe680b4b30 con 0x7efe681626b0 2024-03-24T10:36:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6fd81640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe680d0bd0 con 0x7efe6815e5b0 2024-03-24T10:36:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6fd81640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efe6815e9e0 con 0x7efe681622d0 2024-03-24T10:36:02.811 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6e31e640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7efe6815e5b0 0x7efe680b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60322/0 (socket says 172.21.15.79:60322) 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6e31e640 1 -- 172.21.15.79:0/2735081254 learned_addr learned my addr 172.21.15.79:0/2735081254 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6db1d640 1 --2- 172.21.15.79:0/2735081254 >> v2:172.21.15.72:3300/0 conn(0x7efe681622d0 0x7efe680b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258951379 0 0) 0x7efe680d0bd0 con 0x7efe6815e5b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe54003520 con 0x7efe6815e5b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834692672 0 0) 0x7efe680b4b30 con 0x7efe681626b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe680d0bd0 con 0x7efe681626b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1660057943 0 0) 0x7efe54003520 con 0x7efe6815e5b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 >> v2:172.21.15.72:3300/0 conn(0x7efe681622d0 msgr2=0x7efe680b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 --2- 172.21.15.79:0/2735081254 >> v2:172.21.15.72:3300/0 conn(0x7efe681622d0 0x7efe680b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 >> v1:172.21.15.72:6789/0 conn(0x7efe681626b0 legacy=0x7efe6815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe680d0eb0 con 0x7efe6815e5b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7efe600019f0 con 0x7efe6815e5b0 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 >> v1:172.21.15.79:6789/0 conn(0x7efe6815e5b0 legacy=0x7efe680b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.812 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54003b50 0x7efe54003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe54005180 0x7efe5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efe6815e9e0 con 0x7efe54003b50 2024-03-24T10:36:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efe5400c050 con 0x7efe54005180 2024-03-24T10:36:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efe5400c210 con 0x7efe540047c0 2024-03-24T10:36:02.813 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6db1d640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54003b50 0x7efe54003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.808+0000 7efe6d31c640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6e31e640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe54005180 0x7efe5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6d31c640 1 -- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe54005180 msgr2=0x7efe5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6d31c640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe54005180 0x7efe5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6d31c640 1 -- 172.21.15.79:0/2735081254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54003b50 msgr2=0x7efe54003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6d31c640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54003b50 0x7efe54003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6d31c640 1 -- 172.21.15.79:0/2735081254 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe54003520 con 0x7efe540047c0 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6e31e640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe54005180 0x7efe5400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6db1d640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe54003b50 0x7efe54003f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6e31e640 1 -- 172.21.15.79:0/2735081254 reap_dead start 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.809+0000 7efe6d31c640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe54004c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe580018d0 tx=0x7efe540057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f48a81c7919a3c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:02.814 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580052d0 con 0x7efe540047c0 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe58005430 con 0x7efe540047c0 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6cb1b640 1 -- 172.21.15.79:0/2735081254 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe58003810 con 0x7efe540047c0 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 -- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 msgr2=0x7efe54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe54004c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe580018d0 tx=0x7efe540057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 -- 172.21.15.79:0/2735081254 shutdown_connections 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 --2- 172.21.15.79:0/2735081254 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe54004c40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 -- 172.21.15.79:0/2735081254 >> 172.21.15.79:0/2735081254 conn(0x7efe680d1d00 msgr2=0x7efe680d2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 -- 172.21.15.79:0/2735081254 shutdown_connections 2024-03-24T10:36:02.815 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.810+0000 7efe6fd81640 1 -- 172.21.15.79:0/2735081254 wait complete. 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.811+0000 7efe6fd81640 1 Processor -- start 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.811+0000 7efe6fd81640 1 -- start start 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6fd81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe6815a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6fd81640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe6814c920 0x7efe680c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6fd81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 0x7efe681612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6fd81640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efe6815a1b0 con 0x7efe6814c920 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6fd81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efe680c8680 con 0x7efe680c7f00 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6fd81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efe680c83a0 con 0x7efe540047c0 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6db1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe6815a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6e31e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 0x7efe681612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6e31e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 0x7efe681612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57488/0 (socket says 172.21.15.79:57488) 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6e31e640 1 -- 172.21.15.79:0/2280672408 learned_addr learned my addr 172.21.15.79:0/2280672408 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:02.818 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6db1d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe6815a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50166/0 (socket says 172.21.15.79:50166) 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6d31c640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe6814c920 0x7efe680c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6e31e640 1 -- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 msgr2=0x7efe6815a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.812+0000 7efe6e31e640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe6815a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6e31e640 1 -- 172.21.15.79:0/2280672408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe6814c920 msgr2=0x7efe680c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6e31e640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe6814c920 0x7efe680c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6e31e640 1 -- 172.21.15.79:0/2280672408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe68159b60 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6db1d640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe6815a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6e31e640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 0x7efe681612b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe60001580 tx=0x7efe6000af90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe600078c0 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe60007a20 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60013610 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe68159e40 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6814c4b0 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efe60013770 con 0x7efe680c7f00 2024-03-24T10:36:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.813+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7efe60024350 con 0x7efe680c7f00 2024-03-24T10:36:02.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.814+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6815a320 con 0x7efe680c7f00 2024-03-24T10:36:02.820 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.816+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efe60017020 con 0x7efe680c7f00 2024-03-24T10:36:02.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.889+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26bee6bd-24f4-454d-ab96-a1a3dfa826a4", "id": 1} v 0) -- 0x7efe6804f470 con 0x7efe680c7f00 2024-03-24T10:36:02.895 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.894+0000 7efe5e7fc640 1 -- 172.21.15.79:0/2280672408 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26bee6bd-24f4-454d-ab96-a1a3dfa826a4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7efe64009690 con 0x7efe680c7f00 2024-03-24T10:36:02.895 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 msgr2=0x7efe681612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 0x7efe681612b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe60001580 tx=0x7efe6000af90 comp rx=0 tx=0).stop 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 shutdown_connections 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe680c7f00 0x7efe681612b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe6814c920 0x7efe680c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 --2- 172.21.15.79:0/2280672408 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe540047c0 0x7efe6815a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.895+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 >> 172.21.15.79:0/2280672408 conn(0x7efe680d1d00 msgr2=0x7efe6806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.896+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 shutdown_connections 2024-03-24T10:36:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:02.896+0000 7efe6fd81640 1 -- 172.21.15.79:0/2280672408 wait complete. 2024-03-24T10:36:02.907 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 0e134ac2-19d3-4b80-8c0c-dce8820921ed 2 2024-03-24T10:36:03.007 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.007+0000 7fddfbe9a640 1 Processor -- start 2024-03-24T10:36:03.008 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.007+0000 7fddfbe9a640 1 -- start start 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddfbe9a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fddf415e200 0x7fddf40cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddfbe9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 0x7fddf406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddfbe9a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf406d5b0 con 0x7fddf4161c20 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddfbe9a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fddf406c600 con 0x7fddf415e200 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddfbe9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fddf4162b80 con 0x7fddf406cc30 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddf9435640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 0x7fddf406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddf9435640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 0x7fddf406d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50178/0 (socket says 172.21.15.79:50178) 2024-03-24T10:36:03.009 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddf9435640 1 -- 172.21.15.79:0/1318841393 learned_addr learned my addr 172.21.15.79:0/1318841393 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.008+0000 7fddf9c36640 1 --2- 172.21.15.79:0/1318841393 >> v2:172.21.15.72:3300/0 conn(0x7fddf415e200 0x7fddf40cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf9435640 1 -- 172.21.15.79:0/1318841393 >> v2:172.21.15.72:3300/0 conn(0x7fddf415e200 msgr2=0x7fddf40cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:03.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf9435640 1 --2- 172.21.15.79:0/1318841393 >> v2:172.21.15.72:3300/0 conn(0x7fddf415e200 0x7fddf40cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf9435640 1 -- 172.21.15.79:0/1318841393 >> v1:172.21.15.72:6789/0 conn(0x7fddf4161c20 legacy=0x7fddf4162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.010 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf9435640 1 -- 172.21.15.79:0/1318841393 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf41628a0 con 0x7fddf406cc30 2024-03-24T10:36:03.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf9435640 1 --2- 172.21.15.79:0/1318841393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 0x7fddf406d070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009870 tx=0x7fddf002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1dbb5daf794b7ff server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf8c34640 1 -- 172.21.15.79:0/1318841393 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0031640 con 0x7fddf406cc30 2024-03-24T10:36:03.011 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf8c34640 1 -- 172.21.15.79:0/1318841393 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf00317a0 con 0x7fddf406cc30 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.009+0000 7fddf8c34640 1 -- 172.21.15.79:0/1318841393 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0031b30 con 0x7fddf406cc30 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 -- 172.21.15.79:0/1318841393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 msgr2=0x7fddf406d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/1318841393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 0x7fddf406d070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009870 tx=0x7fddf002b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 -- 172.21.15.79:0/1318841393 shutdown_connections 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/1318841393 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf406cc30 0x7fddf406d070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/1318841393 >> v2:172.21.15.72:3300/0 conn(0x7fddf415e200 0x7fddf40cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 -- 172.21.15.79:0/1318841393 >> 172.21.15.79:0/1318841393 conn(0x7fddf409a9d0 msgr2=0x7fddf409ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 -- 172.21.15.79:0/1318841393 shutdown_connections 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.010+0000 7fddfbe9a640 1 -- 172.21.15.79:0/1318841393 wait complete. 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.011+0000 7fddfbe9a640 1 Processor -- start 2024-03-24T10:36:03.012 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.011+0000 7fddfbe9a640 1 -- start start 2024-03-24T10:36:03.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfbe9a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf406cc30 0x7fddf40b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfbe9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 0x7fddf41f3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfbe9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf4161c20 0x7fddf414ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.015 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfbe9a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fddf40c6b60 con 0x7fddf406cc30 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfbe9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fddf41f50c0 con 0x7fddf415e200 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfbe9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fddf41f4820 con 0x7fddf4161c20 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfa437640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf4161c20 0x7fddf414ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 0x7fddf41f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 0x7fddf41f3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57494/0 (socket says 172.21.15.79:57494) 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 -- 172.21.15.79:0/891410753 learned_addr learned my addr 172.21.15.79:0/891410753 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9c36640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf406cc30 0x7fddf40b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 -- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf4161c20 msgr2=0x7fddf414ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf4161c20 0x7fddf414ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 -- 172.21.15.79:0/891410753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf406cc30 msgr2=0x7fddf40b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf406cc30 0x7fddf40b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddf9435640 1 -- 172.21.15.79:0/891410753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf00094d0 con 0x7fddf415e200 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.012+0000 7fddfa437640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf4161c20 0x7fddf414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:03.016 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddf9435640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 0x7fddf41f3f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddf0000c00 tx=0x7fddf00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf003a930 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf003aa90 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf003ae40 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf41f4b00 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf41f4450 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fddf002f050 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.013+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fddf0044c70 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.014+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf40c8680 con 0x7fddf415e200 2024-03-24T10:36:03.017 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.016+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fddf0035020 con 0x7fddf415e200 2024-03-24T10:36:03.023 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.022+0000 7f212942b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-24T10:36:03.044 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.044+0000 7f8cfd271040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-24T10:36:03.079 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.078+0000 7f212942b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-24T10:36:03.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.088+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e134ac2-19d3-4b80-8c0c-dce8820921ed", "id": 2} v 0) -- 0x7fddf40c6ca0 con 0x7fddf415e200 2024-03-24T10:36:03.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.092+0000 7fddea7fc640 1 -- 172.21.15.79:0/891410753 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e134ac2-19d3-4b80-8c0c-dce8820921ed", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fddf40c6ca0 con 0x7fddf415e200 2024-03-24T10:36:03.093 INFO:teuthology.orchestra.run.smithi079.stdout:2 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 msgr2=0x7fddf41f3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 0x7fddf41f3f10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fddf0000c00 tx=0x7fddf00046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 shutdown_connections 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fddf4161c20 0x7fddf414ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fddf415e200 0x7fddf41f3f10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 --2- 172.21.15.79:0/891410753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fddf406cc30 0x7fddf40b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 >> 172.21.15.79:0/891410753 conn(0x7fddf409a9d0 msgr2=0x7fddf4156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 shutdown_connections 2024-03-24T10:36:03.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.093+0000 7fddfbe9a640 1 -- 172.21.15.79:0/891410753 wait complete. 2024-03-24T10:36:03.098 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.098+0000 7f8cfd271040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-24T10:36:03.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new fda3f5fb-e909-4388-8d88-6a8a9c3be100 3 2024-03-24T10:36:03.127 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.126+0000 7f212942b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-24T10:36:03.143 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.143+0000 7f8cfd271040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-24T10:36:03.183 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.182+0000 7f212942b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-24T10:36:03.196 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.196+0000 7f8cfd271040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-24T10:36:03.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 Processor -- start 2024-03-24T10:36:03.206 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 -- start start 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1a81445e0 0x7fe1a8071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a80726f0 con 0x7fe1a80722d0 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe1a80b4ba0 con 0x7fe1a81445e0 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.203+0000 7fe1adac2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a80b4060 con 0x7fe1a81439e0 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a6ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1a81445e0 0x7fe1a8071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe1a80722d0 0x7fe1a815e9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60330/0 (socket says 172.21.15.79:60330) 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a77fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a7fff640 1 -- 172.21.15.79:0/1029920389 learned_addr learned my addr 172.21.15.79:0/1029920389 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a6ffd640 1 -- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 msgr2=0x7fe1a80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a6ffd640 1 --2- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a80b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a6ffd640 1 -- 172.21.15.79:0/1029920389 >> v1:172.21.15.79:6789/0 conn(0x7fe1a80722d0 legacy=0x7fe1a815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a67fc640 1 -- 172.21.15.79:0/1029920389 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293802065 0 0) 0x7fe1a80726f0 con 0x7fe1a80722d0 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a6ffd640 1 -- 172.21.15.79:0/1029920389 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a80b4300 con 0x7fe1a81445e0 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.204+0000 7fe1a77fe640 1 --2- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1a6ffd640 1 --2- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a8071d90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00ba40 tx=0x7fe19c02dff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffced17646fc0849 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1a67fc640 1 -- 172.21.15.79:0/1029920389 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c02eda0 con 0x7fe1a81445e0 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1a67fc640 1 -- 172.21.15.79:0/1029920389 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe19c036440 con 0x7fe1a81445e0 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1a67fc640 1 -- 172.21.15.79:0/1029920389 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0367d0 con 0x7fe1a81445e0 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 -- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 msgr2=0x7fe1a8071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a8071d90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00ba40 tx=0x7fe19c02dff0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 -- 172.21.15.79:0/1029920389 shutdown_connections 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a8071d90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1029920389 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 -- 172.21.15.79:0/1029920389 >> 172.21.15.79:0/1029920389 conn(0x7fe1a80b2820 msgr2=0x7fe1a80b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.205+0000 7fe1adac2640 1 -- 172.21.15.79:0/1029920389 shutdown_connections 2024-03-24T10:36:03.209 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.206+0000 7fe1adac2640 1 -- 172.21.15.79:0/1029920389 wait complete. 2024-03-24T10:36:03.221 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 Processor -- start 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 -- start start 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80722d0 0x7fe1a813d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a815e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a806ed70 con 0x7fe1a80722d0 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a806fa60 con 0x7fe1a81445e0 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.207+0000 7fe1adac2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a806fd40 con 0x7fe1a81439e0 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a815e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a815e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57510/0 (socket says 172.21.15.79:57510) 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a6ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 -- 172.21.15.79:0/1834741987 learned_addr learned my addr 172.21.15.79:0/1834741987 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.222 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a77fe640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80722d0 0x7fe1a813d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 -- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 msgr2=0x7fe1a806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a806f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 -- 172.21.15.79:0/1834741987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80722d0 msgr2=0x7fe1a813d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80722d0 0x7fe1a813d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 -- 172.21.15.79:0/1834741987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe198009400 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a77fe640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80722d0 0x7fe1a813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1a7fff640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a815e970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c7a0 tx=0x7fe1a000cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000a640 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1a000a7a0 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000abd0 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c00b6a0 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a8070300 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1a000ad30 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.208+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fe1a0012890 con 0x7fe1a81445e0 2024-03-24T10:36:03.223 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.209+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a804f470 con 0x7fe1a81445e0 2024-03-24T10:36:03.224 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.211+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe1a0018070 con 0x7fe1a81445e0 2024-03-24T10:36:03.228 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.227+0000 7f212942b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-24T10:36:03.238 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.238+0000 7f8cfd271040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-24T10:36:03.284 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.284+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fda3f5fb-e909-4388-8d88-6a8a9c3be100", "id": 3} v 0) -- 0x7fe1a80b15d0 con 0x7fe1a81445e0 2024-03-24T10:36:03.287 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.287+0000 7fe18ffff640 1 -- 172.21.15.79:0/1834741987 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fda3f5fb-e909-4388-8d88-6a8a9c3be100", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fe1a00125b0 con 0x7fe1a81445e0 2024-03-24T10:36:03.288 INFO:teuthology.orchestra.run.smithi079.stdout:3 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 msgr2=0x7fe1a815e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a815e970 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000c7a0 tx=0x7fe1a000cc60 comp rx=0 tx=0).stop 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 shutdown_connections 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1a81445e0 0x7fe1a815e970 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1a81439e0 0x7fe1a806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 --2- 172.21.15.79:0/1834741987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a80722d0 0x7fe1a813d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 >> 172.21.15.79:0/1834741987 conn(0x7fe1a80b2820 msgr2=0x7fe1a80b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 shutdown_connections 2024-03-24T10:36:03.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.288+0000 7fe1adac2640 1 -- 172.21.15.79:0/1834741987 wait complete. 2024-03-24T10:36:03.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 279d98ea-b780-42e2-bee9-f8c8fcf2ff71 4 2024-03-24T10:36:03.348 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.348+0000 7f212942b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-24T10:36:03.353 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.353+0000 7f8cfd271040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-24T10:36:03.422 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.421+0000 7f212942b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-24T10:36:03.422 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.422+0000 7f8cfd271040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-24T10:36:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.440+0000 7f23fad43640 1 Processor -- start 2024-03-24T10:36:03.441 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.440+0000 7f23fad43640 1 -- start start 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23fad43640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23f415bf50 0x7f23f40d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23fad43640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 0x7f23f40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23fad43640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23f40cc750 con 0x7f23f40d1e30 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23fad43640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f23f415c330 con 0x7f23f415bf50 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23fad43640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f23f40b2170 con 0x7f23f40b1b90 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 0x7f23f40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 0x7f23f40ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50228/0 (socket says 172.21.15.79:50228) 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 -- 172.21.15.79:0/1564102395 learned_addr learned my addr 172.21.15.79:0/1564102395 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f8adf640 1 --2- 172.21.15.79:0/1564102395 >> v2:172.21.15.72:3300/0 conn(0x7f23f415bf50 0x7f23f40d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.443 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 -- 172.21.15.79:0/1564102395 >> v2:172.21.15.72:3300/0 conn(0x7f23f415bf50 msgr2=0x7f23f40d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 --2- 172.21.15.79:0/1564102395 >> v2:172.21.15.72:3300/0 conn(0x7f23f415bf50 0x7f23f40d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 -- 172.21.15.79:0/1564102395 >> v1:172.21.15.72:6789/0 conn(0x7f23f40d1e30 legacy=0x7f23f40b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.441+0000 7f23f92e0640 1 -- 172.21.15.79:0/1564102395 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f40b2450 con 0x7f23f40b1b90 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.442+0000 7f23f92e0640 1 --2- 172.21.15.79:0/1564102395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 0x7f23f40ccc10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009e50 tx=0x7f23ec02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb6e99f066ea350 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23f37fe640 1 -- 172.21.15.79:0/1564102395 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec02cb00 con 0x7f23f40b1b90 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23f37fe640 1 -- 172.21.15.79:0/1564102395 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23ec02cc60 con 0x7f23f40b1b90 2024-03-24T10:36:03.444 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23f37fe640 1 -- 172.21.15.79:0/1564102395 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0343f0 con 0x7f23f40b1b90 2024-03-24T10:36:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 -- 172.21.15.79:0/1564102395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 msgr2=0x7f23f40ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 --2- 172.21.15.79:0/1564102395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 0x7f23f40ccc10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009e50 tx=0x7f23ec02bf60 comp rx=0 tx=0).stop 2024-03-24T10:36:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 -- 172.21.15.79:0/1564102395 shutdown_connections 2024-03-24T10:36:03.445 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 --2- 172.21.15.79:0/1564102395 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40b1b90 0x7f23f40ccc10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 --2- 172.21.15.79:0/1564102395 >> v2:172.21.15.72:3300/0 conn(0x7f23f415bf50 0x7f23f40d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 -- 172.21.15.79:0/1564102395 >> 172.21.15.79:0/1564102395 conn(0x7f23f409a9d0 msgr2=0x7f23f409ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 -- 172.21.15.79:0/1564102395 shutdown_connections 2024-03-24T10:36:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.443+0000 7f23fad43640 1 -- 172.21.15.79:0/1564102395 wait complete. 2024-03-24T10:36:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.444+0000 7f23fad43640 1 Processor -- start 2024-03-24T10:36:03.446 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.444+0000 7f23fad43640 1 -- start start 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23fad43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23f40b1b90 0x7f23f40c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23fad43640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 0x7f23f40c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23fad43640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f415bf50 0x7f23f40c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23fad43640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f23f415c470 con 0x7f23f415bf50 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23fad43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f23f40c5cb0 con 0x7f23f40b1b90 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23fad43640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f23f415c6c0 con 0x7f23f40d1e30 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 0x7f23f40c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23f8adf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23f40b1b90 0x7f23f40c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.449 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.445+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 0x7f23f40c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50240/0 (socket says 172.21.15.79:50240) 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 -- 172.21.15.79:0/3310396770 learned_addr learned my addr 172.21.15.79:0/3310396770 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f92e0640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f415bf50 0x7f23f40c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 -- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23f40b1b90 msgr2=0x7f23f40c7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23f40b1b90 0x7f23f40c7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 -- 172.21.15.79:0/3310396770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f415bf50 msgr2=0x7f23f40c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f415bf50 0x7f23f40c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 -- 172.21.15.79:0/3310396770 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec009b30 con 0x7f23f40d1e30 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f92e0640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f415bf50 0x7f23f40c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f3fff640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 0x7f23f40c5770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c430 tx=0x7f23e000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e00052d0 con 0x7f23f40d1e30 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e0005430 con 0x7f23f40d1e30 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f415c9a0 con 0x7f23f40d1e30 2024-03-24T10:36:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e0003850 con 0x7f23f40d1e30 2024-03-24T10:36:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f406cc80 con 0x7f23f40d1e30 2024-03-24T10:36:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f23e00039b0 con 0x7f23f40d1e30 2024-03-24T10:36:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.446+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f23e0012930 con 0x7f23f40d1e30 2024-03-24T10:36:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.447+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23f415d1a0 con 0x7f23f40d1e30 2024-03-24T10:36:03.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.449+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f23f415d1a0 con 0x7f23f40d1e30 2024-03-24T10:36:03.469 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.468+0000 7f8cfd271040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-24T10:36:03.471 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.471+0000 7f212942b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-24T10:36:03.520 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.520+0000 7f8cfd271040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-24T10:36:03.522 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.522+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "279d98ea-b780-42e2-bee9-f8c8fcf2ff71", "id": 4} v 0) -- 0x7f23f406d260 con 0x7f23f40d1e30 2024-03-24T10:36:03.525 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.525+0000 7f212942b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-24T10:36:03.527 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.527+0000 7f23f17fa640 1 -- 172.21.15.79:0/3310396770 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "279d98ea-b780-42e2-bee9-f8c8fcf2ff71", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f23e0017070 con 0x7f23f40d1e30 2024-03-24T10:36:03.527 INFO:teuthology.orchestra.run.smithi079.stdout:4 2024-03-24T10:36:03.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 msgr2=0x7f23f40c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.528 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 0x7f23f40c5770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f23e000c430 tx=0x7f23e000c8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 shutdown_connections 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f415bf50 0x7f23f40c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f23f40d1e30 0x7f23f40c5770 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 --2- 172.21.15.79:0/3310396770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f23f40b1b90 0x7f23f40c7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 >> 172.21.15.79:0/3310396770 conn(0x7f23f409a9d0 msgr2=0x7f23f406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 shutdown_connections 2024-03-24T10:36:03.529 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.528+0000 7f23fad43640 1 -- 172.21.15.79:0/3310396770 wait complete. 2024-03-24T10:36:03.539 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 1edfb40d-8263-4a85-95dd-d52b081ccf66 5 2024-03-24T10:36:03.568 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.568+0000 7f8cfd271040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-24T10:36:03.578 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.574+0000 7f212942b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-24T10:36:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.679+0000 7f7bf7a72640 1 Processor -- start 2024-03-24T10:36:03.679 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.679+0000 7f7bf7a72640 1 -- start start 2024-03-24T10:36:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.679+0000 7f7bf7a72640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7bf00b1700 0x7f7bf00cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.679+0000 7f7bf7a72640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf00cc8b0 con 0x7f7bf015c1b0 2024-03-24T10:36:03.680 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.679+0000 7f7bf7a72640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf00cf970 con 0x7f7bf00b1b40 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.679+0000 7f7bf7a72640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf00cfc10 con 0x7f7bf00b1700 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.680+0000 7f7bf500d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7bf00b1700 0x7f7bf00cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.680+0000 7f7bf500d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7bf00b1700 0x7f7bf00cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57528/0 (socket says 172.21.15.79:57528) 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.680+0000 7f7bf500d640 1 -- 172.21.15.79:0/2535660934 learned_addr learned my addr 172.21.15.79:0/2535660934 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.680+0000 7f7bf500d640 1 -- 172.21.15.79:0/2535660934 >> v1:172.21.15.79:6789/0 conn(0x7f7bf00b1b40 legacy=0x7f7bf00d01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.680+0000 7f7bf500d640 1 -- 172.21.15.79:0/2535660934 >> v1:172.21.15.72:6789/0 conn(0x7f7bf015c1b0 legacy=0x7f7bf00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.681 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.680+0000 7f7bf500d640 1 -- 172.21.15.79:0/2535660934 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf00cfef0 con 0x7f7bf00b1700 2024-03-24T10:36:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf500d640 1 --2- 172.21.15.79:0/2535660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf00b1700 0x7f7bf00cd2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009870 tx=0x7f7bec02bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87201febffa1545e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf480c640 1 -- 172.21.15.79:0/2535660934 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec02d870 con 0x7f7bf00b1700 2024-03-24T10:36:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf480c640 1 -- 172.21.15.79:0/2535660934 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec02d9d0 con 0x7f7bf00b1700 2024-03-24T10:36:03.682 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf480c640 1 -- 172.21.15.79:0/2535660934 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec02dd60 con 0x7f7bf00b1700 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2535660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf00b1700 msgr2=0x7f7bf00cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 --2- 172.21.15.79:0/2535660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf00b1700 0x7f7bf00cd2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009870 tx=0x7f7bec02bab0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2535660934 shutdown_connections 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 --2- 172.21.15.79:0/2535660934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf00b1700 0x7f7bf00cd2e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2535660934 >> 172.21.15.79:0/2535660934 conn(0x7f7bf00d1da0 msgr2=0x7f7bf00d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2535660934 shutdown_connections 2024-03-24T10:36:03.683 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.681+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2535660934 wait complete. 2024-03-24T10:36:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 Processor -- start 2024-03-24T10:36:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 -- start start 2024-03-24T10:36:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf00b1700 0x7f7bf01f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.687 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bf00b1b40 0x7f7bf015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 0x7f7bf00b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01f8680 con 0x7f7bf00b1700 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf00b74c0 con 0x7f7bf015c1b0 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf7a72640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf01f42f0 con 0x7f7bf00b1b40 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf600f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 0x7f7bf00b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf600f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 0x7f7bf00b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57534/0 (socket says 172.21.15.79:57534) 2024-03-24T10:36:03.688 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf500d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bf00b1b40 0x7f7bf015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.683+0000 7f7bf600f640 1 -- 172.21.15.79:0/2126025121 learned_addr learned my addr 172.21.15.79:0/2126025121 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf580e640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf00b1700 0x7f7bf01f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf500d640 1 -- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 msgr2=0x7f7bf00b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf500d640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 0x7f7bf00b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf500d640 1 -- 172.21.15.79:0/2126025121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf00b1700 msgr2=0x7f7bf01f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf500d640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf00b1700 0x7f7bf01f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf500d640 1 -- 172.21.15.79:0/2126025121 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec0094d0 con 0x7f7bf00b1b40 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf600f640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 0x7f7bf00b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf500d640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bf00b1b40 0x7f7bf015a520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7bec033000 tx=0x7f7bec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec03c040 con 0x7f7bf00b1b40 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec037d00 con 0x7f7bf00b1b40 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf01f7de0 con 0x7f7bf00b1b40 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec02e680 con 0x7f7bf00b1b40 2024-03-24T10:36:03.689 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf01f83a0 con 0x7f7bf00b1b40 2024-03-24T10:36:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7bec02e7e0 con 0x7f7bf00b1b40 2024-03-24T10:36:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.684+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7bec032070 con 0x7f7bf00b1b40 2024-03-24T10:36:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.685+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf01f4150 con 0x7f7bf00b1b40 2024-03-24T10:36:03.690 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.687+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7bf01f4150 con 0x7f7bf00b1b40 2024-03-24T10:36:03.760 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.759+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1edfb40d-8263-4a85-95dd-d52b081ccf66", "id": 5} v 0) -- 0x7f7bf0067d70 con 0x7f7bf00b1b40 2024-03-24T10:36:03.768 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.764+0000 7f7be67fc640 1 -- 172.21.15.79:0/2126025121 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1edfb40d-8263-4a85-95dd-d52b081ccf66", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7bec047070 con 0x7f7bf00b1b40 2024-03-24T10:36:03.769 INFO:teuthology.orchestra.run.smithi079.stdout:5 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bf00b1b40 msgr2=0x7f7bf015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bf00b1b40 0x7f7bf015a520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7bec033000 tx=0x7f7bec004730 comp rx=0 tx=0).stop 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 shutdown_connections 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bf015c1b0 0x7f7bf00b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7bf00b1b40 0x7f7bf015a520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 --2- 172.21.15.79:0/2126025121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7bf00b1700 0x7f7bf01f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 >> 172.21.15.79:0/2126025121 conn(0x7f7bf00d1da0 msgr2=0x7f7bf00b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 shutdown_connections 2024-03-24T10:36:03.771 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.765+0000 7f7bf7a72640 1 -- 172.21.15.79:0/2126025121 wait complete. 2024-03-24T10:36:03.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 718f88af-7338-4954-9f6d-5d1bf3dc7057 6 2024-03-24T10:36:03.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.877+0000 7fd5b3d77640 1 Processor -- start 2024-03-24T10:36:03.877 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.877+0000 7fd5b3d77640 1 -- start start 2024-03-24T10:36:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b3d77640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd5ac0d2b20 0x7fd5ac0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b3d77640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d0f70 0x7fd5ac0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b3d77640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5ac0d4950 con 0x7fd5ac15e240 2024-03-24T10:36:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b3d77640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd5ac0d2270 con 0x7fd5ac0d2b20 2024-03-24T10:36:03.879 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b3d77640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ac0b38c0 con 0x7fd5ac0d0f70 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b2314640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d0f70 0x7fd5ac0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b1b13640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd5ac15e240 0x7fd5ac0d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60340/0 (socket says 172.21.15.79:60340) 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b1b13640 1 -- 172.21.15.79:0/3409906179 learned_addr learned my addr 172.21.15.79:0/3409906179 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.878+0000 7fd5b1312640 1 --2- 172.21.15.79:0/3409906179 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac0d2b20 0x7fd5ac0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b0b11640 1 -- 172.21.15.79:0/3409906179 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816248214 0 0) 0x7fd5ac0d4950 con 0x7fd5ac15e240 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b0b11640 1 -- 172.21.15.79:0/3409906179 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd598003520 con 0x7fd5ac15e240 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b2314640 1 -- 172.21.15.79:0/3409906179 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac0d2b20 msgr2=0x7fd5ac0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b2314640 1 --2- 172.21.15.79:0/3409906179 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac0d2b20 0x7fd5ac0cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b2314640 1 -- 172.21.15.79:0/3409906179 >> v1:172.21.15.79:6789/0 conn(0x7fd5ac15e240 legacy=0x7fd5ac0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.880 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b2314640 1 -- 172.21.15.79:0/3409906179 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ac0b3550 con 0x7fd5ac0d0f70 2024-03-24T10:36:03.881 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b2314640 1 --2- 172.21.15.79:0/3409906179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d0f70 0x7fd5ac0cef80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009d90 tx=0x7fd5a402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cec91420ab87b0d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.879+0000 7fd5b0b11640 1 -- 172.21.15.79:0/3409906179 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a402cbc0 con 0x7fd5ac0d0f70 2024-03-24T10:36:03.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b0b11640 1 -- 172.21.15.79:0/3409906179 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a402cd20 con 0x7fd5ac0d0f70 2024-03-24T10:36:03.882 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b0b11640 1 -- 172.21.15.79:0/3409906179 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4034660 con 0x7fd5ac0d0f70 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 -- 172.21.15.79:0/3409906179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d0f70 msgr2=0x7fd5ac0cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/3409906179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d0f70 0x7fd5ac0cef80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009d90 tx=0x7fd5a402be10 comp rx=0 tx=0).stop 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 -- 172.21.15.79:0/3409906179 shutdown_connections 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/3409906179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d0f70 0x7fd5ac0cef80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/3409906179 >> v2:172.21.15.72:3300/0 conn(0x7fd5ac0d2b20 0x7fd5ac0cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 -- 172.21.15.79:0/3409906179 >> 172.21.15.79:0/3409906179 conn(0x7fd5ac0d3e30 msgr2=0x7fd5ac0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 -- 172.21.15.79:0/3409906179 shutdown_connections 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.880+0000 7fd5b3d77640 1 -- 172.21.15.79:0/3409906179 wait complete. 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.881+0000 7fd5b3d77640 1 Processor -- start 2024-03-24T10:36:03.883 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.881+0000 7fd5b3d77640 1 -- start start 2024-03-24T10:36:03.885 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b3d77640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0d0f70 0x7fd5ac1f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.887 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b3d77640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d2b20 0x7fd5ac1f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b3d77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5ac15e240 0x7fd5ac0cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b3d77640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac0c7960 con 0x7fd5ac0d0f70 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b3d77640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ac1f3e10 con 0x7fd5ac15e240 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b3d77640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd5ac1f5570 con 0x7fd5ac0d2b20 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b1312640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d2b20 0x7fd5ac1f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b2314640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5ac15e240 0x7fd5ac0cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b1312640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d2b20 0x7fd5ac1f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50268/0 (socket says 172.21.15.79:50268) 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b1312640 1 -- 172.21.15.79:0/1058373196 learned_addr learned my addr 172.21.15.79:0/1058373196 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b1b13640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0d0f70 0x7fd5ac1f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:03.888 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b2314640 1 -- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d2b20 msgr2=0x7fd5ac1f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b2314640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d2b20 0x7fd5ac1f6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b2314640 1 -- 172.21.15.79:0/1058373196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0d0f70 msgr2=0x7fd5ac1f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b2314640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0d0f70 0x7fd5ac1f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.882+0000 7fd5b2314640 1 -- 172.21.15.79:0/1058373196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a4009a70 con 0x7fd5ac15e240 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5b2314640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5ac15e240 0x7fd5ac0cc2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4033000 tx=0x7fd5a4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4040650 con 0x7fd5ac15e240 2024-03-24T10:36:03.889 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a402ce90 con 0x7fd5ac15e240 2024-03-24T10:36:03.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40409f0 con 0x7fd5ac15e240 2024-03-24T10:36:03.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ac0cb2e0 con 0x7fd5ac15e240 2024-03-24T10:36:03.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ac0cb8a0 con 0x7fd5ac15e240 2024-03-24T10:36:03.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5a4049400 con 0x7fd5ac15e240 2024-03-24T10:36:03.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.883+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd5a403e9f0 con 0x7fd5ac15e240 2024-03-24T10:36:03.890 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.884+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ac1f3fa0 con 0x7fd5ac15e240 2024-03-24T10:36:03.892 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.887+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd5a4044020 con 0x7fd5ac15e240 2024-03-24T10:36:03.946 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:03.943+0000 7f8cfd271040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-24T10:36:03.962 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.961+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd new", "uuid": "718f88af-7338-4954-9f6d-5d1bf3dc7057", "id": 6} v 0) -- 0x7fd5ac04f470 con 0x7fd5ac15e240 2024-03-24T10:36:03.966 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.965+0000 7fd5a27fc640 1 -- 172.21.15.79:0/1058373196 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "718f88af-7338-4954-9f6d-5d1bf3dc7057", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd5a4039070 con 0x7fd5ac15e240 2024-03-24T10:36:03.966 INFO:teuthology.orchestra.run.smithi079.stdout:6 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5ac15e240 msgr2=0x7fd5ac0cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5ac15e240 0x7fd5ac0cc2e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4033000 tx=0x7fd5a4004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 shutdown_connections 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd5ac15e240 0x7fd5ac0cc2e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5ac0d2b20 0x7fd5ac1f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 --2- 172.21.15.79:0/1058373196 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd5ac0d0f70 0x7fd5ac1f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:03.967 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 >> 172.21.15.79:0/1058373196 conn(0x7fd5ac0d3e30 msgr2=0x7fd5ac0b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:03.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 shutdown_connections 2024-03-24T10:36:03.968 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:03.966+0000 7fd5b3d77640 1 -- 172.21.15.79:0/1058373196 wait complete. 2024-03-24T10:36:03.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 56a24579-366a-4688-8980-5c14159578ad 7 2024-03-24T10:36:03.978 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:03.977+0000 7f212942b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-24T10:36:04.077 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.076+0000 7f8cfd271040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-24T10:36:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.079+0000 7f6c25c34640 1 Processor -- start 2024-03-24T10:36:04.079 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.079+0000 7f6c25c34640 1 -- start start 2024-03-24T10:36:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c25c34640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c20072610 0x7f6c201659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c25c34640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2015c220 con 0x7f6c2015bd70 2024-03-24T10:36:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c25c34640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c200aeee0 con 0x7f6c201554c0 2024-03-24T10:36:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c25c34640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6c200aecc0 con 0x7f6c20072610 2024-03-24T10:36:04.080 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c20072610 0x7f6c201659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1f7fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c201554c0 0x7f6c200ae5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.79:60350/0 (socket says 172.21.15.79:60350) 2024-03-24T10:36:04.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1f7fe640 1 -- 172.21.15.79:0/2575970150 learned_addr learned my addr 172.21.15.79:0/2575970150 (peer_addr_for_me v1:172.21.15.79:0/0) 2024-03-24T10:36:04.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1e7fc640 1 -- 172.21.15.79:0/2575970150 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3277934874 0 0) 0x7f6c200aeee0 con 0x7f6c201554c0 2024-03-24T10:36:04.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1ffff640 1 -- 172.21.15.79:0/2575970150 >> v1:172.21.15.79:6789/0 conn(0x7f6c201554c0 legacy=0x7f6c200ae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1ffff640 1 -- 172.21.15.79:0/2575970150 >> v1:172.21.15.72:6789/0 conn(0x7f6c2015bd70 legacy=0x7f6c20071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.081 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.080+0000 7f6c1ffff640 1 -- 172.21.15.79:0/2575970150 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c200af1c0 con 0x7f6c20072610 2024-03-24T10:36:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c1ffff640 1 --2- 172.21.15.79:0/2575970150 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c20072610 0x7f6c201659b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009dc0 tx=0x7f6c1802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68575788db0bda3a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c1e7fc640 1 -- 172.21.15.79:0/2575970150 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1802ccd0 con 0x7f6c20072610 2024-03-24T10:36:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c1e7fc640 1 -- 172.21.15.79:0/2575970150 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c1802ce30 con 0x7f6c20072610 2024-03-24T10:36:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c1e7fc640 1 -- 172.21.15.79:0/2575970150 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18034660 con 0x7f6c20072610 2024-03-24T10:36:04.082 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c25c34640 1 -- 172.21.15.79:0/2575970150 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c20072610 msgr2=0x7f6c201659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c25c34640 1 --2- 172.21.15.79:0/2575970150 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c20072610 0x7f6c201659b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009dc0 tx=0x7f6c1802bf20 comp rx=0 tx=0).stop 2024-03-24T10:36:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c25c34640 1 -- 172.21.15.79:0/2575970150 shutdown_connections 2024-03-24T10:36:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c25c34640 1 --2- 172.21.15.79:0/2575970150 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c20072610 0x7f6c201659b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.081+0000 7f6c25c34640 1 -- 172.21.15.79:0/2575970150 >> 172.21.15.79:0/2575970150 conn(0x7f6c200b29c0 msgr2=0x7f6c200b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.082+0000 7f6c25c34640 1 -- 172.21.15.79:0/2575970150 shutdown_connections 2024-03-24T10:36:04.083 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.082+0000 7f6c25c34640 1 -- 172.21.15.79:0/2575970150 wait complete. 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.083+0000 7f6c25c34640 1 Processor -- start 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.083+0000 7f6c25c34640 1 -- start start 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.083+0000 7f6c25c34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c20072610 0x7f6c2014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.083+0000 7f6c25c34640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 0x7f6c200b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.083+0000 7f6c25c34640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c2015bd70 0x7f6c200b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c25c34640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20159bd0 con 0x7f6c2015bd70 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c25c34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c20159eb0 con 0x7f6c20072610 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c25c34640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2015a190 con 0x7f6c201554c0 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 0x7f6c200b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.087 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c20072610 0x7f6c2014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 0x7f6c200b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.79:50296/0 (socket says 172.21.15.79:50296) 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 -- 172.21.15.79:0/1239234562 learned_addr learned my addr 172.21.15.79:0/1239234562 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1ffff640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c2015bd70 0x7f6c200b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 -- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c20072610 msgr2=0x7f6c2014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c20072610 0x7f6c2014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 -- 172.21.15.79:0/1239234562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c2015bd70 msgr2=0x7f6c200b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c2015bd70 0x7f6c200b2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 -- 172.21.15.79:0/1239234562 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c18009a70 con 0x7f6c201554c0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c1effd640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 0x7f6c200b1d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c450 tx=0x7f6c1400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c140052d0 con 0x7f6c201554c0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c14005430 con 0x7f6c201554c0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2015a470 con 0x7f6c201554c0 2024-03-24T10:36:04.088 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c14012870 con 0x7f6c201554c0 2024-03-24T10:36:04.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.084+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c20153d70 con 0x7f6c201554c0 2024-03-24T10:36:04.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.085+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6c140129d0 con 0x7f6c201554c0 2024-03-24T10:36:04.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.085+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6c1401ba60 con 0x7f6c201554c0 2024-03-24T10:36:04.089 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.085+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c20075330 con 0x7f6c201554c0 2024-03-24T10:36:04.104 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.089+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6c1401b400 con 0x7f6c201554c0 2024-03-24T10:36:04.122 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.122+0000 7f212942b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-24T10:36:04.162 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.162+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56a24579-366a-4688-8980-5c14159578ad", "id": 7} v 0) -- 0x7f6c2004f470 con 0x7f6c201554c0 2024-03-24T10:36:04.171 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.170+0000 7f6c07fff640 1 -- 172.21.15.79:0/1239234562 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56a24579-366a-4688-8980-5c14159578ad", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f6c1402a0b0 con 0x7f6c201554c0 2024-03-24T10:36:04.172 INFO:teuthology.orchestra.run.smithi079.stdout:7 2024-03-24T10:36:04.172 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 msgr2=0x7f6c200b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 0x7f6c200b1d20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6c1400c450 tx=0x7f6c1400c910 comp rx=0 tx=0).stop 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 shutdown_connections 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c2015bd70 0x7f6c200b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c201554c0 0x7f6c200b1d20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 --2- 172.21.15.79:0/1239234562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c20072610 0x7f6c2014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 >> 172.21.15.79:0/1239234562 conn(0x7f6c200b29c0 msgr2=0x7f6c2006dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 shutdown_connections 2024-03-24T10:36:04.173 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:36:04.171+0000 7f6c25c34640 1 -- 172.21.15.79:0/1239234562 wait complete. 2024-03-24T10:36:04.182 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-24T10:36:04.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-24T10:36:04.185 INFO:tasks.ceph.osd.0:Started 2024-03-24T10:36:04.185 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-24T10:36:04.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-24T10:36:04.185 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.184+0000 7f8cfd271040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-24T10:36:04.193 INFO:tasks.ceph.osd.1:Started 2024-03-24T10:36:04.194 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-24T10:36:04.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-24T10:36:04.197 INFO:tasks.ceph.osd.2:Started 2024-03-24T10:36:04.197 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-24T10:36:04.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-24T10:36:04.199 INFO:tasks.ceph.osd.3:Started 2024-03-24T10:36:04.199 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-24T10:36:04.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-24T10:36:04.201 INFO:tasks.ceph.osd.4:Started 2024-03-24T10:36:04.201 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-24T10:36:04.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-24T10:36:04.203 INFO:tasks.ceph.osd.5:Started 2024-03-24T10:36:04.204 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-24T10:36:04.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-24T10:36:04.206 INFO:tasks.ceph.osd.6:Started 2024-03-24T10:36:04.206 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-24T10:36:04.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-24T10:36:04.208 INFO:tasks.ceph.osd.7:Started 2024-03-24T10:36:04.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:04.245 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.245+0000 7f8cfd271040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-24T10:36:04.251 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.250+0000 7f212942b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-24T10:36:04.313 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.313+0000 7f212942b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-24T10:36:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.331+0000 7fc3a828f640 1 Processor -- start 2024-03-24T10:36:04.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.331+0000 7fc3a828f640 1 -- start start 2024-03-24T10:36:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.332+0000 7fc3a828f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc3a015e170 0x7fc3a015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.332+0000 7fc3a828f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3a00d2450 0x7fc3a00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3a00d2450 0x7fc3a00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc3a00d2450 0x7fc3a00b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50726/0 (socket says 172.21.15.72:50726) 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 -- 172.21.15.72:0/3545081006 learned_addr learned my addr 172.21.15.72:0/3545081006 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a602b640 1 --2- 172.21.15.72:0/3545081006 >> v2:172.21.15.79:3300/0 conn(0x7fc3a015e170 0x7fc3a015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a00d4e50 con 0x7fc3a00d4930 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a00cf790 con 0x7fc3a00d2450 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a00cfa70 con 0x7fc3a015e170 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 -- 172.21.15.72:0/3545081006 >> v2:172.21.15.79:3300/0 conn(0x7fc3a015e170 msgr2=0x7fc3a015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 --2- 172.21.15.72:0/3545081006 >> v2:172.21.15.79:3300/0 conn(0x7fc3a015e170 0x7fc3a015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 -- 172.21.15.72:0/3545081006 >> v1:172.21.15.79:6789/0 conn(0x7fc3a00d4930 legacy=0x7fc3a00d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a682c640 1 -- 172.21.15.72:0/3545081006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a00cfd50 con 0x7fc3a00d2450 2024-03-24T10:36:04.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.333+0000 7fc3a5029640 1 -- 172.21.15.72:0/3545081006 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3241978375 0 0) 0x7fc3a00d4e50 con 0x7fc3a00d4930 2024-03-24T10:36:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.334+0000 7fc3a682c640 1 --2- 172.21.15.72:0/3545081006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a00b3c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00b6b20 tx=0x7fc39802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8906aa12051efa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:04.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.334+0000 7fc3a5029640 1 -- 172.21.15.72:0/3545081006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39802caa0 con 0x7fc3a00d2450 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.334+0000 7fc3a5029640 1 -- 172.21.15.72:0/3545081006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39802cc00 con 0x7fc3a00d2450 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.334+0000 7fc3a5029640 1 -- 172.21.15.72:0/3545081006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980343f0 con 0x7fc3a00d2450 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.334+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 msgr2=0x7fc3a00b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.334+0000 7fc3a828f640 1 --2- 172.21.15.72:0/3545081006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a00b3c80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00b6b20 tx=0x7fc39802bf00 comp rx=0 tx=0).stop 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.335+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 shutdown_connections 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.335+0000 7fc3a828f640 1 --2- 172.21.15.72:0/3545081006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a00b3c80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.335+0000 7fc3a828f640 1 --2- 172.21.15.72:0/3545081006 >> v2:172.21.15.79:3300/0 conn(0x7fc3a015e170 0x7fc3a015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.335+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 >> 172.21.15.72:0/3545081006 conn(0x7fc3a009d310 msgr2=0x7fc3a00d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.335+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 shutdown_connections 2024-03-24T10:36:04.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.335+0000 7fc3a828f640 1 -- 172.21.15.72:0/3545081006 wait complete. 2024-03-24T10:36:04.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.336+0000 7fc3a828f640 1 Processor -- start 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.336+0000 7fc3a828f640 1 -- start start 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.336+0000 7fc3a828f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a0153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.336+0000 7fc3a828f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00d4930 0x7fc3a01f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.336+0000 7fc3a828f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a015e170 0x7fc3a00cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.336+0000 7fc3a828f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a0160b60 con 0x7fc3a00d2450 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a828f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a01f3b60 con 0x7fc3a00d4930 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a0153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a828f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a01539a0 con 0x7fc3a015e170 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a0153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50742/0 (socket says 172.21.15.72:50742) 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 -- 172.21.15.72:0/1940120971 learned_addr learned my addr 172.21.15.72:0/1940120971 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a582a640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00d4930 0x7fc3a01f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a682c640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a015e170 0x7fc3a00cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:04.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 -- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a015e170 msgr2=0x7fc3a00cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a015e170 0x7fc3a00cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 -- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00d4930 msgr2=0x7fc3a01f4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00d4930 0x7fc3a01f4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 -- 172.21.15.72:0/1940120971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc398009b30 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a682c640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a015e170 0x7fc3a00cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a602b640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a0153460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc39000e870 tx=0x7fc39000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3900094f0 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39000c940 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39000ccf0 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a015fee0 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a01604a0 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc390013470 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.337+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc390013720 con 0x7fc3a00d2450 2024-03-24T10:36:04.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.338+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a00a1ef0 con 0x7fc3a00d2450 2024-03-24T10:36:04.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.340+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc390021060 con 0x7fc3a00d2450 2024-03-24T10:36:04.379 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.378+0000 7f8cfd271040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-24T10:36:04.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.401+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3a004f550 con 0x7fc3a00d2450 2024-03-24T10:36:04.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.401+0000 7fc396ffd640 1 -- 172.21.15.72:0/1940120971 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc39002a020 con 0x7fc3a00d2450 2024-03-24T10:36:04.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:04.402 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:04.164041+0000","last_up_change":"0.000000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 msgr2=0x7fc3a0153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a0153460 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc39000e870 tx=0x7fc39000ed30 comp rx=0 tx=0).stop 2024-03-24T10:36:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 shutdown_connections 2024-03-24T10:36:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc3a015e170 0x7fc3a00cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc3a00d4930 0x7fc3a01f4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 --2- 172.21.15.72:0/1940120971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3a00d2450 0x7fc3a0153460 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 >> 172.21.15.72:0/1940120971 conn(0x7fc3a009d310 msgr2=0x7fc3a00d3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 shutdown_connections 2024-03-24T10:36:04.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:04.402+0000 7fc3a828f640 1 -- 172.21.15.72:0/1940120971 wait complete. 2024-03-24T10:36:04.413 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-24T10:36:04.414 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-24T10:36:04.426 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.425+0000 7f212942b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-24T10:36:04.476 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.476+0000 7f8cfd271040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-24T10:36:04.519 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.519+0000 7f212942b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-24T10:36:04.632 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.631+0000 7f8cfd271040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-24T10:36:04.675 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.674+0000 7f212942b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-24T10:36:04.675 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.673+0000 7f8cfd271040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-24T10:36:04.717 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.717+0000 7f212942b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-24T10:36:04.794 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T10:36:04.793+0000 7f8568c19640 -1 Falling back to public interface 2024-03-24T10:36:04.801 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T10:36:04.800+0000 7f590ab38640 -1 Falling back to public interface 2024-03-24T10:36:04.807 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T10:36:04.806+0000 7f3627815640 -1 Falling back to public interface 2024-03-24T10:36:04.811 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T10:36:04.810+0000 7f1f4260e640 -1 Falling back to public interface 2024-03-24T10:36:04.811 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T10:36:04.810+0000 7fb0ed411640 -1 Falling back to public interface 2024-03-24T10:36:04.811 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T10:36:04.811+0000 7f2827dbd640 -1 Falling back to public interface 2024-03-24T10:36:04.812 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T10:36:04.812+0000 7f2826d6c640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2024-03-24T10:36:04.816 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T10:36:04.816+0000 7f70e0011640 -1 Falling back to public interface 2024-03-24T10:36:04.820 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T10:36:04.820+0000 7fcdef2c8640 -1 Falling back to public interface 2024-03-24T10:36:04.833 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:04.833+0000 7f8cfd271040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-24T10:36:04.879 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:04.879+0000 7f212942b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-24T10:36:05.220 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:05.311 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.310+0000 7f1ce5047640 1 Processor -- start 2024-03-24T10:36:05.311 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.310+0000 7f1ce5047640 1 -- start start 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1ce5047640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ce00ccaf0 0x7f1ce006e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1ce5047640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1ce00674d0 0x7f1ce006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1ce5047640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00ccf80 con 0x7f1ce015bf20 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1ce5047640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00cd540 con 0x7f1ce00ccaf0 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1ce5047640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00cd260 con 0x7f1ce00674d0 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1cde59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ce00ccaf0 0x7f1ce006e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1cde59c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ce00ccaf0 0x7f1ce006e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50750/0 (socket says 172.21.15.72:50750) 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1cde59c640 1 -- 172.21.15.72:0/476608394 learned_addr learned my addr 172.21.15.72:0/476608394 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.311+0000 7f1cdf59e640 1 --2- 172.21.15.72:0/476608394 >> v2:172.21.15.79:3300/0 conn(0x7f1ce00674d0 0x7f1ce006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.312+0000 7f1cde59c640 1 -- 172.21.15.72:0/476608394 >> v2:172.21.15.79:3300/0 conn(0x7f1ce00674d0 msgr2=0x7f1ce006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:05.313 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.312+0000 7f1cde59c640 1 --2- 172.21.15.72:0/476608394 >> v2:172.21.15.79:3300/0 conn(0x7f1ce00674d0 0x7f1ce006ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.314 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.312+0000 7f1cde59c640 1 -- 172.21.15.72:0/476608394 >> v1:172.21.15.79:6789/0 conn(0x7f1ce015bf20 legacy=0x7f1ce0066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:05.314 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.312+0000 7f1cde59c640 1 -- 172.21.15.72:0/476608394 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce006df10 con 0x7f1ce00ccaf0 2024-03-24T10:36:05.314 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.312+0000 7f1cde59c640 1 --2- 172.21.15.72:0/476608394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00ccaf0 0x7f1ce006e710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00cb210 tx=0x7f1cd002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbfb2f0d1fbbee4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:05.314 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.312+0000 7f1cddd9b640 1 -- 172.21.15.72:0/476608394 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0031870 con 0x7f1ce00ccaf0 2024-03-24T10:36:05.314 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1cddd9b640 1 -- 172.21.15.72:0/476608394 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00319d0 con 0x7f1ce00ccaf0 2024-03-24T10:36:05.314 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1cddd9b640 1 -- 172.21.15.72:0/476608394 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0031d60 con 0x7f1ce00ccaf0 2024-03-24T10:36:05.315 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 -- 172.21.15.72:0/476608394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00ccaf0 msgr2=0x7f1ce006e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:05.315 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 --2- 172.21.15.72:0/476608394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00ccaf0 0x7f1ce006e710 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00cb210 tx=0x7f1cd002b910 comp rx=0 tx=0).stop 2024-03-24T10:36:05.315 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 -- 172.21.15.72:0/476608394 shutdown_connections 2024-03-24T10:36:05.315 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 --2- 172.21.15.72:0/476608394 >> v2:172.21.15.79:3300/0 conn(0x7f1ce00674d0 0x7f1ce006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.316 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 --2- 172.21.15.72:0/476608394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00ccaf0 0x7f1ce006e710 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.316 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 -- 172.21.15.72:0/476608394 >> 172.21.15.72:0/476608394 conn(0x7f1ce00cd6b0 msgr2=0x7f1ce00cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:05.316 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 -- 172.21.15.72:0/476608394 shutdown_connections 2024-03-24T10:36:05.316 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.313+0000 7f1ce5047640 1 -- 172.21.15.72:0/476608394 wait complete. 2024-03-24T10:36:05.316 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 Processor -- start 2024-03-24T10:36:05.316 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 -- start start 2024-03-24T10:36:05.318 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 0x7f1ce01f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ce015bf20 0x7f1ce01f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ce015c300 0x7f1ce006b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00c93b0 con 0x7f1ce00674d0 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce01f57b0 con 0x7f1ce015c300 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1ce5047640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce01f5a90 con 0x7f1ce015bf20 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1cded9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 0x7f1ce01f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1cded9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 0x7f1ce01f4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50762/0 (socket says 172.21.15.72:50762) 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.315+0000 7f1cded9d640 1 -- 172.21.15.72:0/614949464 learned_addr learned my addr 172.21.15.72:0/614949464 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cdf59e640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ce015c300 0x7f1ce006b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cde59c640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ce015bf20 0x7f1ce01f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cded9d640 1 -- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ce015bf20 msgr2=0x7f1ce01f11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cded9d640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ce015bf20 0x7f1ce01f11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.319 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cded9d640 1 -- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ce015c300 msgr2=0x7f1ce006b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cded9d640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ce015c300 0x7f1ce006b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cded9d640 1 -- 172.21.15.72:0/614949464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd00094d0 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cdf59e640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ce015c300 0x7f1ce006b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cded9d640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 0x7f1ce01f4f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c3c0 tx=0x7f1cd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40052d0 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd4005450 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce01f5d70 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4007260 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce01f54a0 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1cd40073c0 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.316+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1cd4011590 con 0x7f1ce00674d0 2024-03-24T10:36:05.320 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.317+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce00cb350 con 0x7f1ce00674d0 2024-03-24T10:36:05.321 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.319+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1cd4020060 con 0x7f1ce00674d0 2024-03-24T10:36:05.381 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.380+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ce004f470 con 0x7f1ce00674d0 2024-03-24T10:36:05.381 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.381+0000 7f1cc77fe640 1 -- 172.21.15.72:0/614949464 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1cd4003910 con 0x7f1ce00674d0 2024-03-24T10:36:05.382 INFO:teuthology.misc.health.smithi072.stdout: 2024-03-24T10:36:05.382 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:04.164041+0000","last_up_change":"0.000000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 msgr2=0x7f1ce01f4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 0x7f1ce01f4f60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400c3c0 tx=0x7f1cd400c880 comp rx=0 tx=0).stop 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 shutdown_connections 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ce015c300 0x7f1ce006b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1ce015bf20 0x7f1ce01f11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 --2- 172.21.15.72:0/614949464 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ce00674d0 0x7f1ce01f4f60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 >> 172.21.15.72:0/614949464 conn(0x7f1ce00cd6b0 msgr2=0x7f1ce006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 shutdown_connections 2024-03-24T10:36:05.383 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:05.382+0000 7f1ce5047640 1 -- 172.21.15.72:0/614949464 wait complete. 2024-03-24T10:36:05.391 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-24T10:36:05.679 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:05.679+0000 7f8cfd271040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-24T10:36:05.687 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:05.688+0000 7f212942b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-24T10:36:05.954 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:05.953+0000 7f8cfd271040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-24T10:36:05.962 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:05.963+0000 7f212942b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-24T10:36:06.004 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:06.004+0000 7f8cfd271040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-24T10:36:06.013 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:06.013+0000 7f212942b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-24T10:36:06.117 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:06.117+0000 7f8cfd271040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-24T10:36:06.125 INFO:tasks.ceph.mgr.x.smithi079.stderr:2024-03-24T10:36:06.126+0000 7f212942b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-24T10:36:07.141 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:07.141+0000 7f8c9e6e2640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-24T10:36:07.141 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T10:36:07.141+0000 7f8c9e6e2640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-24T10:36:08.265 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T10:36:08.265+0000 7f8568c19640 -1 osd.1 0 log_to_monitors true 2024-03-24T10:36:08.271 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T10:36:08.271+0000 7f590ab38640 -1 osd.4 0 log_to_monitors true 2024-03-24T10:36:08.312 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T10:36:08.311+0000 7f1f4260e640 -1 osd.7 0 log_to_monitors true 2024-03-24T10:36:08.314 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T10:36:08.314+0000 7fb0ed411640 -1 osd.3 0 log_to_monitors true 2024-03-24T10:36:08.320 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T10:36:08.320+0000 7f2827dbd640 -1 osd.0 0 log_to_monitors true 2024-03-24T10:36:08.333 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T10:36:08.332+0000 7f70e0011640 -1 osd.2 0 log_to_monitors true 2024-03-24T10:36:08.333 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T10:36:08.330+0000 7fcdef2c8640 -1 osd.6 0 log_to_monitors true 2024-03-24T10:36:08.334 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T10:36:08.334+0000 7f3627815640 -1 osd.5 0 log_to_monitors true 2024-03-24T10:36:12.070 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T10:36:12.069+0000 7f8564e00640 -1 osd.1 0 waiting for initial osdmap 2024-03-24T10:36:12.086 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T10:36:12.086+0000 7f855c40c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.189 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T10:36:12.188+0000 7f2823d53640 -1 osd.0 0 waiting for initial osdmap 2024-03-24T10:36:12.202 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:12.205 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T10:36:12.205+0000 7f281bb73640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.264 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T10:36:12.264+0000 7fcdeb25e640 -1 osd.6 0 waiting for initial osdmap 2024-03-24T10:36:12.275 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T10:36:12.274+0000 7fcde307e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.290 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T10:36:12.289+0000 7f36230ed640 -1 osd.5 0 waiting for initial osdmap 2024-03-24T10:36:12.302 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T10:36:12.302+0000 7f361af0d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.306 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T10:36:12.306+0000 7f1f3dec6640 -1 osd.7 0 waiting for initial osdmap 2024-03-24T10:36:12.307 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T10:36:12.306+0000 7f5906ace640 -1 osd.4 0 waiting for initial osdmap 2024-03-24T10:36:12.321 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T10:36:12.321+0000 7f58fe8ee640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.322 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T10:36:12.321+0000 7f1f35ce6640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.325 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.324+0000 7fefeaea4640 1 Processor -- start 2024-03-24T10:36:12.325 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.324+0000 7fefeaea4640 1 -- start start 2024-03-24T10:36:12.325 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.325+0000 7fefeaea4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefe415f680 0x7fefe40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:12.326 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.325+0000 7fefeaea4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40d2910 0x7fefe40ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:12.326 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.325+0000 7fefeaea4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefe40b0e50 con 0x7fefe40aeae0 2024-03-24T10:36:12.326 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.325+0000 7fefeaea4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fefe40cded0 con 0x7fefe415f680 2024-03-24T10:36:12.326 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.325+0000 7fefeaea4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fefe40b0b70 con 0x7fefe40d2910 2024-03-24T10:36:12.326 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40d2910 0x7fefe40ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe9441640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fefe40aeae0 0x7fefe40aef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37958/0 (socket says 172.21.15.72:37958) 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe8c40640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fefe415f680 0x7fefe40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe9441640 1 -- 172.21.15.72:0/1840564679 learned_addr learned my addr 172.21.15.72:0/1840564679 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe3fff640 1 -- 172.21.15.72:0/1840564679 >> v2:172.21.15.72:3300/0 conn(0x7fefe415f680 msgr2=0x7fefe40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe3fff640 1 --2- 172.21.15.72:0/1840564679 >> v2:172.21.15.72:3300/0 conn(0x7fefe415f680 0x7fefe40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe3fff640 1 -- 172.21.15.72:0/1840564679 >> v1:172.21.15.72:6789/0 conn(0x7fefe40aeae0 legacy=0x7fefe40aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe37fe640 1 -- 172.21.15.72:0/1840564679 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352547033 0 0) 0x7fefe40b0e50 con 0x7fefe40aeae0 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.326+0000 7fefe3fff640 1 -- 172.21.15.72:0/1840564679 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe40ce330 con 0x7fefe40d2910 2024-03-24T10:36:12.327 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.327+0000 7fefe3fff640 1 --2- 172.21.15.72:0/1840564679 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40d2910 0x7fefe40ceb50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22c90e127051ee2e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:12.328 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefe37fe640 1 -- 172.21.15.72:0/1840564679 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd402cbd0 con 0x7fefe40d2910 2024-03-24T10:36:12.328 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefe37fe640 1 -- 172.21.15.72:0/1840564679 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd402cd30 con 0x7fefe40d2910 2024-03-24T10:36:12.328 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefe37fe640 1 -- 172.21.15.72:0/1840564679 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd402cea0 con 0x7fefe40d2910 2024-03-24T10:36:12.329 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefeaea4640 1 -- 172.21.15.72:0/1840564679 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40d2910 msgr2=0x7fefe40ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:12.329 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1840564679 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40d2910 0x7fefe40ceb50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009d90 tx=0x7fefd402be20 comp rx=0 tx=0).stop 2024-03-24T10:36:12.329 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefeaea4640 1 -- 172.21.15.72:0/1840564679 shutdown_connections 2024-03-24T10:36:12.329 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1840564679 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40d2910 0x7fefe40ceb50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.329 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1840564679 >> v2:172.21.15.72:3300/0 conn(0x7fefe415f680 0x7fefe40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.330 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.328+0000 7fefeaea4640 1 -- 172.21.15.72:0/1840564679 >> 172.21.15.72:0/1840564679 conn(0x7fefe40d1df0 msgr2=0x7fefe40d2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:12.330 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.329+0000 7fefeaea4640 1 -- 172.21.15.72:0/1840564679 shutdown_connections 2024-03-24T10:36:12.330 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.329+0000 7fefeaea4640 1 -- 172.21.15.72:0/1840564679 wait complete. 2024-03-24T10:36:12.330 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.330+0000 7fefeaea4640 1 Processor -- start 2024-03-24T10:36:12.330 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.330+0000 7fefeaea4640 1 -- start start 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefeaea4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40aeae0 0x7fefe40b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefeaea4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 0x7fefe4157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefeaea4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40cb760 0x7fefe40702c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefeaea4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fefe4157ab0 con 0x7fefe415f680 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefeaea4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fefe40c8f50 con 0x7fefe40aeae0 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefeaea4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fefe40b7170 con 0x7fefe40cb760 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 0x7fefe4157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:12.333 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 0x7fefe4157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48826/0 (socket says 172.21.15.72:48826) 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 -- 172.21.15.72:0/1826444955 learned_addr learned my addr 172.21.15.72:0/1826444955 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe9441640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40cb760 0x7fefe40702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe8c40640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40aeae0 0x7fefe40b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 -- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40cb760 msgr2=0x7fefe40702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40cb760 0x7fefe40702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 -- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40aeae0 msgr2=0x7fefe40b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40aeae0 0x7fefe40b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe3fff640 1 -- 172.21.15.72:0/1826444955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd4009a70 con 0x7fefe415f680 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.331+0000 7fefe8c40640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40aeae0 0x7fefe40b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.332+0000 7fefe3fff640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 0x7fefe4157570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefd4037040 tx=0x7fefd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.332+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd402cea0 con 0x7fefe415f680 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.332+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe40b7410 con 0x7fefe415f680 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.332+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd4009450 con 0x7fefe415f680 2024-03-24T10:36:12.334 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.332+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd402cea0 con 0x7fefe415f680 2024-03-24T10:36:12.335 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.333+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe40b79d0 con 0x7fefe415f680 2024-03-24T10:36:12.335 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.334+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) ==== 89724+0+0 (secure 0 0 0) 0x7fefd4040450 con 0x7fefe415f680 2024-03-24T10:36:12.335 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.334+0000 7fefe17fa640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fefc406b7e0 0x7fefc406dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:12.336 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.334+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe4067d60 con 0x7fefe415f680 2024-03-24T10:36:12.336 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.335+0000 7fefe8c40640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fefc406b7e0 0x7fefc406dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:12.336 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.335+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fefd40aba30 con 0x7fefe415f680 2024-03-24T10:36:12.336 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.335+0000 7fefe8c40640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fefc406b7e0 0x7fefc406dca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009b90 tx=0x7fefdc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:12.347 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.344+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fefd40772d0 con 0x7fefe415f680 2024-03-24T10:36:12.420 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T10:36:12.420+0000 7f70dc1d4640 -1 osd.2 0 waiting for initial osdmap 2024-03-24T10:36:12.438 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T10:36:12.438+0000 7f70d37e0640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.456 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T10:36:12.456+0000 7fb0e8dd3640 -1 osd.3 0 waiting for initial osdmap 2024-03-24T10:36:12.472 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T10:36:12.472+0000 7fb0e0bf3640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-24T10:36:12.536 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.535+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefe40c90c0 con 0x7fefe415f680 2024-03-24T10:36:12.536 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.535+0000 7fefe17fa640 1 -- 172.21.15.72:0/1826444955 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fefd4039090 con 0x7fefe415f680 2024-03-24T10:36:12.536 INFO:teuthology.misc.health.smithi072.stdout: 2024-03-24T10:36:12.536 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":12,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:10.142735+0000","last_up_change":"0.000000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fefc406b7e0 msgr2=0x7fefc406dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fefc406b7e0 0x7fefc406dca0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009b90 tx=0x7fefdc008040 comp rx=0 tx=0).stop 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 msgr2=0x7fefe4157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 0x7fefe4157570 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fefd4037040 tx=0x7fefd4004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 shutdown_connections 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fefc406b7e0 0x7fefc406dca0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefe40cb760 0x7fefe40702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefe415f680 0x7fefe4157570 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.538 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 --2- 172.21.15.72:0/1826444955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefe40aeae0 0x7fefe40b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:12.539 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 >> 172.21.15.72:0/1826444955 conn(0x7fefe40d1df0 msgr2=0x7fefe40cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:12.539 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 shutdown_connections 2024-03-24T10:36:12.539 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:12.537+0000 7fefeaea4640 1 -- 172.21.15.72:0/1826444955 wait complete. 2024-03-24T10:36:12.547 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-24T10:36:19.356 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:19.455 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.455+0000 7f071822e640 1 Processor -- start 2024-03-24T10:36:19.455 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.455+0000 7f071822e640 1 -- start start 2024-03-24T10:36:19.457 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f071822e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0710156450 0x7f07100ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.457 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f071822e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 0x7f07100b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.457 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f071822e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07100cf250 con 0x7f07100cc6d0 2024-03-24T10:36:19.457 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f071822e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f07100cf530 con 0x7f0710156450 2024-03-24T10:36:19.457 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f071822e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f07100cf810 con 0x7f0710160170 2024-03-24T10:36:19.457 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f07167cb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 0x7f07100b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f0715fca640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f0710156450 0x7f07100ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f07167cb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 0x7f07100b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:35910/0 (socket says 172.21.15.72:35910) 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.456+0000 7f07167cb640 1 -- 172.21.15.72:0/3612132226 learned_addr learned my addr 172.21.15.72:0/3612132226 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f0715fca640 1 -- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 msgr2=0x7f07100b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f0715fca640 1 --2- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 0x7f07100b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f0715fca640 1 -- 172.21.15.72:0/3612132226 >> v1:172.21.15.79:6789/0 conn(0x7f07100cc6d0 legacy=0x7f071015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f0715fca640 1 -- 172.21.15.72:0/3612132226 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07100b2b30 con 0x7f0710156450 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f0714fc8640 1 -- 172.21.15.72:0/3612132226 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972346746 0 0) 0x7f07100cf250 con 0x7f07100cc6d0 2024-03-24T10:36:19.458 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f07167cb640 1 --2- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 0x7f07100b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:19.459 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.457+0000 7f0715fca640 1 --2- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710156450 0x7f07100ceb70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f070c0097a0 tx=0x7f070c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3fd551a09db0d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:19.459 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f0714fc8640 1 -- 172.21.15.72:0/3612132226 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c031830 con 0x7f0710156450 2024-03-24T10:36:19.459 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f0714fc8640 1 -- 172.21.15.72:0/3612132226 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c031990 con 0x7f0710156450 2024-03-24T10:36:19.459 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f0714fc8640 1 -- 172.21.15.72:0/3612132226 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c031d20 con 0x7f0710156450 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 -- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710156450 msgr2=0x7f07100ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 --2- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710156450 0x7f07100ceb70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f070c0097a0 tx=0x7f070c02b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 -- 172.21.15.72:0/3612132226 shutdown_connections 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 --2- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0710160170 0x7f07100b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 --2- 172.21.15.72:0/3612132226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710156450 0x7f07100ceb70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 -- 172.21.15.72:0/3612132226 >> 172.21.15.72:0/3612132226 conn(0x7f071006b710 msgr2=0x7f07100b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 -- 172.21.15.72:0/3612132226 shutdown_connections 2024-03-24T10:36:19.460 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.458+0000 7f071822e640 1 -- 172.21.15.72:0/3612132226 wait complete. 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.459+0000 7f071822e640 1 Processor -- start 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.459+0000 7f071822e640 1 -- start start 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f071822e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07100cc6d0 0x7f0710152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f071822e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 0x7f0710154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f071822e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710160170 0x7f0710158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f071822e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0710152e40 con 0x7f0710156450 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f071822e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0710156be0 con 0x7f0710160170 2024-03-24T10:36:19.462 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f071822e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f0710156ec0 con 0x7f07100cc6d0 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f07157c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 0x7f0710154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f07157c9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 0x7f0710154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48858/0 (socket says 172.21.15.72:48858) 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f07157c9640 1 -- 172.21.15.72:0/270870784 learned_addr learned my addr 172.21.15.72:0/270870784 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f07167cb640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710160170 0x7f0710158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.460+0000 7f0715fca640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07100cc6d0 0x7f0710152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07157c9640 1 -- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07100cc6d0 msgr2=0x7f0710152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07157c9640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07100cc6d0 0x7f0710152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07157c9640 1 -- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710160170 msgr2=0x7f0710158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07157c9640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710160170 0x7f0710158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07157c9640 1 -- 172.21.15.72:0/270870784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0708009b30 con 0x7f0710156450 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07157c9640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 0x7f0710154cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f070000c410 tx=0x7f070000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07000035f0 con 0x7f0710156450 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0700003770 con 0x7f0710156450 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c009400 con 0x7f0710156450 2024-03-24T10:36:19.463 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700003b20 con 0x7f0710156450 2024-03-24T10:36:19.464 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.461+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0710157480 con 0x7f0710156450 2024-03-24T10:36:19.464 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.462+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071004f470 con 0x7f0710156450 2024-03-24T10:36:19.464 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.463+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0700003c80 con 0x7f0710156450 2024-03-24T10:36:19.464 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.463+0000 7f07067fc640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f06f406b840 0x7f06f406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.465 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.463+0000 7f0715fca640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f06f406b840 0x7f06f406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.465 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.463+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0700089340 con 0x7f0710156450 2024-03-24T10:36:19.465 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.463+0000 7f0715fca640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f06f406b840 0x7f06f406dd00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f070c036000 tx=0x7f070c03e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:19.468 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.468+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f07000541f0 con 0x7f0710156450 2024-03-24T10:36:19.644 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.643+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07100b2250 con 0x7f0710156450 2024-03-24T10:36:19.644 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.644+0000 7f07067fc640 1 -- 172.21.15.72:0/270870784 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f07000578b0 con 0x7f0710156450 2024-03-24T10:36:19.645 INFO:teuthology.misc.health.smithi072.stdout: 2024-03-24T10:36:19.645 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":17,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:17.084730+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f06f406b840 msgr2=0x7f06f406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f06f406b840 0x7f06f406dd00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f070c036000 tx=0x7f070c03e040 comp rx=0 tx=0).stop 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 msgr2=0x7f0710154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 0x7f0710154cf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f070000c410 tx=0x7f070000c8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 shutdown_connections 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f06f406b840 0x7f06f406dd00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0710160170 0x7f0710158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.647 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0710156450 0x7f0710154cf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.648 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 --2- 172.21.15.72:0/270870784 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07100cc6d0 0x7f0710152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.648 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 >> 172.21.15.72:0/270870784 conn(0x7f071006b710 msgr2=0x7f071015d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:19.648 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 shutdown_connections 2024-03-24T10:36:19.648 INFO:teuthology.misc.health.smithi072.stderr:2024-03-24T10:36:19.646+0000 7f071822e640 1 -- 172.21.15.72:0/270870784 wait complete. 2024-03-24T10:36:19.657 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-24T10:36:19.657 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-24T10:36:19.658 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-24T10:36:19.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-24T10:36:19.660 INFO:tasks.ceph.mds.a:Started 2024-03-24T10:36:19.660 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-24T10:36:19.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-24T10:36:19.662 INFO:tasks.ceph.mds.c:Started 2024-03-24T10:36:19.663 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-24T10:36:19.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-24T10:36:19.666 INFO:tasks.ceph.mds.b:Started 2024-03-24T10:36:19.666 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-24T10:36:19.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-24T10:36:19.669 INFO:tasks.ceph.mds.d:Started 2024-03-24T10:36:19.669 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-24T10:36:19.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:19.735 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-03-24T10:36:19.736 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-03-24T10:36:19.736 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-03-24T10:36:19.736+0000 7ffa45a27640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-03-24T10:36:19.752 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2024-03-24T10:36:19.752 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2024-03-24T10:36:19.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.772+0000 7f6f87ba5640 1 Processor -- start 2024-03-24T10:36:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.772+0000 7f6f87ba5640 1 -- start start 2024-03-24T10:36:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f87ba5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 0x7f6f8015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f87ba5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f800d2450 0x7f6f800b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f87ba5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f800d4e50 con 0x7f6f8015e170 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f87ba5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6f800cf790 con 0x7f6f800d2450 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f87ba5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6f800cfa70 con 0x7f6f800d4930 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f86142640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f800d2450 0x7f6f800b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f85140640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 0x7f6f8015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f86142640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6f800d2450 0x7f6f800b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:60500/0 (socket says 172.21.15.72:60500) 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f85140640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 0x7f6f8015e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:35954/0 (socket says 172.21.15.72:35954) 2024-03-24T10:36:19.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.773+0000 7f6f86142640 1 -- 172.21.15.72:0/4192392934 learned_addr learned my addr 172.21.15.72:0/4192392934 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f86142640 1 -- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 msgr2=0x7f6f8015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f86142640 1 --2- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 0x7f6f8015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f86142640 1 -- 172.21.15.72:0/4192392934 >> v1:172.21.15.79:6789/0 conn(0x7f6f8015e170 legacy=0x7f6f800d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f86142640 1 -- 172.21.15.72:0/4192392934 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f800cfd50 con 0x7f6f800d2450 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f85140640 1 --2- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 0x7f6f8015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f86142640 1 --2- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f800b3c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009e50 tx=0x7f6f7802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56d9bb6085febe6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f8493f640 1 -- 172.21.15.72:0/4192392934 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f7802ca70 con 0x7f6f800d2450 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f8493f640 1 -- 172.21.15.72:0/4192392934 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7802cbd0 con 0x7f6f800d2450 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.774+0000 7f6f8493f640 1 -- 172.21.15.72:0/4192392934 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f780343f0 con 0x7f6f800d2450 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 -- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 msgr2=0x7f6f800b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f800b3c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009e50 tx=0x7f6f7802bed0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 -- 172.21.15.72:0/4192392934 shutdown_connections 2024-03-24T10:36:19.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f800b3c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/4192392934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f800d4930 0x7f6f8015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 -- 172.21.15.72:0/4192392934 >> 172.21.15.72:0/4192392934 conn(0x7f6f8009d310 msgr2=0x7f6f800d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:19.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 -- 172.21.15.72:0/4192392934 shutdown_connections 2024-03-24T10:36:19.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.775+0000 7f6f87ba5640 1 -- 172.21.15.72:0/4192392934 wait complete. 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.776+0000 7f6f87ba5640 1 Processor -- start 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.776+0000 7f6f87ba5640 1 -- start start 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f87ba5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f8015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f87ba5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 0x7f6f8015a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f87ba5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f8015e170 0x7f6f801f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f87ba5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6f800b93d0 con 0x7f6f800d4930 2024-03-24T10:36:19.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f87ba5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f801588b0 con 0x7f6f800d2450 2024-03-24T10:36:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f85140640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 0x7f6f8015a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f87ba5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8015af00 con 0x7f6f8015e170 2024-03-24T10:36:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f85140640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 0x7f6f8015a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48880/0 (socket says 172.21.15.72:48880) 2024-03-24T10:36:19.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.777+0000 7f6f85140640 1 -- 172.21.15.72:0/3523654277 learned_addr learned my addr 172.21.15.72:0/3523654277 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85941640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f8015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f86142640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f8015e170 0x7f6f801f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85140640 1 -- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f8015e170 msgr2=0x7f6f801f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85140640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f8015e170 0x7f6f801f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85140640 1 -- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 msgr2=0x7f6f8015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85140640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f8015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85140640 1 -- 172.21.15.72:0/3523654277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f70009400 con 0x7f6f800d4930 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85941640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f8015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f85140640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 0x7f6f8015a9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000ec10 tx=0x7f6f7000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70009760 con 0x7f6f800d4930 2024-03-24T10:36:19.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7000cc30 con 0x7f6f800d4930 2024-03-24T10:36:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70013470 con 0x7f6f800d4930 2024-03-24T10:36:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f78009b30 con 0x7f6f800d4930 2024-03-24T10:36:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.778+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f800b95e0 con 0x7f6f800d4930 2024-03-24T10:36:19.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.779+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f800a1ef0 con 0x7f6f800d4930 2024-03-24T10:36:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.780+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6f700135d0 con 0x7f6f800d4930 2024-03-24T10:36:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.780+0000 7f6f767fc640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6f6406b810 0x7f6f6406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.780+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6f7008a140 con 0x7f6f800d4930 2024-03-24T10:36:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.780+0000 7f6f85941640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6f6406b810 0x7f6f6406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:19.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.780+0000 7f6f85941640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6f6406b810 0x7f6f6406dcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007fd0 tx=0x7f6f7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:19.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.784+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6f70054eb0 con 0x7f6f800d4930 2024-03-24T10:36:19.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.958+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f801589f0 con 0x7f6f800d4930 2024-03-24T10:36:19.959 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.958+0000 7f6f767fc640 1 -- 172.21.15.72:0/3523654277 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f6f70058570 con 0x7f6f800d4930 2024-03-24T10:36:19.959 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:19.959 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:17.084730+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6f6406b810 msgr2=0x7f6f6406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6f6406b810 0x7f6f6406dcd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c007fd0 tx=0x7f6f7c009040 comp rx=0 tx=0).stop 2024-03-24T10:36:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 msgr2=0x7f6f8015a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 0x7f6f8015a9c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000ec10 tx=0x7f6f7000c520 comp rx=0 tx=0).stop 2024-03-24T10:36:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 shutdown_connections 2024-03-24T10:36:19.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6f6406b810 0x7f6f6406dcd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6f8015e170 0x7f6f801f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f800d4930 0x7f6f8015a9c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 --2- 172.21.15.72:0/3523654277 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f800d2450 0x7f6f8015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.960+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 >> 172.21.15.72:0/3523654277 conn(0x7f6f8009d310 msgr2=0x7f6f800d3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.961+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 shutdown_connections 2024-03-24T10:36:19.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:19.961+0000 7f6f87ba5640 1 -- 172.21.15.72:0/3523654277 wait complete. 2024-03-24T10:36:19.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-24T10:36:19.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:36:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.075+0000 7fe213ed0640 1 Processor -- start 2024-03-24T10:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.075+0000 7fe213ed0640 1 -- start start 2024-03-24T10:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe213ed0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20c06ecb0 0x7fe20c0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe213ed0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20c0b30f0 con 0x7fe20c15f440 2024-03-24T10:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe213ed0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20c0b33d0 con 0x7fe20c06e8d0 2024-03-24T10:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe213ed0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe20c0b48a0 con 0x7fe20c06ecb0 2024-03-24T10:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21146b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20c06ecb0 0x7fe20c0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21246d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe20c15f440 0x7fe20c144150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37978/0 (socket says 172.21.15.72:37978) 2024-03-24T10:36:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21146b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe20c06ecb0 0x7fe20c0b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48886/0 (socket says 172.21.15.72:48886) 2024-03-24T10:36:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21246d640 1 -- 172.21.15.72:0/2331261425 learned_addr learned my addr 172.21.15.72:0/2331261425 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21146b640 1 -- 172.21.15.72:0/2331261425 >> v1:172.21.15.79:6789/0 conn(0x7fe20c06e8d0 legacy=0x7fe20c0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21146b640 1 -- 172.21.15.72:0/2331261425 >> v1:172.21.15.72:6789/0 conn(0x7fe20c15f440 legacy=0x7fe20c144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe210c6a640 1 -- 172.21.15.72:0/2331261425 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371839307 0 0) 0x7fe20c0b30f0 con 0x7fe20c15f440 2024-03-24T10:36:20.078 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.076+0000 7fe21146b640 1 -- 172.21.15.72:0/2331261425 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20c0b36b0 con 0x7fe20c06ecb0 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.077+0000 7fe21146b640 1 --2- 172.21.15.72:0/2331261425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06ecb0 0x7fe20c0b2b10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0097a0 tx=0x7fe1fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226bc7bd9a5e5be2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.077+0000 7fe210c6a640 1 -- 172.21.15.72:0/2331261425 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc030610 con 0x7fe20c06ecb0 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.077+0000 7fe210c6a640 1 -- 172.21.15.72:0/2331261425 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc030770 con 0x7fe20c06ecb0 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.077+0000 7fe210c6a640 1 -- 172.21.15.72:0/2331261425 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc030b00 con 0x7fe20c06ecb0 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 -- 172.21.15.72:0/2331261425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06ecb0 msgr2=0x7fe20c0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 --2- 172.21.15.72:0/2331261425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06ecb0 0x7fe20c0b2b10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0097a0 tx=0x7fe1fc02b960 comp rx=0 tx=0).stop 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 -- 172.21.15.72:0/2331261425 shutdown_connections 2024-03-24T10:36:20.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 --2- 172.21.15.72:0/2331261425 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06ecb0 0x7fe20c0b2b10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 -- 172.21.15.72:0/2331261425 >> 172.21.15.72:0/2331261425 conn(0x7fe20c0b1810 msgr2=0x7fe20c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 -- 172.21.15.72:0/2331261425 shutdown_connections 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.078+0000 7fe213ed0640 1 -- 172.21.15.72:0/2331261425 wait complete. 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.079+0000 7fe213ed0640 1 Processor -- start 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.079+0000 7fe213ed0640 1 -- start start 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 0x7fe20c15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe20c06ecb0 0x7fe20c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20c15f440 0x7fe20c072330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c15ad70 con 0x7fe20c06e8d0 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe20c0aa800 con 0x7fe20c15f440 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe20c0a9c80 con 0x7fe20c06ecb0 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 0x7fe20c15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 0x7fe20c15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48898/0 (socket says 172.21.15.72:48898) 2024-03-24T10:36:20.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 -- 172.21.15.72:0/291104304 learned_addr learned my addr 172.21.15.72:0/291104304 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe21246d640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20c15f440 0x7fe20c072330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 -- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe20c06ecb0 msgr2=0x7fe20c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe20c06ecb0 0x7fe20c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 -- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20c15f440 msgr2=0x7fe20c072330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20c15f440 0x7fe20c072330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 -- 172.21.15.72:0/291104304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc009400 con 0x7fe20c06e8d0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe21246d640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20c15f440 0x7fe20c072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe211c6c640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 0x7fe20c15a830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe20800c450 tx=0x7fe20800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2080052d0 con 0x7fe20c06e8d0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe208005430 con 0x7fe20c06e8d0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208012870 con 0x7fe20c06e8d0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe20c0a9f60 con 0x7fe20c06e8d0 2024-03-24T10:36:20.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.080+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe20c0aa520 con 0x7fe20c06e8d0 2024-03-24T10:36:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.081+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe20c142fa0 con 0x7fe20c06e8d0 2024-03-24T10:36:20.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.081+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe2080129d0 con 0x7fe20c06e8d0 2024-03-24T10:36:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.082+0000 7fe2027fc640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1f006b810 0x7fe1f006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.082+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe2080899d0 con 0x7fe20c06e8d0 2024-03-24T10:36:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.082+0000 7fe21146b640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1f006b810 0x7fe1f006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.082+0000 7fe21146b640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1f006b810 0x7fe1f006dcd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc036000 tx=0x7fe1fc03b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:20.086 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.086+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe208054740 con 0x7fe20c06e8d0 2024-03-24T10:36:20.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.260+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe20c04f470 con 0x7fe20c06e8d0 2024-03-24T10:36:20.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.260+0000 7fe2027fc640 1 -- 172.21.15.72:0/291104304 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fe208057e00 con 0x7fe20c06e8d0 2024-03-24T10:36:20.261 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1f006b810 msgr2=0x7fe1f006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1f006b810 0x7fe1f006dcd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc036000 tx=0x7fe1fc03b040 comp rx=0 tx=0).stop 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 msgr2=0x7fe20c15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 0x7fe20c15a830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe20800c450 tx=0x7fe20800c910 comp rx=0 tx=0).stop 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 shutdown_connections 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1f006b810 0x7fe1f006dcd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe20c15f440 0x7fe20c072330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe20c06ecb0 0x7fe20c0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 --2- 172.21.15.72:0/291104304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe20c06e8d0 0x7fe20c15a830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.263 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 >> 172.21.15.72:0/291104304 conn(0x7fe20c0b1810 msgr2=0x7fe20c0b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 shutdown_connections 2024-03-24T10:36:20.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.262+0000 7fe213ed0640 1 -- 172.21.15.72:0/291104304 wait complete. 2024-03-24T10:36:20.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.372+0000 7fe8d0b8a640 1 Processor -- start 2024-03-24T10:36:20.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.372+0000 7fe8d0b8a640 1 -- start start 2024-03-24T10:36:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8d0b8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8cc071d80 0x7fe8cc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8d0b8a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8cc0ae570 0x7fe8cc06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8d0b8a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8cc0ad840 con 0x7fe8cc155040 2024-03-24T10:36:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8d0b8a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe8cc06e4f0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8d0b8a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe8cc0ada90 con 0x7fe8cc071d80 2024-03-24T10:36:20.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8cad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8cc0ae570 0x7fe8cc06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8cad9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8cc0ae570 0x7fe8cc06dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48904/0 (socket says 172.21.15.72:48904) 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.373+0000 7fe8cad9d640 1 -- 172.21.15.72:0/937412217 learned_addr learned my addr 172.21.15.72:0/937412217 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8c9d9b640 1 --2- 172.21.15.72:0/937412217 >> v2:172.21.15.79:3300/0 conn(0x7fe8cc071d80 0x7fe8cc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8cad9d640 1 -- 172.21.15.72:0/937412217 >> v2:172.21.15.79:3300/0 conn(0x7fe8cc071d80 msgr2=0x7fe8cc06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8cad9d640 1 --2- 172.21.15.72:0/937412217 >> v2:172.21.15.79:3300/0 conn(0x7fe8cc071d80 0x7fe8cc06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8cad9d640 1 -- 172.21.15.72:0/937412217 >> v1:172.21.15.79:6789/0 conn(0x7fe8cc155040 legacy=0x7fe8cc071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8cad9d640 1 -- 172.21.15.72:0/937412217 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8cc0add70 con 0x7fe8cc0ae570 2024-03-24T10:36:20.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8cad9d640 1 --2- 172.21.15.72:0/937412217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc06dcc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc06f5f0 tx=0x7fe8c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5711132767be1fd3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.374+0000 7fe8c959a640 1 -- 172.21.15.72:0/937412217 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c40317e0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8c959a640 1 -- 172.21.15.72:0/937412217 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c4031940 con 0x7fe8cc0ae570 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8c959a640 1 -- 172.21.15.72:0/937412217 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4031cd0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/937412217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 msgr2=0x7fe8cc06dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/937412217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc06dcc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc06f5f0 tx=0x7fe8c402b880 comp rx=0 tx=0).stop 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/937412217 shutdown_connections 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/937412217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc06dcc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/937412217 >> v2:172.21.15.79:3300/0 conn(0x7fe8cc071d80 0x7fe8cc06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/937412217 >> 172.21.15.72:0/937412217 conn(0x7fe8cc06b310 msgr2=0x7fe8cc06b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/937412217 shutdown_connections 2024-03-24T10:36:20.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.375+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/937412217 wait complete. 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.376+0000 7fe8d0b8a640 1 Processor -- start 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.376+0000 7fe8d0b8a640 1 -- start start 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8d0b8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8cc071d80 0x7fe8cc147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8d0b8a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8d0b8a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8cc155040 0x7fe8cc157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8d0b8a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc147f40 con 0x7fe8cc0ae570 2024-03-24T10:36:20.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8d0b8a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8cc1f4200 con 0x7fe8cc071d80 2024-03-24T10:36:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8d0b8a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe8cc1f4770 con 0x7fe8cc155040 2024-03-24T10:36:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8c9d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8c9d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48910/0 (socket says 172.21.15.72:48910) 2024-03-24T10:36:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8c9d9b640 1 -- 172.21.15.72:0/1599090971 learned_addr learned my addr 172.21.15.72:0/1599090971 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8ca59c640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8cc071d80 0x7fe8cc147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.377+0000 7fe8cad9d640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8cc155040 0x7fe8cc157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8c9d9b640 1 -- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8cc155040 msgr2=0x7fe8cc157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8c9d9b640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8cc155040 0x7fe8cc157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8c9d9b640 1 -- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8cc071d80 msgr2=0x7fe8cc147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8c9d9b640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8cc071d80 0x7fe8cc147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8c9d9b640 1 -- 172.21.15.72:0/1599090971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c40094d0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8cad9d640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8cc155040 0x7fe8cc157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:20.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8ca59c640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8cc071d80 0x7fe8cc147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8c9d9b640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc0b31c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d800 tx=0x7fe8c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0004030 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c0004190 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8cc0b6900 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000b6c0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.378+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8cc0b6620 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.379+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8cc06c0c0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.379+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe8c000b820 con 0x7fe8cc0ae570 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.380+0000 7fe8baffd640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8ac06b810 0x7fe8ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.380+0000 7fe8ca59c640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8ac06b810 0x7fe8ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:20.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.380+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe8c008a120 con 0x7fe8cc0ae570 2024-03-24T10:36:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.380+0000 7fe8ca59c640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8ac06b810 0x7fe8ac06dcd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009fc0 tx=0x7fe8bc009550 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:20.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.384+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe8c0054e90 con 0x7fe8cc0ae570 2024-03-24T10:36:20.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.594+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8cc1f48e0 con 0x7fe8cc0ae570 2024-03-24T10:36:20.595 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.594+0000 7fe8baffd640 1 -- 172.21.15.72:0/1599090971 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fe8c0058550 con 0x7fe8cc0ae570 2024-03-24T10:36:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:20.595 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-24T10:36:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 2 2024-03-24T10:36:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8ac06b810 msgr2=0x7fe8ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8ac06b810 0x7fe8ac06dcd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc009fc0 tx=0x7fe8bc009550 comp rx=0 tx=0).stop 2024-03-24T10:36:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 msgr2=0x7fe8cc0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc0b31c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d800 tx=0x7fe8c000dcc0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 shutdown_connections 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8ac06b810 0x7fe8ac06dcd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8cc155040 0x7fe8cc157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8cc0ae570 0x7fe8cc0b31c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 --2- 172.21.15.72:0/1599090971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8cc071d80 0x7fe8cc147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 >> 172.21.15.72:0/1599090971 conn(0x7fe8cc06b310 msgr2=0x7fe8cc162420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 shutdown_connections 2024-03-24T10:36:20.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:20.596+0000 7fe8d0b8a640 1 -- 172.21.15.72:0/1599090971 wait complete. 2024-03-24T10:36:22.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.719+0000 7f21919e2640 1 Processor -- start 2024-03-24T10:36:22.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.719+0000 7f21919e2640 1 -- start start 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f21919e2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f218c15e170 0x7f218c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f21919e2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d4930 0x7f218c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f21919e2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f218c0d4e50 con 0x7f218c0d2280 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f21919e2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f218c0cf790 con 0x7f218c15e170 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f21919e2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f218c0cfa70 con 0x7f218c0d4930 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f218affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f218c15e170 0x7f218c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f218affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f218c15e170 0x7f218c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44278/0 (socket says 172.21.15.72:44278) 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f218affd640 1 -- 172.21.15.72:0/1159845974 learned_addr learned my addr 172.21.15.72:0/1159845974 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f218affd640 1 -- 172.21.15.72:0/1159845974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d4930 msgr2=0x7f218c0d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.720+0000 7f218a7fc640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d4930 0x7f218c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:22.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f218affd640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d4930 0x7f218c0d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f218affd640 1 -- 172.21.15.72:0/1159845974 >> v1:172.21.15.79:6789/0 conn(0x7f218c0d2280 legacy=0x7f218c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f218affd640 1 -- 172.21.15.72:0/1159845974 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218c0cfd50 con 0x7f218c15e170 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f218a7fc640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d4930 0x7f218c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f218affd640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c15e170 0x7f218c15e550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2180009870 tx=0x7f218002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fda99e2b1f2664 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f2189ffb640 1 -- 172.21.15.72:0/1159845974 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180031640 con 0x7f218c15e170 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f2189ffb640 1 -- 172.21.15.72:0/1159845974 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21800317a0 con 0x7f218c15e170 2024-03-24T10:36:22.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.721+0000 7f2189ffb640 1 -- 172.21.15.72:0/1159845974 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2180031b30 con 0x7f218c15e170 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 -- 172.21.15.72:0/1159845974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c15e170 msgr2=0x7f218c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c15e170 0x7f218c15e550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2180009870 tx=0x7f218002b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 -- 172.21.15.72:0/1159845974 shutdown_connections 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d4930 0x7f218c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 --2- 172.21.15.72:0/1159845974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c15e170 0x7f218c15e550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 -- 172.21.15.72:0/1159845974 >> 172.21.15.72:0/1159845974 conn(0x7f218c09d310 msgr2=0x7f218c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 -- 172.21.15.72:0/1159845974 shutdown_connections 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.722+0000 7f21919e2640 1 -- 172.21.15.72:0/1159845974 wait complete. 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.723+0000 7f21919e2640 1 Processor -- start 2024-03-24T10:36:22.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.723+0000 7f21919e2640 1 -- start start 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f21919e2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d2280 0x7f218c0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f21919e2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 0x7f218c0d3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f21919e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c15e170 0x7f218c14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f21919e2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f218c0cb310 con 0x7f218c0d4930 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f21919e2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f218c0b7ac0 con 0x7f218c15e170 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f21919e2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f218c0b6f40 con 0x7f218c0d2280 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 0x7f218c0d3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 0x7f218c0d3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44290/0 (socket says 172.21.15.72:44290) 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 -- 172.21.15.72:0/793863479 learned_addr learned my addr 172.21.15.72:0/793863479 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218affd640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d2280 0x7f218c0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218b7fe640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c15e170 0x7f218c14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 -- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d2280 msgr2=0x7f218c0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d2280 0x7f218c0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 -- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c15e170 msgr2=0x7f218c14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:22.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c15e170 0x7f218c14ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.724+0000 7f218a7fc640 1 -- 172.21.15.72:0/793863479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21800094d0 con 0x7f218c0d4930 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.725+0000 7f218a7fc640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 0x7f218c0d3fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c7f0 tx=0x7f217c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.725+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c007a30 con 0x7f218c0d4930 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.725+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217c007b90 con 0x7f218c0d4930 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.725+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c00ce40 con 0x7f218c0d4930 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.725+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218c0b7220 con 0x7f218c0d4930 2024-03-24T10:36:22.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.725+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218c0b77e0 con 0x7f218c0d4930 2024-03-24T10:36:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.726+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f218c0b7d50 con 0x7f218c0d4930 2024-03-24T10:36:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.726+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f217c0113f0 con 0x7f218c0d4930 2024-03-24T10:36:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.727+0000 7f2173fff640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f217806b810 0x7f217806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.727+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f217c08a030 con 0x7f218c0d4930 2024-03-24T10:36:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.727+0000 7f218affd640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f217806b810 0x7f217806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:22.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.727+0000 7f218affd640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f217806b810 0x7f217806dcd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2180036000 tx=0x7f218003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:22.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.731+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f217c054da0 con 0x7f218c0d4930 2024-03-24T10:36:22.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.938+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f218c0d32c0 con 0x7f218c0d4930 2024-03-24T10:36:22.939 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.938+0000 7f2173fff640 1 -- 172.21.15.72:0/793863479 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3855 (secure 0 0 0) 0x7f217c058460 con 0x7f218c0d4930 2024-03-24T10:36:22.939 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:22.939 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4288,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-24T10:36:22.939 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2024-03-24T10:36:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f217806b810 msgr2=0x7f217806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f217806b810 0x7f217806dcd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2180036000 tx=0x7f218003c040 comp rx=0 tx=0).stop 2024-03-24T10:36:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 msgr2=0x7f218c0d3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 0x7f218c0d3fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f217c00c7f0 tx=0x7f217c00cbf0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 shutdown_connections 2024-03-24T10:36:22.941 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f217806b810 0x7f217806dcd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f218c15e170 0x7f218c14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f218c0d4930 0x7f218c0d3fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 --2- 172.21.15.72:0/793863479 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f218c0d2280 0x7f218c0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:22.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.940+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 >> 172.21.15.72:0/793863479 conn(0x7f218c09d310 msgr2=0x7f218c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:22.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.941+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 shutdown_connections 2024-03-24T10:36:22.942 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:22.941+0000 7f21919e2640 1 -- 172.21.15.72:0/793863479 wait complete. 2024-03-24T10:36:22.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:23.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.052+0000 7f0855fb5640 1 Processor -- start 2024-03-24T10:36:23.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.052+0000 7f0855fb5640 1 -- start start 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f0855fb5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 0x7f08500ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f0855fb5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f085006b130 0x7f085006b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f0855fb5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08500ae720 con 0x7f08501457b0 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f0855fb5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f08500b07d0 con 0x7f085006b130 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f0855fb5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f085006bae0 con 0x7f085015c5e0 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f084f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08501457b0 0x7f085006e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58034/0 (socket says 172.21.15.72:58034) 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f084f7fe640 1 -- 172.21.15.72:0/2813360008 learned_addr learned my addr 172.21.15.72:0/2813360008 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f084ffff640 1 --2- 172.21.15.72:0/2813360008 >> v2:172.21.15.79:3300/0 conn(0x7f085006b130 0x7f085006b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f084effd640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 0x7f08500ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433987214 0 0) 0x7f08500ae720 con 0x7f08501457b0 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.053+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0838003520 con 0x7f08501457b0 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1927508617 0 0) 0x7f0838003520 con 0x7f08501457b0 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 msgr2=0x7f08500ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 0x7f08500ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 >> v2:172.21.15.79:3300/0 conn(0x7f085006b130 msgr2=0x7f085006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 --2- 172.21.15.72:0/2813360008 >> v2:172.21.15.79:3300/0 conn(0x7f085006b130 0x7f085006b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08500aea00 con 0x7f08501457b0 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f0840001670 con 0x7f08501457b0 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 >> v1:172.21.15.72:6789/0 conn(0x7f08501457b0 legacy=0x7f085006e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 0x7f0838003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0838003f90 0x7f08380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f08500b07d0 con 0x7f0838003f90 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f085006bae0 con 0x7f0838004d00 2024-03-24T10:36:23.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f083800ba60 con 0x7f085015c5e0 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084effd640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0838003f90 0x7f08380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084f7fe640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 0x7f0838003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084ffff640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084effd640 1 -- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 msgr2=0x7f0838003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084effd640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f085015c5e0 0x7f0838003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084effd640 1 -- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838004d00 msgr2=0x7f0838005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084effd640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084effd640 1 -- 172.21.15.72:0/2813360008 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0838003520 con 0x7f0838003f90 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.054+0000 7f084ffff640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838004d00 0x7f0838005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f084effd640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0838003f90 0x7f08380047c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0844009ac0 tx=0x7f08380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fff678ad1d167d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084402c6b0 con 0x7f0838003f90 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f084402c810 con 0x7f0838003f90 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f084e7fc640 1 -- 172.21.15.72:0/2813360008 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f084402cba0 con 0x7f0838003f90 2024-03-24T10:36:23.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f0855fb5640 1 -- 172.21.15.72:0/2813360008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0838003f90 msgr2=0x7f08380047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2813360008 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0838003f90 0x7f08380047c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0844009ac0 tx=0x7f08380057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f084ffff640 1 -- 172.21.15.72:0/2813360008 reap_dead start 2024-03-24T10:36:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f0855fb5640 1 -- 172.21.15.72:0/2813360008 shutdown_connections 2024-03-24T10:36:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f0855fb5640 1 -- 172.21.15.72:0/2813360008 >> 172.21.15.72:0/2813360008 conn(0x7f08500b29c0 msgr2=0x7f08500b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f0855fb5640 1 -- 172.21.15.72:0/2813360008 shutdown_connections 2024-03-24T10:36:23.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.055+0000 7f0855fb5640 1 -- 172.21.15.72:0/2813360008 wait complete. 2024-03-24T10:36:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.056+0000 7f0855fb5640 1 Processor -- start 2024-03-24T10:36:23.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 -- start start 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838003f90 0x7f085009bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 0x7f08500b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0850156e60 0x7f08500b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0850140910 con 0x7f0850156a20 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f085013cda0 con 0x7f0838003f90 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f0855fb5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f085013fc90 con 0x7f0850156e60 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f084effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 0x7f08500b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f084effd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 0x7f08500b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44310/0 (socket says 172.21.15.72:44310) 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.057+0000 7f084effd640 1 -- 172.21.15.72:0/2064550891 learned_addr learned my addr 172.21.15.72:0/2064550891 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084ffff640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0850156e60 0x7f08500b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084f7fe640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838003f90 0x7f085009bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084effd640 1 -- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0850156e60 msgr2=0x7f08500b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084effd640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0850156e60 0x7f08500b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084effd640 1 -- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838003f90 msgr2=0x7f085009bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084effd640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838003f90 0x7f085009bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084effd640 1 -- 172.21.15.72:0/2064550891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085013ff70 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084ffff640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0850156e60 0x7f08500b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f084effd640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 0x7f08500b0e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0844009ac0 tx=0x7f0844004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844003810 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0844003970 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0844003d00 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0850140250 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.058+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f085009c2a0 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.059+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0850140a50 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.059+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0844040450 con 0x7f0850156a20 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.060+0000 7f0837fff640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f083c06b840 0x7f083c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.060+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f08440abdd0 con 0x7f0850156a20 2024-03-24T10:36:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.060+0000 7f084f7fe640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f083c06b840 0x7f083c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.060+0000 7f084f7fe640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f083c06b840 0x7f083c06dd00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0840001050 tx=0x7f0840009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.064+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0850140a50 con 0x7f0850156a20 2024-03-24T10:36:23.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.238+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0850140a50 con 0x7f0850156a20 2024-03-24T10:36:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.239+0000 7f0837fff640 1 -- 172.21.15.72:0/2064550891 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12848 (secure 0 0 0) 0x7f0850140a50 con 0x7f0850156a20 2024-03-24T10:36:23.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:23.240 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:17.084730+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f083c06b840 msgr2=0x7f083c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f083c06b840 0x7f083c06dd00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0840001050 tx=0x7f0840009040 comp rx=0 tx=0).stop 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 msgr2=0x7f08500b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 0x7f08500b0e20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0844009ac0 tx=0x7f0844004730 comp rx=0 tx=0).stop 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 shutdown_connections 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f083c06b840 0x7f083c06dd00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0850156e60 0x7f08500b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0850156a20 0x7f08500b0e20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 --2- 172.21.15.72:0/2064550891 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0838003f90 0x7f085009bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 >> 172.21.15.72:0/2064550891 conn(0x7f08500b29c0 msgr2=0x7f0850142ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 shutdown_connections 2024-03-24T10:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.241+0000 7f0855fb5640 1 -- 172.21.15.72:0/2064550891 wait complete. 2024-03-24T10:36:23.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-24T10:36:23.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:36:23.355 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.355+0000 7fe73642e640 1 Processor -- start 2024-03-24T10:36:23.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.355+0000 7fe73642e640 1 -- start start 2024-03-24T10:36:23.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe73642e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe73006c2b0 0x7fe73006c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe73642e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73006cdb0 0x7fe73015d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe73642e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7300cf670 con 0x7fe7300cdca0 2024-03-24T10:36:23.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe73642e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe73006d200 con 0x7fe73006cdb0 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe73642e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe7300d0c40 con 0x7fe73006c2b0 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73006cdb0 0x7fe73015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe73006cdb0 0x7fe73015d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44324/0 (socket says 172.21.15.72:44324) 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe72ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe7300cdca0 0x7fe7300cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58048/0 (socket says 172.21.15.72:58048) 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 -- 172.21.15.72:0/2769247800 learned_addr learned my addr 172.21.15.72:0/2769247800 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe72f7fe640 1 --2- 172.21.15.72:0/2769247800 >> v2:172.21.15.79:3300/0 conn(0x7fe73006c2b0 0x7fe73006c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 -- 172.21.15.72:0/2769247800 >> v2:172.21.15.79:3300/0 conn(0x7fe73006c2b0 msgr2=0x7fe73006c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 --2- 172.21.15.72:0/2769247800 >> v2:172.21.15.79:3300/0 conn(0x7fe73006c2b0 0x7fe73006c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 -- 172.21.15.72:0/2769247800 >> v1:172.21.15.72:6789/0 conn(0x7fe7300cdca0 legacy=0x7fe7300cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe72effd640 1 -- 172.21.15.72:0/2769247800 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790806683 0 0) 0x7fe7300cf670 con 0x7fe7300cdca0 2024-03-24T10:36:23.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.356+0000 7fe7349cb640 1 -- 172.21.15.72:0/2769247800 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7300d0070 con 0x7fe73006cdb0 2024-03-24T10:36:23.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.357+0000 7fe7349cb640 1 --2- 172.21.15.72:0/2769247800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006cdb0 0x7fe73015d940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7300716e0 tx=0x7fe72802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3573c6c7b23087f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.357+0000 7fe72effd640 1 -- 172.21.15.72:0/2769247800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72802cb20 con 0x7fe73006cdb0 2024-03-24T10:36:23.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.357+0000 7fe72effd640 1 -- 172.21.15.72:0/2769247800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72802cc80 con 0x7fe73006cdb0 2024-03-24T10:36:23.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.357+0000 7fe72effd640 1 -- 172.21.15.72:0/2769247800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7280343f0 con 0x7fe73006cdb0 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.357+0000 7fe73642e640 1 -- 172.21.15.72:0/2769247800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006cdb0 msgr2=0x7fe73015d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.357+0000 7fe73642e640 1 --2- 172.21.15.72:0/2769247800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006cdb0 0x7fe73015d940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe7300716e0 tx=0x7fe72802bf80 comp rx=0 tx=0).stop 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.358+0000 7fe73642e640 1 -- 172.21.15.72:0/2769247800 shutdown_connections 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.358+0000 7fe73642e640 1 --2- 172.21.15.72:0/2769247800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006cdb0 0x7fe73015d940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.358+0000 7fe73642e640 1 --2- 172.21.15.72:0/2769247800 >> v2:172.21.15.79:3300/0 conn(0x7fe73006c2b0 0x7fe73006c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.358+0000 7fe73642e640 1 -- 172.21.15.72:0/2769247800 >> 172.21.15.72:0/2769247800 conn(0x7fe7300d1cd0 msgr2=0x7fe7300d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.358+0000 7fe73642e640 1 -- 172.21.15.72:0/2769247800 shutdown_connections 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.358+0000 7fe73642e640 1 -- 172.21.15.72:0/2769247800 wait complete. 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.359+0000 7fe73642e640 1 Processor -- start 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.359+0000 7fe73642e640 1 -- start start 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 0x7fe7301f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73006cdb0 0x7fe7300ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7300cdca0 0x7fe73015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe73015e620 con 0x7fe73006c2b0 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7300c95f0 con 0x7fe73006cdb0 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe7300c98d0 con 0x7fe7300cdca0 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 0x7fe7301f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 0x7fe7301f3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44336/0 (socket says 172.21.15.72:44336) 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 -- 172.21.15.72:0/3962597803 learned_addr learned my addr 172.21.15.72:0/3962597803 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72f7fe640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73006cdb0 0x7fe7300ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe7349cb640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7300cdca0 0x7fe73015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 -- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7300cdca0 msgr2=0x7fe73015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7300cdca0 0x7fe73015e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 -- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73006cdb0 msgr2=0x7fe7300ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73006cdb0 0x7fe7300ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 -- 172.21.15.72:0/3962597803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe728009b30 con 0x7fe73006c2b0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe7349cb640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7300cdca0 0x7fe73015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72ffff640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 0x7fe7301f3890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe72000c4d0 tx=0x7fe72000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7200074e0 con 0x7fe73006c2b0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720007660 con 0x7fe73006c2b0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7300c9bb0 con 0x7fe73006c2b0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720004a20 con 0x7fe73006c2b0 2024-03-24T10:36:23.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.360+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7300ca170 con 0x7fe73006c2b0 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.361+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73004f470 con 0x7fe73006c2b0 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.362+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe720004b80 con 0x7fe73006c2b0 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.362+0000 7fe72cff9640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe71c06b810 0x7fe71c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.362+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe720089400 con 0x7fe73006c2b0 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.362+0000 7fe72f7fe640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe71c06b810 0x7fe71c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.362+0000 7fe72f7fe640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe71c06b810 0x7fe71c06dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7300c74f0 tx=0x7fe724008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.366+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe720054170 con 0x7fe73006c2b0 2024-03-24T10:36:23.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.535+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe7300c5590 con 0x7fe73006c2b0 2024-03-24T10:36:23.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.536+0000 7fe72cff9640 1 -- 172.21.15.72:0/3962597803 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fe720018020 con 0x7fe73006c2b0 2024-03-24T10:36:23.537 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:36:23.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe71c06b810 msgr2=0x7fe71c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe71c06b810 0x7fe71c06dcd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7300c74f0 tx=0x7fe724008040 comp rx=0 tx=0).stop 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 msgr2=0x7fe7301f3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 0x7fe7301f3890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe72000c4d0 tx=0x7fe72000c990 comp rx=0 tx=0).stop 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 shutdown_connections 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe71c06b810 0x7fe71c06dcd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7300cdca0 0x7fe73015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe73006cdb0 0x7fe7300ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 --2- 172.21.15.72:0/3962597803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73006c2b0 0x7fe7301f3890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 >> 172.21.15.72:0/3962597803 conn(0x7fe7300d1cd0 msgr2=0x7fe730161130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 shutdown_connections 2024-03-24T10:36:23.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.538+0000 7fe73642e640 1 -- 172.21.15.72:0/3962597803 wait complete. 2024-03-24T10:36:23.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-24T10:36:23.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.648+0000 7f1c140c3640 1 Processor -- start 2024-03-24T10:36:23.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 -- start start 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c0c15e1d0 0x7f1c0c0cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1c0c06f030 0x7f1c0c06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c0d1b60 0x7f1c0c0d2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0c0d2550 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0c15e5b0 con 0x7f1c0c06f030 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.649+0000 7f1c140c3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0c0ce9c0 con 0x7f1c0c0d1b60 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c0c15e1d0 0x7f1c0c0cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c0c15e1d0 0x7f1c0c0cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44338/0 (socket says 172.21.15.72:44338) 2024-03-24T10:36:23.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 -- 172.21.15.72:0/605890779 learned_addr learned my addr 172.21.15.72:0/605890779 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c1165e640 1 --2- 172.21.15.72:0/605890779 >> v2:172.21.15.79:3300/0 conn(0x7f1c0c06f030 0x7f1c0c06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c12660640 1 --2- 172.21.15.72:0/605890779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c0d1b60 0x7f1c0c0d2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 -- 172.21.15.72:0/605890779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c0d1b60 msgr2=0x7f1c0c0d2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/605890779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c0d1b60 0x7f1c0c0d2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 -- 172.21.15.72:0/605890779 >> v2:172.21.15.79:3300/0 conn(0x7f1c0c06f030 msgr2=0x7f1c0c06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/605890779 >> v2:172.21.15.79:3300/0 conn(0x7f1c0c06f030 0x7f1c0c06f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.650+0000 7f1c11e5f640 1 -- 172.21.15.72:0/605890779 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c0ceca0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/605890779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0cfec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0d2930 tx=0x7f1c0402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d0734fa145ae72 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c10e5d640 1 -- 172.21.15.72:0/605890779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c04031640 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c10e5d640 1 -- 172.21.15.72:0/605890779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c040317a0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c10e5d640 1 -- 172.21.15.72:0/605890779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c04031b30 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 -- 172.21.15.72:0/605890779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 msgr2=0x7f1c0c0cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 --2- 172.21.15.72:0/605890779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0cfec0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0d2930 tx=0x7f1c0402b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 -- 172.21.15.72:0/605890779 shutdown_connections 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 --2- 172.21.15.72:0/605890779 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c0d1b60 0x7f1c0c0d2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 --2- 172.21.15.72:0/605890779 >> v2:172.21.15.79:3300/0 conn(0x7f1c0c06f030 0x7f1c0c06f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 --2- 172.21.15.72:0/605890779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0cfec0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 -- 172.21.15.72:0/605890779 >> 172.21.15.72:0/605890779 conn(0x7f1c0c09a9d0 msgr2=0x7f1c0c09ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 -- 172.21.15.72:0/605890779 shutdown_connections 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.651+0000 7f1c140c3640 1 -- 172.21.15.72:0/605890779 wait complete. 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.652+0000 7f1c140c3640 1 Processor -- start 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 -- start start 2024-03-24T10:36:23.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c06f030 0x7f1c0c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c0c0d1b60 0x7f1c0c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c0b6480 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c0b5910 con 0x7f1c0c0d1b60 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c140c3640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1c0c0b5be0 con 0x7f1c0c06f030 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c12660640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c12660640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0b6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44342/0 (socket says 172.21.15.72:44342) 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c12660640 1 -- 172.21.15.72:0/3236958805 learned_addr learned my addr 172.21.15.72:0/3236958805 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.653+0000 7f1c1165e640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c0c0d1b60 0x7f1c0c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c06f030 0x7f1c0c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c12660640 1 -- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c06f030 msgr2=0x7f1c0c0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c12660640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c06f030 0x7f1c0c0c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c12660640 1 -- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c0c0d1b60 msgr2=0x7f1c0c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c12660640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c0c0d1b60 0x7f1c0c0b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c12660640 1 -- 172.21.15.72:0/3236958805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c040094d0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c1165e640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c0c0d1b60 0x7f1c0c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c06f030 0x7f1c0c0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c12660640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0b6f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c08007e40 tx=0x7f1c0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08014620 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c0800ee90 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c080149e0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0c0b5ec0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.657 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.654+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0c1f3e60 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.655+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0c073d50 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.655+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1c08014b40 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.655+0000 7f1c027fc640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1bf006b810 0x7f1bf006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.656+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1c0808a7c0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.658 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.656+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1bf006b810 0x7f1bf006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.656+0000 7f1c11e5f640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1bf006b810 0x7f1bf006dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c04036000 tx=0x7f1c0403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.660+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1c080555c0 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.835+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1c0c0c7280 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.836+0000 7f1c027fc640 1 -- 172.21.15.72:0/3236958805 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f1c08058c80 con 0x7f1c0c15e1d0 2024-03-24T10:36:23.836 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:23.837 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2024-03-24T10:36:23.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:36:23.837 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2024-03-24T10:36:23.837 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2024-03-24T10:36:23.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:36:23.837 INFO:teuthology.orchestra.run.smithi072.stdout:] 2024-03-24T10:36:23.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1bf006b810 msgr2=0x7f1bf006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1bf006b810 0x7f1bf006dcd0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1c04036000 tx=0x7f1c0403c040 comp rx=0 tx=0).stop 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 msgr2=0x7f1c0c0b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0b6f70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c08007e40 tx=0x7f1c0800e4b0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 shutdown_connections 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1bf006b810 0x7f1bf006dcd0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c0c15e1d0 0x7f1c0c0b6f70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c0c0d1b60 0x7f1c0c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 --2- 172.21.15.72:0/3236958805 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1c0c06f030 0x7f1c0c0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 >> 172.21.15.72:0/3236958805 conn(0x7f1c0c09a9d0 msgr2=0x7f1c0c15b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 shutdown_connections 2024-03-24T10:36:23.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.838+0000 7f1c140c3640 1 -- 172.21.15.72:0/3236958805 wait complete. 2024-03-24T10:36:23.848 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-24T10:36:23.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-24T10:36:23.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.952+0000 7f7a2c66f640 1 Processor -- start 2024-03-24T10:36:23.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.952+0000 7f7a2c66f640 1 -- start start 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2c66f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a2415b010 0x7f7a24070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2c66f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a240726e0 con 0x7f7a24072100 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2c66f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a240b4050 con 0x7f7a240ad5a0 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2c66f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7a240b4310 con 0x7f7a2415b010 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2ac0c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7a24072100 0x7f7a240b2bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58062/0 (socket says 172.21.15.72:58062) 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2ac0c640 1 -- 172.21.15.72:0/8522551 learned_addr learned my addr 172.21.15.72:0/8522551 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2566231779 0 0) 0x7f7a240726e0 con 0x7f7a24072100 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a10003520 con 0x7f7a24072100 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2a40b640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a2415b010 0x7f7a24070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 674589254 0 0) 0x7f7a10003520 con 0x7f7a24072100 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a2415b010 msgr2=0x7f7a24070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a2415b010 0x7f7a24070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 >> v1:172.21.15.79:6789/0 conn(0x7f7a240ad5a0 legacy=0x7f7a240719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a240b45f0 con 0x7f7a24072100 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f7a1c0019f0 con 0x7f7a24072100 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 >> v1:172.21.15.72:6789/0 conn(0x7f7a24072100 legacy=0x7f7a240b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a100039a0 0x7f7a10003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004300 0x7f7a100047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a10004fe0 0x7f7a1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7a240b4310 con 0x7f7a10004fe0 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1000bef0 con 0x7f7a10004300 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1000c0b0 con 0x7f7a100039a0 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2ac0c640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a10004fe0 0x7f7a1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a2a40b640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a100039a0 0x7f7a10003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.953+0000 7f7a29c0a640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004300 0x7f7a100047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a2ac0c640 1 -- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a100039a0 msgr2=0x7f7a10003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a2ac0c640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a100039a0 0x7f7a10003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a2ac0c640 1 -- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004300 msgr2=0x7f7a100047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a2ac0c640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004300 0x7f7a100047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a2ac0c640 1 -- 172.21.15.72:0/8522551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a10003520 con 0x7f7a10004fe0 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a2ac0c640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a10004fe0 0x7f7a1000b980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00a830 tx=0x7f7a100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a2b4f2a1a26b3b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.954+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0072d0 con 0x7f7a10004fe0 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1c02f070 con 0x7f7a10004fe0 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a29409640 1 -- 172.21.15.72:0/8522551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1c0076f0 con 0x7f7a10004fe0 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2c66f640 1 -- 172.21.15.72:0/8522551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a10004fe0 msgr2=0x7f7a1000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/8522551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a10004fe0 0x7f7a1000b980 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c00a830 tx=0x7f7a100057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2ac0c640 1 -- 172.21.15.72:0/8522551 reap_dead start 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2c66f640 1 -- 172.21.15.72:0/8522551 shutdown_connections 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2c66f640 1 -- 172.21.15.72:0/8522551 >> 172.21.15.72:0/8522551 conn(0x7f7a240b18b0 msgr2=0x7f7a240b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2c66f640 1 -- 172.21.15.72:0/8522551 shutdown_connections 2024-03-24T10:36:23.958 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.955+0000 7f7a2c66f640 1 -- 172.21.15.72:0/8522551 wait complete. 2024-03-24T10:36:23.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.956+0000 7f7a2c66f640 1 Processor -- start 2024-03-24T10:36:23.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.956+0000 7f7a2c66f640 1 -- start start 2024-03-24T10:36:23.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2c66f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004fe0 0x7f7a241485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2c66f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 0x7f7a241545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2c66f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a24154b20 0x7f7a2406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2c66f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7a24157e90 con 0x7f7a2409d590 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2c66f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7a24151e60 con 0x7f7a10004fe0 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2c66f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7a24148b10 con 0x7f7a24154b20 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 0x7f7a241545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 0x7f7a241545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44370/0 (socket says 172.21.15.72:44370) 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 -- 172.21.15.72:0/2397132912 learned_addr learned my addr 172.21.15.72:0/2397132912 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2a40b640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004fe0 0x7f7a241485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 -- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a24154b20 msgr2=0x7f7a2406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2ac0c640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a24154b20 0x7f7a2406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a24154b20 0x7f7a2406d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 -- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004fe0 msgr2=0x7f7a241485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004fe0 0x7f7a241485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 -- 172.21.15.72:0/2397132912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a24152100 con 0x7f7a2409d590 2024-03-24T10:36:23.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2a40b640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004fe0 0x7f7a241485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a2ac0c640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a24154b20 0x7f7a2406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.957+0000 7f7a29c0a640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 0x7f7a241545e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400f610 tx=0x7f7a1400fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.958+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a140052e0 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.958+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a14005440 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.958+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a241523e0 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.958+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14003830 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.958+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a241529a0 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.959+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a24152b60 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.959+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7a14003990 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.959+0000 7f7a1affd640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7a0806b840 0x7f7a0806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.959+0000 7f7a2a40b640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7a0806b840 0x7f7a0806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.959+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7a14089da0 con 0x7f7a2409d590 2024-03-24T10:36:23.963 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.960+0000 7f7a2a40b640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7a0806b840 0x7f7a0806dd00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a2406df60 tx=0x7f7a20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:23.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:23.963+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7a14054b10 con 0x7f7a2409d590 2024-03-24T10:36:24.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.135+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7a2415e2a0 con 0x7f7a2409d590 2024-03-24T10:36:24.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.194+0000 7f7a1affd640 1 -- 172.21.15.72:0/2397132912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f7a140581d0 con 0x7f7a2409d590 2024-03-24T10:36:24.195 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2024-03-24T10:36:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.197+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7a0806b840 msgr2=0x7f7a0806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.197+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7a0806b840 0x7f7a0806dd00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a2406df60 tx=0x7f7a20008040 comp rx=0 tx=0).stop 2024-03-24T10:36:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.197+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 msgr2=0x7f7a241545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.197+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 0x7f7a241545e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400f610 tx=0x7f7a1400fad0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.198 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.198+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 shutdown_connections 2024-03-24T10:36:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.198+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7a0806b840 0x7f7a0806dd00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.198+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7a24154b20 0x7f7a2406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.198+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a2409d590 0x7f7a241545e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.198+0000 7f7a2c66f640 1 --2- 172.21.15.72:0/2397132912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7a10004fe0 0x7f7a241485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.199 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.198+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 >> 172.21.15.72:0/2397132912 conn(0x7f7a240b18b0 msgr2=0x7f7a240af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.199+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 shutdown_connections 2024-03-24T10:36:24.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.199+0000 7f7a2c66f640 1 -- 172.21.15.72:0/2397132912 wait complete. 2024-03-24T10:36:24.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-24T10:36:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 Processor -- start 2024-03-24T10:36:24.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 -- start start 2024-03-24T10:36:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f084015bfe0 0x7f08400d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f08400cfdd0 0x7f08400d0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08400d0740 con 0x7f08400cf830 2024-03-24T10:36:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f08400cf630 con 0x7f084015bfe0 2024-03-24T10:36:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.319+0000 7f08462ae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f08400cc770 con 0x7f08400cfdd0 2024-03-24T10:36:24.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f084015bfe0 0x7f08400d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08400cf830 0x7f08400aea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58076/0 (socket says 172.21.15.72:58076) 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083f7fe640 1 -- 172.21.15.72:0/933584265 learned_addr learned my addr 172.21.15.72:0/933584265 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f084484b640 1 --2- 172.21.15.72:0/933584265 >> v2:172.21.15.79:3300/0 conn(0x7f08400cfdd0 0x7f08400d0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083ffff640 1 -- 172.21.15.72:0/933584265 >> v2:172.21.15.79:3300/0 conn(0x7f08400cfdd0 msgr2=0x7f08400d0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083ffff640 1 --2- 172.21.15.72:0/933584265 >> v2:172.21.15.79:3300/0 conn(0x7f08400cfdd0 0x7f08400d0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083ffff640 1 -- 172.21.15.72:0/933584265 >> v1:172.21.15.72:6789/0 conn(0x7f08400cf830 legacy=0x7f08400aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083ffff640 1 -- 172.21.15.72:0/933584265 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08400cf070 con 0x7f084015bfe0 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f083effd640 1 -- 172.21.15.72:0/933584265 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3946388163 0 0) 0x7f08400d0740 con 0x7f08400cf830 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.320+0000 7f084484b640 1 --2- 172.21.15.72:0/933584265 >> v2:172.21.15.79:3300/0 conn(0x7f08400cfdd0 0x7f08400d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f083ffff640 1 --2- 172.21.15.72:0/933584265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084015bfe0 0x7f08400d2780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f084006ed80 tx=0x7f083402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4763518a792d88 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f083effd640 1 -- 172.21.15.72:0/933584265 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083402e070 con 0x7f084015bfe0 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f083effd640 1 -- 172.21.15.72:0/933584265 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08340315a0 con 0x7f084015bfe0 2024-03-24T10:36:24.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f083effd640 1 -- 172.21.15.72:0/933584265 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834031930 con 0x7f084015bfe0 2024-03-24T10:36:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 -- 172.21.15.72:0/933584265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084015bfe0 msgr2=0x7f08400d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 --2- 172.21.15.72:0/933584265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084015bfe0 0x7f08400d2780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f084006ed80 tx=0x7f083402b840 comp rx=0 tx=0).stop 2024-03-24T10:36:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 -- 172.21.15.72:0/933584265 shutdown_connections 2024-03-24T10:36:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 --2- 172.21.15.72:0/933584265 >> v2:172.21.15.79:3300/0 conn(0x7f08400cfdd0 0x7f08400d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 --2- 172.21.15.72:0/933584265 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f084015bfe0 0x7f08400d2780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 -- 172.21.15.72:0/933584265 >> 172.21.15.72:0/933584265 conn(0x7f08400d1c60 msgr2=0x7f08400d2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 -- 172.21.15.72:0/933584265 shutdown_connections 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.321+0000 7f08462ae640 1 -- 172.21.15.72:0/933584265 wait complete. 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 Processor -- start 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 -- start start 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08400cf830 0x7f08401505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 0x7f08400c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f084015bfe0 0x7f08400c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0840151570 con 0x7f08400cfdd0 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f084009fa10 con 0x7f08400cf830 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f08462ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f0840150c40 con 0x7f084015bfe0 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.323+0000 7f083f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 0x7f08400c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 0x7f08400c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44388/0 (socket says 172.21.15.72:44388) 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 -- 172.21.15.72:0/3807625458 learned_addr learned my addr 172.21.15.72:0/3807625458 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:24.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 -- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f084015bfe0 msgr2=0x7f08400c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f084484b640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f084015bfe0 0x7f08400c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083ffff640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08400cf830 0x7f08401505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f084015bfe0 0x7f08400c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 -- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08400cf830 msgr2=0x7f08401505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08400cf830 0x7f08401505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 -- 172.21.15.72:0/3807625458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0834009400 con 0x7f08400cfdd0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083ffff640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08400cf830 0x7f08401505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083f7fe640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 0x7f08400c5790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f083000c430 tx=0x7f083000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08300074e0 con 0x7f08400cfdd0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0830007660 con 0x7f08400cfdd0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0840150f20 con 0x7f08400cfdd0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0830004a20 con 0x7f08400cfdd0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.324+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f084009ec50 con 0x7f08400cfdd0 2024-03-24T10:36:24.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.325+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08401516e0 con 0x7f08400cfdd0 2024-03-24T10:36:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.326+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0830004b80 con 0x7f08400cfdd0 2024-03-24T10:36:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.326+0000 7f083cff9640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f082c06b810 0x7f082c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.326+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f0830089e10 con 0x7f08400cfdd0 2024-03-24T10:36:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.326+0000 7f083ffff640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f082c06b810 0x7f082c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:24.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.326+0000 7f083ffff640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f082c06b810 0x7f082c06dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0834036000 tx=0x7f083403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:24.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.331+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0830054a10 con 0x7f08400cfdd0 2024-03-24T10:36:24.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:24.501+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f084004f470 con 0x7f08400cfdd0 2024-03-24T10:36:25.197 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.197+0000 7f083cff9640 1 -- 172.21.15.72:0/3807625458 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f08300580d0 con 0x7f08400cfdd0 2024-03-24T10:36:25.197 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2024-03-24T10:36:25.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f082c06b810 msgr2=0x7f082c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f082c06b810 0x7f082c06dcd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0834036000 tx=0x7f083403d040 comp rx=0 tx=0).stop 2024-03-24T10:36:25.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 msgr2=0x7f08400c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.200 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 0x7f08400c5790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f083000c430 tx=0x7f083000c8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 shutdown_connections 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f082c06b810 0x7f082c06dcd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f084015bfe0 0x7f08400c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08400cfdd0 0x7f08400c5790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 --2- 172.21.15.72:0/3807625458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f08400cf830 0x7f08401505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 >> 172.21.15.72:0/3807625458 conn(0x7f08400d1c60 msgr2=0x7f08400aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 shutdown_connections 2024-03-24T10:36:25.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.200+0000 7f08462ae640 1 -- 172.21.15.72:0/3807625458 wait complete. 2024-03-24T10:36:25.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-24T10:36:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.329+0000 7f5adfbb5640 1 Processor -- start 2024-03-24T10:36:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.329+0000 7f5adfbb5640 1 -- start start 2024-03-24T10:36:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.330+0000 7f5adfbb5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5ad80d2b20 0x7f5ad80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.330+0000 7f5adfbb5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad80d4950 con 0x7f5ad815e240 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.330+0000 7f5adfbb5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ad80b38c0 con 0x7f5ad80d0f70 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.330+0000 7f5adfbb5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5ad80d2270 con 0x7f5ad80d2b20 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.330+0000 7f5add951640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5ad815e240 0x7f5ad80d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58090/0 (socket says 172.21.15.72:58090) 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.330+0000 7f5add951640 1 -- 172.21.15.72:0/3724653200 learned_addr learned my addr 172.21.15.72:0/3724653200 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 --2- 172.21.15.72:0/3724653200 >> v2:172.21.15.79:3300/0 conn(0x7f5ad80d2b20 0x7f5ad80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592454369 0 0) 0x7f5ad80d4950 con 0x7f5ad815e240 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac4003520 con 0x7f5ad815e240 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2292641618 0 0) 0x7f5ac4003520 con 0x7f5ad815e240 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 >> v2:172.21.15.79:3300/0 conn(0x7f5ad80d2b20 msgr2=0x7f5ad80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 --2- 172.21.15.72:0/3724653200 >> v2:172.21.15.79:3300/0 conn(0x7f5ad80d2b20 0x7f5ad80cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 >> v1:172.21.15.79:6789/0 conn(0x7f5ad80d0f70 legacy=0x7f5ad80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80b3550 con 0x7f5ad815e240 2024-03-24T10:36:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f5ad40019f0 con 0x7f5ad815e240 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 >> v1:172.21.15.72:6789/0 conn(0x7f5ad815e240 legacy=0x7f5ad80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ac4003970 0x7f5ac4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40047c0 0x7f5ac4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac4005180 0x7f5ac400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80d2270 con 0x7f5ac40047c0 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac400c120 con 0x7f5ac4005180 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac400c2e0 con 0x7f5ac4003970 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40047c0 0x7f5ac4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5ade152640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac4005180 0x7f5ac400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add951640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ac4003970 0x7f5ac4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 -- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ac4003970 msgr2=0x7f5ac4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ac4003970 0x7f5ac4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 -- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac4005180 msgr2=0x7f5ac400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac4005180 0x7f5ac400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5add150640 1 -- 172.21.15.72:0/3724653200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac4003520 con 0x7f5ac40047c0 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.331+0000 7f5ade152640 1 -- 172.21.15.72:0/3724653200 reap_dead start 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.332+0000 7f5add150640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40047c0 0x7f5ac4004c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009ac0 tx=0x7f5ac40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995f374a8ed383e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.332+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac802c6b0 con 0x7f5ac40047c0 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.332+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac802c810 con 0x7f5ac40047c0 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.332+0000 7f5adc94f640 1 -- 172.21.15.72:0/3724653200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac802cba0 con 0x7f5ac40047c0 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 -- 172.21.15.72:0/3724653200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40047c0 msgr2=0x7f5ac4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40047c0 0x7f5ac4004c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009ac0 tx=0x7f5ac40057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 -- 172.21.15.72:0/3724653200 shutdown_connections 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/3724653200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ac40047c0 0x7f5ac4004c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 -- 172.21.15.72:0/3724653200 >> 172.21.15.72:0/3724653200 conn(0x7f5ad80d3e30 msgr2=0x7f5ad80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 -- 172.21.15.72:0/3724653200 shutdown_connections 2024-03-24T10:36:25.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.333+0000 7f5adfbb5640 1 -- 172.21.15.72:0/3724653200 wait complete. 2024-03-24T10:36:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.334+0000 7f5adfbb5640 1 Processor -- start 2024-03-24T10:36:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.334+0000 7f5adfbb5640 1 -- start start 2024-03-24T10:36:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac40047c0 0x7f5ad814adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ad81611b0 0x7f5ad814b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 0x7f5ad80b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80b1450 con 0x7f5ad814ba70 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad80c9990 con 0x7f5ac40047c0 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad80b16a0 con 0x7f5ad81611b0 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 0x7f5ad80b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 0x7f5ad80b89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44404/0 (socket says 172.21.15.72:44404) 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 -- 172.21.15.72:0/4260490670 learned_addr learned my addr 172.21.15.72:0/4260490670 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5add951640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac40047c0 0x7f5ad814adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5add150640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ad81611b0 0x7f5ad814b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 -- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ad81611b0 msgr2=0x7f5ad814b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ad81611b0 0x7f5ad814b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 -- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac40047c0 msgr2=0x7f5ad814adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac40047c0 0x7f5ad814adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 -- 172.21.15.72:0/4260490670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad80b1980 con 0x7f5ad814ba70 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ade152640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 0x7f5ad80b89f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b58f0 tx=0x7f5ad000f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:25.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0005340 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ad00054a0 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad80c9340 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0007250 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.335+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad8161630 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.336+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad80c91a0 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.337+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5ad00073b0 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.337+0000 7f5ace7fc640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5abc06b810 0x7f5abc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.337+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f5ad0089470 con 0x7f5ad814ba70 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.337+0000 7f5add951640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5abc06b810 0x7f5abc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:25.341 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.338+0000 7f5add951640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5abc06b810 0x7f5abc06dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4001b20 tx=0x7f5ad4006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:25.342 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.342+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5ad80c91a0 con 0x7f5ad814ba70 2024-03-24T10:36:25.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:36:25.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:36:25.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:25.551+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5ad80c91a0 con 0x7f5ad814ba70 2024-03-24T10:36:26.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.216+0000 7f5ace7fc640 1 -- 172.21.15.72:0/4260490670 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5ad80c91a0 con 0x7f5ad814ba70 2024-03-24T10:36:26.217 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 2 and data pool 3 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.223+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5abc06b810 msgr2=0x7f5abc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.223+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5abc06b810 0x7f5abc06dcd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4001b20 tx=0x7f5ad4006040 comp rx=0 tx=0).stop 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.223+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 msgr2=0x7f5ad80b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.223+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 0x7f5ad80b89f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80b58f0 tx=0x7f5ad000f900 comp rx=0 tx=0).stop 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.224+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 shutdown_connections 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.224+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5abc06b810 0x7f5abc06dcd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.224+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ad814ba70 0x7f5ad80b89f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.224+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5ad81611b0 0x7f5ad814b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.224+0000 7f5adfbb5640 1 --2- 172.21.15.72:0/4260490670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac40047c0 0x7f5ad814adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.224+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 >> 172.21.15.72:0/4260490670 conn(0x7f5ad80d3e30 msgr2=0x7f5ad80d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:26.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.225+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 shutdown_connections 2024-03-24T10:36:26.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.225+0000 7f5adfbb5640 1 -- 172.21.15.72:0/4260490670 wait complete. 2024-03-24T10:36:26.248 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-24T10:36:26.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-24T10:36:26.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.356+0000 7f8e82793640 1 Processor -- start 2024-03-24T10:36:26.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e82793640 1 -- start start 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e82793640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8e7c15b010 0x7f8e7c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e82793640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e7c0ad5a0 0x7f8e7c0712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e82793640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e7c0726e0 con 0x7f8e7c0719f0 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e82793640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8e7c0b4050 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e82793640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8e7c0b4310 con 0x7f8e7c15b010 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e7b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e7c0ad5a0 0x7f8e7c0712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e7b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e7c0ad5a0 0x7f8e7c0712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44410/0 (socket says 172.21.15.72:44410) 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.357+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/2575291962 learned_addr learned my addr 172.21.15.72:0/2575291962 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:26.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7bfff640 1 --2- 172.21.15.72:0/2575291962 >> v2:172.21.15.79:3300/0 conn(0x7f8e7c15b010 0x7f8e7c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/2575291962 >> v2:172.21.15.79:3300/0 conn(0x7f8e7c15b010 msgr2=0x7f8e7c070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7b7fe640 1 --2- 172.21.15.72:0/2575291962 >> v2:172.21.15.79:3300/0 conn(0x7f8e7c15b010 0x7f8e7c070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/2575291962 >> v1:172.21.15.79:6789/0 conn(0x7f8e7c0719f0 legacy=0x7f8e7c071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/2575291962 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c0b45f0 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7bfff640 1 --2- 172.21.15.72:0/2575291962 >> v2:172.21.15.79:3300/0 conn(0x7f8e7c15b010 0x7f8e7c070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.358+0000 7f8e7b7fe640 1 --2- 172.21.15.72:0/2575291962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c0712f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c068960 tx=0x7f8e7002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d9c4cbd6a95923 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e7affd640 1 -- 172.21.15.72:0/2575291962 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700317e0 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e7affd640 1 -- 172.21.15.72:0/2575291962 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70031940 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e7affd640 1 -- 172.21.15.72:0/2575291962 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70031cd0 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 -- 172.21.15.72:0/2575291962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 msgr2=0x7f8e7c0712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 --2- 172.21.15.72:0/2575291962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c0712f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c068960 tx=0x7f8e7002b880 comp rx=0 tx=0).stop 2024-03-24T10:36:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 -- 172.21.15.72:0/2575291962 shutdown_connections 2024-03-24T10:36:26.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 --2- 172.21.15.72:0/2575291962 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c0712f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 --2- 172.21.15.72:0/2575291962 >> v2:172.21.15.79:3300/0 conn(0x7f8e7c15b010 0x7f8e7c070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 -- 172.21.15.72:0/2575291962 >> 172.21.15.72:0/2575291962 conn(0x7f8e7c0b18b0 msgr2=0x7f8e7c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 -- 172.21.15.72:0/2575291962 shutdown_connections 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.359+0000 7f8e82793640 1 -- 172.21.15.72:0/2575291962 wait complete. 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.360+0000 7f8e82793640 1 Processor -- start 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.360+0000 7f8e82793640 1 -- start start 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e82793640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e7c0719f0 0x7f8e7c15d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e82793640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c09b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e82793640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e7c0afa90 0x7f8e7c0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e82793640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c0b0460 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e82793640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c09b3a0 con 0x7f8e7c0afa90 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e82793640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8e7c1f68a0 con 0x7f8e7c0719f0 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e7b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c09b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:26.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e7b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c09b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44416/0 (socket says 172.21.15.72:44416) 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/3063328091 learned_addr learned my addr 172.21.15.72:0/3063328091 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e80d30640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e7c0afa90 0x7f8e7c0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.361+0000 7f8e7bfff640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e7c0719f0 0x7f8e7c15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e7c0719f0 msgr2=0x7f8e7c15d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e7b7fe640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e7c0719f0 0x7f8e7c15d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e7c0afa90 msgr2=0x7f8e7c0aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e7b7fe640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e7c0afa90 0x7f8e7c0aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e7b7fe640 1 -- 172.21.15.72:0/3063328091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e700094d0 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e7b7fe640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c09b830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000c00 tx=0x7f8e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700329c0 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70032b40 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c09aa70 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e700453f0 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.362+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c09b030 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.363+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c09b530 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.363+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8e70045550 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.363+0000 7f8e78ff9640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8e6806b810 0x7f8e6806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.364+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8e700ac590 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.364+0000 7f8e7bfff640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8e6806b810 0x7f8e6806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:26.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.364+0000 7f8e7bfff640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8e6806b810 0x7f8e6806dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00aac0 tx=0x7f8e6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:26.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.368+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8e70077180 con 0x7f8e7c0ad5a0 2024-03-24T10:36:26.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:26.547+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f8e7c09e080 con 0x7f8e7c0ad5a0 2024-03-24T10:36:27.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.220+0000 7f8e78ff9640 1 -- 172.21.15.72:0/3063328091 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f8e7007a840 con 0x7f8e7c0ad5a0 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8e6806b810 msgr2=0x7f8e6806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8e6806b810 0x7f8e6806dcd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00aac0 tx=0x7f8e6c008040 comp rx=0 tx=0).stop 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 msgr2=0x7f8e7c09b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c09b830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000c00 tx=0x7f8e700046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 shutdown_connections 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8e6806b810 0x7f8e6806dcd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e7c0afa90 0x7f8e7c0aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e7c0ad5a0 0x7f8e7c09b830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 --2- 172.21.15.72:0/3063328091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8e7c0719f0 0x7f8e7c15d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 >> 172.21.15.72:0/3063328091 conn(0x7f8e7c0b18b0 msgr2=0x7f8e7c070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 shutdown_connections 2024-03-24T10:36:27.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.223+0000 7f8e82793640 1 -- 172.21.15.72:0/3063328091 wait complete. 2024-03-24T10:36:27.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-24T10:36:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.348+0000 7f81ff817640 1 Processor -- start 2024-03-24T10:36:27.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.348+0000 7f81ff817640 1 -- start start 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81ff817640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f815e1c0 0x7f81f80d2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81ff817640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f80d2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81ff817640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f80c82c0 con 0x7f81f80d0ef0 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81ff817640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80d4960 con 0x7f81f815e1c0 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81ff817640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f81f80d4c40 con 0x7f81f80d1c20 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81fd5b3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f815e1c0 0x7f81f80d2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81fddb4640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f81f80d0ef0 0x7f81f80b4ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58096/0 (socket says 172.21.15.72:58096) 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81fddb4640 1 -- 172.21.15.72:0/1066524760 learned_addr learned my addr 172.21.15.72:0/1066524760 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81fd5b3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81f815e1c0 0x7f81f80d2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44418/0 (socket says 172.21.15.72:44418) 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.349+0000 7f81fcdb2640 1 --2- 172.21.15.72:0/1066524760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f80d2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81fd5b3640 1 -- 172.21.15.72:0/1066524760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 msgr2=0x7f81f80d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81fd5b3640 1 --2- 172.21.15.72:0/1066524760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f80d2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81fd5b3640 1 -- 172.21.15.72:0/1066524760 >> v1:172.21.15.72:6789/0 conn(0x7f81f80d0ef0 legacy=0x7f81f80b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81fd5b3640 1 -- 172.21.15.72:0/1066524760 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80c7990 con 0x7f81f815e1c0 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81effff640 1 -- 172.21.15.72:0/1066524760 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379735775 0 0) 0x7f81f80c82c0 con 0x7f81f80d0ef0 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81fd5b3640 1 --2- 172.21.15.72:0/1066524760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80d2420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009d90 tx=0x7f81f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb174c40e0c5d61 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.350+0000 7f81effff640 1 -- 172.21.15.72:0/1066524760 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f402cc50 con 0x7f81f815e1c0 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81effff640 1 -- 172.21.15.72:0/1066524760 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f402cdb0 con 0x7f81f815e1c0 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81effff640 1 -- 172.21.15.72:0/1066524760 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4034660 con 0x7f81f815e1c0 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 -- 172.21.15.72:0/1066524760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 msgr2=0x7f81f80d2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 --2- 172.21.15.72:0/1066524760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80d2420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009d90 tx=0x7f81f402bea0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 -- 172.21.15.72:0/1066524760 shutdown_connections 2024-03-24T10:36:27.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 --2- 172.21.15.72:0/1066524760 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f80d2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 --2- 172.21.15.72:0/1066524760 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80d2420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 -- 172.21.15.72:0/1066524760 >> 172.21.15.72:0/1066524760 conn(0x7f81f80d3e40 msgr2=0x7f81f80d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 -- 172.21.15.72:0/1066524760 shutdown_connections 2024-03-24T10:36:27.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.351+0000 7f81ff817640 1 -- 172.21.15.72:0/1066524760 wait complete. 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.352+0000 7f81ff817640 1 Processor -- start 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.352+0000 7f81ff817640 1 -- start start 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81ff817640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f80d0ef0 0x7f81f81f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81ff817640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81ff817640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81ff817640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f81f80cb490 con 0x7f81f815e1c0 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81ff817640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81f80ce300 con 0x7f81f80d0ef0 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81ff817640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f81f809e2e0 con 0x7f81f80d1c20 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44434/0 (socket says 172.21.15.72:44434) 2024-03-24T10:36:27.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 -- 172.21.15.72:0/2380126120 learned_addr learned my addr 172.21.15.72:0/2380126120 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fd5b3640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f80d0ef0 0x7f81f81f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fcdb2640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 -- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 msgr2=0x7f81f815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 -- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f80d0ef0 msgr2=0x7f81f81f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f80d0ef0 0x7f81f81f7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.353+0000 7f81fddb4640 1 -- 172.21.15.72:0/2380126120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f4009a70 con 0x7f81f815e1c0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.354+0000 7f81fddb4640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80cddc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c480 tx=0x7f81f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.354+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f00074e0 con 0x7f81f815e1c0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.354+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f0007660 con 0x7f81f815e1c0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.354+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f809dd20 con 0x7f81f815e1c0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.354+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0004a20 con 0x7f81f815e1c0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.354+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f80cb0b0 con 0x7f81f815e1c0 2024-03-24T10:36:27.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.355+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f80caf10 con 0x7f81f815e1c0 2024-03-24T10:36:27.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.355+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f81f0004b80 con 0x7f81f815e1c0 2024-03-24T10:36:27.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.355+0000 7f81edffb640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f81dc06b810 0x7f81dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:27.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.355+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f81f0089760 con 0x7f81f815e1c0 2024-03-24T10:36:27.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.355+0000 7f81fd5b3640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f81dc06b810 0x7f81dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:27.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.356+0000 7f81fd5b3640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f81dc06b810 0x7f81dc06dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81f4036000 tx=0x7f81f4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:27.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.360+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f81f80caf10 con 0x7f81f815e1c0 2024-03-24T10:36:27.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:27.530+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f81f80cb5d0 con 0x7f81f815e1c0 2024-03-24T10:36:29.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.230+0000 7f81edffb640 1 -- 172.21.15.72:0/2380126120 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f81f80cb5d0 con 0x7f81f815e1c0 2024-03-24T10:36:29.231 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2024-03-24T10:36:29.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f81dc06b810 msgr2=0x7f81dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f81dc06b810 0x7f81dc06dcd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81f4036000 tx=0x7f81f4030000 comp rx=0 tx=0).stop 2024-03-24T10:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 msgr2=0x7f81f80cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80cddc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c480 tx=0x7f81f000c940 comp rx=0 tx=0).stop 2024-03-24T10:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 shutdown_connections 2024-03-24T10:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f81dc06b810 0x7f81dc06dcd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81f815e1c0 0x7f81f80cddc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f81f80d1c20 0x7f81f815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 --2- 172.21.15.72:0/2380126120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f81f80d0ef0 0x7f81f81f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.234+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 >> 172.21.15.72:0/2380126120 conn(0x7f81f80d3e40 msgr2=0x7f81f806bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.235+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 shutdown_connections 2024-03-24T10:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.236+0000 7f81ff817640 1 -- 172.21.15.72:0/2380126120 wait complete. 2024-03-24T10:36:29.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-24T10:36:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.364+0000 7fc7ee0eb640 1 Processor -- start 2024-03-24T10:36:29.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.364+0000 7fc7ee0eb640 1 -- start start 2024-03-24T10:36:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7ee0eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e815e300 0x7fc7e80d2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:29.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7ee0eb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7e80d07c0 0x7fc7e80d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7ee0eb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e80d1160 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7ee0eb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e80d0080 con 0x7fc7e80d07c0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7ee0eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e80cfe20 con 0x7fc7e815e300 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7e80d07c0 0x7fc7e80d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e6ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc7e80d4bc0 0x7fc7e80cf710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58100/0 (socket says 172.21.15.72:58100) 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e6ffd640 1 -- 172.21.15.72:0/2676277477 learned_addr learned my addr 172.21.15.72:0/2676277477 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e77fe640 1 --2- 172.21.15.72:0/2676277477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e815e300 0x7fc7e80d2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e7fff640 1 -- 172.21.15.72:0/2676277477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e815e300 msgr2=0x7fc7e80d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e7fff640 1 --2- 172.21.15.72:0/2676277477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e815e300 0x7fc7e80d2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e7fff640 1 -- 172.21.15.72:0/2676277477 >> v1:172.21.15.72:6789/0 conn(0x7fc7e80d4bc0 legacy=0x7fc7e80cf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.365+0000 7fc7e7fff640 1 -- 172.21.15.72:0/2676277477 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e80d2fd0 con 0x7fc7e80d07c0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.366+0000 7fc7e7fff640 1 --2- 172.21.15.72:0/2676277477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d07c0 0x7fc7e80d0c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009d90 tx=0x7fc7e002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94276a22fee8fc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.366+0000 7fc7e67fc640 1 -- 172.21.15.72:0/2676277477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e002cc50 con 0x7fc7e80d07c0 2024-03-24T10:36:29.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.366+0000 7fc7e67fc640 1 -- 172.21.15.72:0/2676277477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e002cdb0 con 0x7fc7e80d07c0 2024-03-24T10:36:29.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.366+0000 7fc7e67fc640 1 -- 172.21.15.72:0/2676277477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0034660 con 0x7fc7e80d07c0 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/2676277477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d07c0 msgr2=0x7fc7e80d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/2676277477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d07c0 0x7fc7e80d0c20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009d90 tx=0x7fc7e002bea0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/2676277477 shutdown_connections 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/2676277477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d07c0 0x7fc7e80d0c20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/2676277477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e815e300 0x7fc7e80d2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/2676277477 >> 172.21.15.72:0/2676277477 conn(0x7fc7e809d310 msgr2=0x7fc7e80d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/2676277477 shutdown_connections 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.367+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/2676277477 wait complete. 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.368+0000 7fc7ee0eb640 1 Processor -- start 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.368+0000 7fc7ee0eb640 1 -- start start 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e80d07c0 0x7fc7e8157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 0x7fc7e80cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:29.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e8157ce0 0x7fc7e80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e80b44a0 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e8157840 con 0x7fc7e8157ce0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e80b41c0 con 0x7fc7e80d07c0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 0x7fc7e80cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 0x7fc7e80cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44448/0 (socket says 172.21.15.72:44448) 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 -- 172.21.15.72:0/1628358889 learned_addr learned my addr 172.21.15.72:0/1628358889 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e77fe640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e80d07c0 0x7fc7e8157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e7fff640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e8157ce0 0x7fc7e80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 -- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e80d07c0 msgr2=0x7fc7e8157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e80d07c0 0x7fc7e8157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 -- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e8157ce0 msgr2=0x7fc7e80cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e8157ce0 0x7fc7e80cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 -- 172.21.15.72:0/1628358889 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e0009a70 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7e6ffd640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 0x7fc7e80cd200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00c400 tx=0x7fc7dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:29.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc005ce0 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7dc005e40 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e80b4980 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0072d0 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.369+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e80b4f40 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.371+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e80b47e0 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.371+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc7dc007450 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.371+0000 7fc7cffff640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc7d406b840 0x7fc7d406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.371+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fc7dc089a10 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.371+0000 7fc7e77fe640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc7d406b840 0x7fc7d406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:29.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.372+0000 7fc7e77fe640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc7d406b840 0x7fc7d406dd00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009b40 tx=0x7fc7d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:29.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.376+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc7e80b47e0 con 0x7fc7e80d4bc0 2024-03-24T10:36:29.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:29.545+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc7e80b47e0 con 0x7fc7e80d4bc0 2024-03-24T10:36:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.235+0000 7fc7cffff640 1 -- 172.21.15.72:0/1628358889 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fc7e80b47e0 con 0x7fc7e80d4bc0 2024-03-24T10:36:30.235 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 4 allow_ec_overwrites to true 2024-03-24T10:36:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.238+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc7d406b840 msgr2=0x7fc7d406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.238+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc7d406b840 0x7fc7d406dd00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009b40 tx=0x7fc7d8009190 comp rx=0 tx=0).stop 2024-03-24T10:36:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.238+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 msgr2=0x7fc7e80cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.238+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 0x7fc7e80cd200 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00c400 tx=0x7fc7dc00c8c0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.239+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 shutdown_connections 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.239+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc7d406b840 0x7fc7d406dd00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.239+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7e8157ce0 0x7fc7e80cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.239+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7e80d4bc0 0x7fc7e80cd200 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.239+0000 7fc7ee0eb640 1 --2- 172.21.15.72:0/1628358889 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc7e80d07c0 0x7fc7e8157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.239+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 >> 172.21.15.72:0/1628358889 conn(0x7fc7e809d310 msgr2=0x7fc7e8160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.240+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 shutdown_connections 2024-03-24T10:36:30.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.242+0000 7fc7ee0eb640 1 -- 172.21.15.72:0/1628358889 wait complete. 2024-03-24T10:36:30.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-24T10:36:30.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.372+0000 7f331b417640 1 Processor -- start 2024-03-24T10:36:30.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.372+0000 7f331b417640 1 -- start start 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f331b417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 0x7f33140d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f331b417640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f331406dd90 0x7f331406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f331b417640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33140d0970 con 0x7f331415bc10 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f331b417640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f331415f500 con 0x7f331406dd90 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f331b417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f331415ef40 con 0x7f33140d1150 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 0x7f33140d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33199b4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f331406dd90 0x7f331406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 0x7f33140d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:58380/0 (socket says 172.21.15.72:58380) 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 -- 172.21.15.72:0/2983337196 learned_addr learned my addr 172.21.15.72:0/2983337196 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 -- 172.21.15.72:0/2983337196 >> v2:172.21.15.79:3300/0 conn(0x7f331406dd90 msgr2=0x7f331406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 --2- 172.21.15.72:0/2983337196 >> v2:172.21.15.79:3300/0 conn(0x7f331406dd90 0x7f331406e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 -- 172.21.15.72:0/2983337196 >> v1:172.21.15.79:6789/0 conn(0x7f331415bc10 legacy=0x7f331415e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.373+0000 7f33189b2640 1 -- 172.21.15.72:0/2983337196 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331415f220 con 0x7f33140d1150 2024-03-24T10:36:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.374+0000 7f33189b2640 1 --2- 172.21.15.72:0/2983337196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 0x7f33140d15d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3304009870 tx=0x7f330402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a9a27b772e3b4aa server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.374+0000 7f330bfff640 1 -- 172.21.15.72:0/2983337196 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304030840 con 0x7f33140d1150 2024-03-24T10:36:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.374+0000 7f330bfff640 1 -- 172.21.15.72:0/2983337196 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33040309a0 con 0x7f33140d1150 2024-03-24T10:36:30.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.374+0000 7f330bfff640 1 -- 172.21.15.72:0/2983337196 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3304030d30 con 0x7f33140d1150 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 -- 172.21.15.72:0/2983337196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 msgr2=0x7f33140d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 --2- 172.21.15.72:0/2983337196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 0x7f33140d15d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3304009870 tx=0x7f330402b980 comp rx=0 tx=0).stop 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 -- 172.21.15.72:0/2983337196 shutdown_connections 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 --2- 172.21.15.72:0/2983337196 >> v2:172.21.15.79:3300/0 conn(0x7f331406dd90 0x7f331406e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 --2- 172.21.15.72:0/2983337196 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33140d1150 0x7f33140d15d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 -- 172.21.15.72:0/2983337196 >> 172.21.15.72:0/2983337196 conn(0x7f331406c240 msgr2=0x7f331406c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 -- 172.21.15.72:0/2983337196 shutdown_connections 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.375+0000 7f331b417640 1 -- 172.21.15.72:0/2983337196 wait complete. 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.376+0000 7f331b417640 1 Processor -- start 2024-03-24T10:36:30.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.376+0000 7f331b417640 1 -- start start 2024-03-24T10:36:30.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f331b417640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 0x7f331415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:30.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f331b417640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33140d1150 0x7f33140c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:30.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f331b417640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f331415bc10 0x7f331406e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:30.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f331b417640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f33141f37c0 con 0x7f331406dd90 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f331b417640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f331415ad50 con 0x7f33140d1150 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f331b417640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f33141393a0 con 0x7f331415bc10 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 0x7f331415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 0x7f331415a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44452/0 (socket says 172.21.15.72:44452) 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33189b2640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33140d1150 0x7f33140c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 -- 172.21.15.72:0/1479178898 learned_addr learned my addr 172.21.15.72:0/1479178898 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33199b4640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f331415bc10 0x7f331406e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 -- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f331415bc10 msgr2=0x7f331406e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f331415bc10 0x7f331406e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 -- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33140d1150 msgr2=0x7f33140c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33140d1150 0x7f33140c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33191b3640 1 -- 172.21.15.72:0/1479178898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33040094d0 con 0x7f331406dd90 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.377+0000 7f33199b4640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f331415bc10 0x7f331406e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:30.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.378+0000 7f33191b3640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 0x7f331415a810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f331000c730 tx=0x7f331000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.378+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310006d50 con 0x7f331406dd90 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.378+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331000ce40 con 0x7f331406dd90 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.378+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3314139680 con 0x7f331406dd90 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.378+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310003bb0 con 0x7f331406dd90 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.378+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3314139c40 con 0x7f331406dd90 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.379+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f331404f470 con 0x7f331406dd90 2024-03-24T10:36:30.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.379+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3310003d10 con 0x7f331406dd90 2024-03-24T10:36:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.379+0000 7f3309ffb640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f32f806b840 0x7f32f806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.380+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f3310089e90 con 0x7f331406dd90 2024-03-24T10:36:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.380+0000 7f33189b2640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f32f806b840 0x7f32f806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:30.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.380+0000 7f33189b2640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f32f806b840 0x7f32f806dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3304036000 tx=0x7f3304008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:30.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.384+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3310058200 con 0x7f331406dd90 2024-03-24T10:36:30.593 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:30.592+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f3314072910 con 0x7f331406dd90 2024-03-24T10:36:30.760 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T10:36:30.759+0000 7fd4fc039640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-24T10:36:31.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.236+0000 7f3309ffb640 1 -- 172.21.15.72:0/1479178898 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f3310057d90 con 0x7f331406dd90 2024-03-24T10:36:31.237 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 4 to fsmap 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f32f806b840 msgr2=0x7f32f806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f32f806b840 0x7f32f806dd00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3304036000 tx=0x7f3304008030 comp rx=0 tx=0).stop 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 msgr2=0x7f331415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 0x7f331415a810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f331000c730 tx=0x7f331000cbf0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 shutdown_connections 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f32f806b840 0x7f32f806dd00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f331415bc10 0x7f331406e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33140d1150 0x7f33140c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 --2- 172.21.15.72:0/1479178898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f331406dd90 0x7f331415a810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.239+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 >> 172.21.15.72:0/1479178898 conn(0x7f331406c240 msgr2=0x7f331406c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.240+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 shutdown_connections 2024-03-24T10:36:31.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.240+0000 7f331b417640 1 -- 172.21.15.72:0/1479178898 wait complete. 2024-03-24T10:36:31.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 Processor -- start 2024-03-24T10:36:31.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 -- start start 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f499015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 0x7f49900b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49900d4e50 con 0x7f49900d4930 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f49900cf790 con 0x7f49900d2450 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.354+0000 7f4994ac9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f49900cfa70 con 0x7f499015e170 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 0x7f49900b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498e59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f499015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498ed9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 0x7f49900b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:35326/0 (socket says 172.21.15.72:35326) 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498ed9d640 1 -- 172.21.15.72:0/2336014266 learned_addr learned my addr 172.21.15.72:0/2336014266 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f4987fff640 1 --1- 172.21.15.72:0/2336014266 >> v1:172.21.15.79:6789/0 conn(0x7f49900d4930 0x7f49900d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:52856/0 (socket says 172.21.15.72:52856) 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498e59c640 1 -- 172.21.15.72:0/2336014266 >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 msgr2=0x7f49900b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498e59c640 1 --2- 172.21.15.72:0/2336014266 >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 0x7f49900b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498e59c640 1 -- 172.21.15.72:0/2336014266 >> v1:172.21.15.79:6789/0 conn(0x7f49900d4930 legacy=0x7f49900d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498e59c640 1 -- 172.21.15.72:0/2336014266 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49900cfd50 con 0x7f499015e170 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.355+0000 7f498ed9d640 1 --2- 172.21.15.72:0/2336014266 >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 0x7f49900b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f498e59c640 1 --2- 172.21.15.72:0/2336014266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f499015e550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49800097a0 tx=0x7f498002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fff48a4d9f79bd3b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f498dd9b640 1 -- 172.21.15.72:0/2336014266 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f498002e070 con 0x7f499015e170 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f498dd9b640 1 -- 172.21.15.72:0/2336014266 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49800315a0 con 0x7f499015e170 2024-03-24T10:36:31.357 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f498dd9b640 1 -- 172.21.15.72:0/2336014266 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4980031930 con 0x7f499015e170 2024-03-24T10:36:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 -- 172.21.15.72:0/2336014266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 msgr2=0x7f499015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 --2- 172.21.15.72:0/2336014266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f499015e550 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f49800097a0 tx=0x7f498002b840 comp rx=0 tx=0).stop 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 -- 172.21.15.72:0/2336014266 shutdown_connections 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 --2- 172.21.15.72:0/2336014266 >> v2:172.21.15.79:3300/0 conn(0x7f49900d2450 0x7f49900b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 --2- 172.21.15.72:0/2336014266 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f499015e550 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 -- 172.21.15.72:0/2336014266 >> 172.21.15.72:0/2336014266 conn(0x7f499009d310 msgr2=0x7f49900d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 -- 172.21.15.72:0/2336014266 shutdown_connections 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.356+0000 7f4994ac9640 1 -- 172.21.15.72:0/2336014266 wait complete. 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 Processor -- start 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 -- start start 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900d2450 0x7f49900cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 0x7f499014f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f49900d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f49901505f0 con 0x7f49900d4930 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49900cb570 con 0x7f49900d2450 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.358+0000 7f4994ac9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f499014fce0 con 0x7f499015e170 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 0x7f499014f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f498e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900d2450 0x7f49900cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 0x7f499014f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44466/0 (socket says 172.21.15.72:44466) 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 -- 172.21.15.72:0/1148151152 learned_addr learned my addr 172.21.15.72:0/1148151152 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f498e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900d2450 0x7f49900cb030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:35340/0 (socket says 172.21.15.72:35340) 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f498ed9d640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f49900d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 -- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 msgr2=0x7f49900d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f49900d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 -- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900d2450 msgr2=0x7f49900cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900d2450 0x7f49900cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 -- 172.21.15.72:0/1148151152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4988009b30 con 0x7f49900d4930 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4987fff640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 0x7f499014f280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f497800c400 tx=0x7f497800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49780074e0 con 0x7f49900d4930 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978007640 con 0x7f49900d4930 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4980009400 con 0x7f49900d4930 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978004a00 con 0x7f49900d4930 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.359+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499014ff30 con 0x7f49900d4930 2024-03-24T10:36:31.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.360+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4990150730 con 0x7f49900d4930 2024-03-24T10:36:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.361+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4978004b60 con 0x7f49900d4930 2024-03-24T10:36:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.361+0000 7f4986ffd640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f497006b810 0x7f497006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.361+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4978089d40 con 0x7f49900d4930 2024-03-24T10:36:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.361+0000 7f498e59c640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f497006b810 0x7f497006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.361+0000 7f498e59c640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f497006b810 0x7f497006dcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4980036000 tx=0x7f498003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.366+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4990150730 con 0x7f49900d4930 2024-03-24T10:36:31.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.572+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4990150730 con 0x7f49900d4930 2024-03-24T10:36:31.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.572+0000 7f4986ffd640 1 -- 172.21.15.72:0/1148151152 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5168 (secure 0 0 0) 0x7f4990150730 con 0x7f49900d4930 2024-03-24T10:36:31.573 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:31.573 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:30.594205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:36:31.574 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 6 2024-03-24T10:36:31.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f497006b810 msgr2=0x7f497006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f497006b810 0x7f497006dcd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4980036000 tx=0x7f498003d040 comp rx=0 tx=0).stop 2024-03-24T10:36:31.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 msgr2=0x7f499014f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 0x7f499014f280 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f497800c400 tx=0x7f497800c8c0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 shutdown_connections 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f497006b810 0x7f497006dcd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f499015e170 0x7f49900d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49900d4930 0x7f499014f280 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 --2- 172.21.15.72:0/1148151152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49900d2450 0x7f49900cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 >> 172.21.15.72:0/1148151152 conn(0x7f499009d310 msgr2=0x7f499006c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.574+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 shutdown_connections 2024-03-24T10:36:31.576 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.575+0000 7f4994ac9640 1 -- 172.21.15.72:0/1148151152 wait complete. 2024-03-24T10:36:31.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:31.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.686+0000 7f6acb6b5640 1 Processor -- start 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.686+0000 7f6acb6b5640 1 -- start start 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6acb6b5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ac40d2870 0x7f6ac4166e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6acb6b5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40b3690 con 0x7f6ac40b2950 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6acb6b5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40b2780 con 0x7f6ac415f810 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6acb6b5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac40b2dd0 con 0x7f6ac40d2870 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6ac9c52640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ac40d2870 0x7f6ac4166e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6ac8c50640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6ac40b2950 0x7f6ac40af1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58304/0 (socket says 172.21.15.72:58304) 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6ac8c50640 1 -- 172.21.15.72:0/2214366847 learned_addr learned my addr 172.21.15.72:0/2214366847 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6ac9c52640 1 -- 172.21.15.72:0/2214366847 >> v1:172.21.15.79:6789/0 conn(0x7f6ac415f810 legacy=0x7f6ac40aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6ac9c52640 1 -- 172.21.15.72:0/2214366847 >> v1:172.21.15.72:6789/0 conn(0x7f6ac40b2950 legacy=0x7f6ac40af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6ac9c52640 1 -- 172.21.15.72:0/2214366847 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40d2cc0 con 0x7f6ac40d2870 2024-03-24T10:36:31.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.687+0000 7f6abbfff640 1 -- 172.21.15.72:0/2214366847 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033710812 0 0) 0x7f6ac40b3690 con 0x7f6ac40b2950 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6ac9c52640 1 --2- 172.21.15.72:0/2214366847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac4166e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d90 tx=0x7f6abc02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57204fe7b83c3108 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6abbfff640 1 -- 172.21.15.72:0/2214366847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc02cd80 con 0x7f6ac40d2870 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6abbfff640 1 -- 172.21.15.72:0/2214366847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6abc034440 con 0x7f6ac40d2870 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6abbfff640 1 -- 172.21.15.72:0/2214366847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0347d0 con 0x7f6ac40d2870 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6acb6b5640 1 -- 172.21.15.72:0/2214366847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 msgr2=0x7f6ac4166e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/2214366847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac4166e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009d90 tx=0x7f6abc02bfd0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6acb6b5640 1 -- 172.21.15.72:0/2214366847 shutdown_connections 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/2214366847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac4166e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.688+0000 7f6acb6b5640 1 -- 172.21.15.72:0/2214366847 >> 172.21.15.72:0/2214366847 conn(0x7f6ac40d1d50 msgr2=0x7f6ac40d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:31.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.689+0000 7f6acb6b5640 1 -- 172.21.15.72:0/2214366847 shutdown_connections 2024-03-24T10:36:31.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.689+0000 7f6acb6b5640 1 -- 172.21.15.72:0/2214366847 wait complete. 2024-03-24T10:36:31.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 Processor -- start 2024-03-24T10:36:31.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 -- start start 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ac40b2950 0x7f6ac41520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac40c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac415f810 0x7f6ac40c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40c6020 con 0x7f6ac40d2870 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac40c5d10 con 0x7f6ac415f810 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6acb6b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac40ca7b0 con 0x7f6ac40b2950 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6ac8c50640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac40c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6ac8c50640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac40c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50718/0 (socket says 172.21.15.72:50718) 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6ac8c50640 1 -- 172.21.15.72:0/803640360 learned_addr learned my addr 172.21.15.72:0/803640360 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6ac9451640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ac40b2950 0x7f6ac41520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.690+0000 7f6ac9c52640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac415f810 0x7f6ac40c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ac8c50640 1 -- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ac40b2950 msgr2=0x7f6ac41520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ac8c50640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ac40b2950 0x7f6ac41520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ac8c50640 1 -- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac415f810 msgr2=0x7f6ac40c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ac8c50640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac415f810 0x7f6ac40c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ac8c50640 1 -- 172.21.15.72:0/803640360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc009a70 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ac8c50640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac40c9950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c4a0 tx=0x7f6ab400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40074e0 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab4007640 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4004a00 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac40caa90 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.691+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac40cb050 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.692+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac40d01a0 con 0x7f6ac40d2870 2024-03-24T10:36:31.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.692+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6ab4004b60 con 0x7f6ac40d2870 2024-03-24T10:36:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.693+0000 7f6ab9ffb640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6aa806b810 0x7f6aa806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.693+0000 7f6ac9451640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6aa806b810 0x7f6aa806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.693+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6ab4089630 con 0x7f6ac40d2870 2024-03-24T10:36:31.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.693+0000 7f6ac9451640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6aa806b810 0x7f6aa806dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0000f60 tx=0x7f6ac0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.698+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6ab4053dc0 con 0x7f6ac40d2870 2024-03-24T10:36:31.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.873+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ac409fe20 con 0x7f6ac40d2870 2024-03-24T10:36:31.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.875+0000 7f6ab9ffb640 1 -- 172.21.15.72:0/803640360 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f6ab4057480 con 0x7f6ac40d2870 2024-03-24T10:36:31.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:31.876 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:31.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6aa806b810 msgr2=0x7f6aa806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6aa806b810 0x7f6aa806dcd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0000f60 tx=0x7f6ac0009040 comp rx=0 tx=0).stop 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 msgr2=0x7f6ac40c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac40c9950 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ab400c4a0 tx=0x7f6ab400c960 comp rx=0 tx=0).stop 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 shutdown_connections 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6aa806b810 0x7f6aa806dcd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ac415f810 0x7f6ac40c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ac40d2870 0x7f6ac40c9950 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 --2- 172.21.15.72:0/803640360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ac40b2950 0x7f6ac41520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 >> 172.21.15.72:0/803640360 conn(0x7f6ac40d1d50 msgr2=0x7f6ac415e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 shutdown_connections 2024-03-24T10:36:31.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.877+0000 7f6acb6b5640 1 -- 172.21.15.72:0/803640360 wait complete. 2024-03-24T10:36:31.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.991+0000 7fda5b283640 1 Processor -- start 2024-03-24T10:36:31.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.991+0000 7fda5b283640 1 -- start start 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda5b283640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda5406e680 0x7fda54070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda5b283640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda540725b0 con 0x7fda54071380 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda5b283640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda54071a10 con 0x7fda5415ae80 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda5b283640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda54071800 con 0x7fda5406e680 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda59820640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda54071380 0x7fda540ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58316/0 (socket says 172.21.15.72:58316) 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda59820640 1 -- 172.21.15.72:0/954606198 learned_addr learned my addr 172.21.15.72:0/954606198 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.992+0000 7fda5881e640 1 --2- 172.21.15.72:0/954606198 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda5406e680 0x7fda54070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4004363422 0 0) 0x7fda540725b0 con 0x7fda54071380 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda40003520 con 0x7fda54071380 2024-03-24T10:36:31.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425850614 0 0) 0x7fda54071a10 con 0x7fda5415ae80 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda540725b0 con 0x7fda5415ae80 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda5881e640 1 -- 172.21.15.72:0/954606198 >> v1:172.21.15.79:6789/0 conn(0x7fda5415ae80 legacy=0x7fda5406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda5881e640 1 -- 172.21.15.72:0/954606198 >> v1:172.21.15.72:6789/0 conn(0x7fda54071380 legacy=0x7fda540ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda5881e640 1 -- 172.21.15.72:0/954606198 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda5415b260 con 0x7fda5406e680 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.993+0000 7fda5881e640 1 --2- 172.21.15.72:0/954606198 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda5406e680 0x7fda54070e40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda440097d0 tx=0x7fda4402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=429f0a66244c7e6b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44031890 con 0x7fda5406e680 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda440319f0 con 0x7fda5406e680 2024-03-24T10:36:31.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda4bfff640 1 -- 172.21.15.72:0/954606198 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda44031d60 con 0x7fda5406e680 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 -- 172.21.15.72:0/954606198 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda5406e680 msgr2=0x7fda54070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 --2- 172.21.15.72:0/954606198 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda5406e680 0x7fda54070e40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda440097d0 tx=0x7fda4402b930 comp rx=0 tx=0).stop 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 -- 172.21.15.72:0/954606198 shutdown_connections 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 --2- 172.21.15.72:0/954606198 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda5406e680 0x7fda54070e40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 -- 172.21.15.72:0/954606198 >> 172.21.15.72:0/954606198 conn(0x7fda540b1920 msgr2=0x7fda540b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 -- 172.21.15.72:0/954606198 shutdown_connections 2024-03-24T10:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.994+0000 7fda5b283640 1 -- 172.21.15.72:0/954606198 wait complete. 2024-03-24T10:36:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.995+0000 7fda5b283640 1 Processor -- start 2024-03-24T10:36:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.995+0000 7fda5b283640 1 -- start start 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5b283640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 0x7fda5409d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5b283640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda54071380 0x7fda541f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5b283640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda5415ae80 0x7fda541f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5b283640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fda5409b690 con 0x7fda5406e680 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5b283640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda5415c0f0 con 0x7fda5415ae80 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5b283640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda5415c3d0 con 0x7fda54071380 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5901f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 0x7fda5409d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5901f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 0x7fda5409d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50724/0 (socket says 172.21.15.72:50724) 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5901f640 1 -- 172.21.15.72:0/591704224 learned_addr learned my addr 172.21.15.72:0/591704224 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5881e640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda54071380 0x7fda541f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda59820640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda5415ae80 0x7fda541f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.996+0000 7fda5901f640 1 -- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda54071380 msgr2=0x7fda541f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5901f640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda54071380 0x7fda541f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5901f640 1 -- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda5415ae80 msgr2=0x7fda541f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5901f640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda5415ae80 0x7fda541f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5901f640 1 -- 172.21.15.72:0/591704224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda44009400 con 0x7fda5406e680 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5901f640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 0x7fda5409d0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ea80 tx=0x7fda5000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda5000cde0 con 0x7fda5406e680 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda50003970 con 0x7fda5406e680 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50003d20 con 0x7fda5406e680 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda5415c6b0 con 0x7fda5406e680 2024-03-24T10:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.997+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda5415cc70 con 0x7fda5406e680 2024-03-24T10:36:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.998+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda5409e080 con 0x7fda5406e680 2024-03-24T10:36:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.998+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fda500050d0 con 0x7fda5406e680 2024-03-24T10:36:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.999+0000 7fda49ffb640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3806b810 0x7fda3806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.999+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda5008cab0 con 0x7fda5406e680 2024-03-24T10:36:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.999+0000 7fda5881e640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3806b810 0x7fda3806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:31.999+0000 7fda5881e640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3806b810 0x7fda3806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda44036000 tx=0x7fda4403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.003+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fda500571c0 con 0x7fda5406e680 2024-03-24T10:36:32.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.176+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda540b1600 con 0x7fda5406e680 2024-03-24T10:36:32.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.177+0000 7fda49ffb640 1 -- 172.21.15.72:0/591704224 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7fda5001f090 con 0x7fda5406e680 2024-03-24T10:36:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:32.178 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3806b810 msgr2=0x7fda3806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3806b810 0x7fda3806dcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda44036000 tx=0x7fda4403c040 comp rx=0 tx=0).stop 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 msgr2=0x7fda5409d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 0x7fda5409d0e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ea80 tx=0x7fda5000ef40 comp rx=0 tx=0).stop 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 shutdown_connections 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3806b810 0x7fda3806dcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda5415ae80 0x7fda541f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda54071380 0x7fda541f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 --2- 172.21.15.72:0/591704224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda5406e680 0x7fda5409d0e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 >> 172.21.15.72:0/591704224 conn(0x7fda540b1920 msgr2=0x7fda540ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 shutdown_connections 2024-03-24T10:36:32.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.179+0000 7fda5b283640 1 -- 172.21.15.72:0/591704224 wait complete. 2024-03-24T10:36:32.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:32.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.308+0000 7fb708a55640 1 Processor -- start 2024-03-24T10:36:32.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.308+0000 7fb708a55640 1 -- start start 2024-03-24T10:36:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.308+0000 7fb708a55640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb7040cde50 0x7fb704161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb708a55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb704162300 0x7fb70406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb708a55640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7040d0260 con 0x7fb70406ffd0 2024-03-24T10:36:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb708a55640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb7040cd440 con 0x7fb7040cde50 2024-03-24T10:36:32.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb708a55640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb7040d0500 con 0x7fb704162300 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb702d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb70406ffd0 0x7fb70415da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58330/0 (socket says 172.21.15.72:58330) 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb702d9d640 1 -- 172.21.15.72:0/3331094893 learned_addr learned my addr 172.21.15.72:0/3331094893 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb70259c640 1 --2- 172.21.15.72:0/3331094893 >> v2:172.21.15.79:3300/0 conn(0x7fb7040cde50 0x7fb704161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb6f9d9b640 1 --2- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb704162300 0x7fb70406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb701d9b640 1 -- 172.21.15.72:0/3331094893 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485218224 0 0) 0x7fb7040d0260 con 0x7fb70406ffd0 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb701d9b640 1 -- 172.21.15.72:0/3331094893 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6f0003520 con 0x7fb70406ffd0 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb70259c640 1 -- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb704162300 msgr2=0x7fb70406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb70259c640 1 --2- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb704162300 0x7fb70406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb70259c640 1 -- 172.21.15.72:0/3331094893 >> v1:172.21.15.72:6789/0 conn(0x7fb70406ffd0 legacy=0x7fb70415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.309+0000 7fb70259c640 1 -- 172.21.15.72:0/3331094893 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb704070460 con 0x7fb7040cde50 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb70259c640 1 --2- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7040cde50 0x7fb704161dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40097a0 tx=0x7fb6f402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8bab888d2a87d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb701d9b640 1 -- 172.21.15.72:0/3331094893 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4031830 con 0x7fb7040cde50 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb701d9b640 1 -- 172.21.15.72:0/3331094893 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f4031990 con 0x7fb7040cde50 2024-03-24T10:36:32.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb701d9b640 1 -- 172.21.15.72:0/3331094893 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4031d20 con 0x7fb7040cde50 2024-03-24T10:36:32.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 -- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7040cde50 msgr2=0x7fb704161dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 --2- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7040cde50 0x7fb704161dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40097a0 tx=0x7fb6f402b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 -- 172.21.15.72:0/3331094893 shutdown_connections 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 --2- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb704162300 0x7fb70406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 --2- 172.21.15.72:0/3331094893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7040cde50 0x7fb704161dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 -- 172.21.15.72:0/3331094893 >> 172.21.15.72:0/3331094893 conn(0x7fb7040b3930 msgr2=0x7fb7040b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 -- 172.21.15.72:0/3331094893 shutdown_connections 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.310+0000 7fb708a55640 1 -- 172.21.15.72:0/3331094893 wait complete. 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.312+0000 7fb708a55640 1 Processor -- start 2024-03-24T10:36:32.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.312+0000 7fb708a55640 1 -- start start 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70406ffd0 0x7fb70409f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 0x7fb7040aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb704162300 0x7fb70415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb70409ebf0 con 0x7fb7040cde50 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb70409f5c0 con 0x7fb704162300 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb70409e2c0 con 0x7fb70406ffd0 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 0x7fb7040aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.315 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 0x7fb7040aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50734/0 (socket says 172.21.15.72:50734) 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 -- 172.21.15.72:0/661829933 learned_addr learned my addr 172.21.15.72:0/661829933 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb70259c640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70406ffd0 0x7fb70409f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb702d9d640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb704162300 0x7fb70415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 -- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70406ffd0 msgr2=0x7fb70409f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70406ffd0 0x7fb70409f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 -- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb704162300 msgr2=0x7fb70415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb704162300 0x7fb70415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 -- 172.21.15.72:0/661829933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f4009400 con 0x7fb7040cde50 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6f9d9b640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 0x7fb7040aff90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00e9b0 tx=0x7fb6ec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec009670 con 0x7fb7040cde50 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec00c9a0 con 0x7fb7040cde50 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00cd50 con 0x7fb7040cde50 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70409e5a0 con 0x7fb7040cde50 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.313+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7041f8680 con 0x7fb7040cde50 2024-03-24T10:36:32.316 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.314+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70409ed60 con 0x7fb7040cde50 2024-03-24T10:36:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.315+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb6ec013470 con 0x7fb7040cde50 2024-03-24T10:36:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.315+0000 7fb6fb7fe640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6e406b810 0x7fb6e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.315+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb6ec08a620 con 0x7fb7040cde50 2024-03-24T10:36:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.315+0000 7fb70259c640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6e406b810 0x7fb6e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.316+0000 7fb70259c640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6e406b810 0x7fb6e406dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4036000 tx=0x7fb6f403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.320+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb6ec054e40 con 0x7fb7040cde50 2024-03-24T10:36:32.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.527+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb70409ff20 con 0x7fb7040cde50 2024-03-24T10:36:32.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.527+0000 7fb6fb7fe640 1 -- 172.21.15.72:0/661829933 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5168 (secure 0 0 0) 0x7fb6ec058500 con 0x7fb7040cde50 2024-03-24T10:36:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:32.527 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:30.594205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:36:32.527 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 6 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6e406b810 msgr2=0x7fb6e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6e406b810 0x7fb6e406dcd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4036000 tx=0x7fb6f403c040 comp rx=0 tx=0).stop 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 msgr2=0x7fb7040aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 0x7fb7040aff90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00e9b0 tx=0x7fb6ec00ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 shutdown_connections 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6e406b810 0x7fb6e406dcd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb704162300 0x7fb70415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7040cde50 0x7fb7040aff90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 --2- 172.21.15.72:0/661829933 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb70406ffd0 0x7fb70409f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 >> 172.21.15.72:0/661829933 conn(0x7fb7040b3930 msgr2=0x7fb70406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:32.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 shutdown_connections 2024-03-24T10:36:32.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.529+0000 7fb708a55640 1 -- 172.21.15.72:0/661829933 wait complete. 2024-03-24T10:36:32.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.641+0000 7f9398faf640 1 Processor -- start 2024-03-24T10:36:32.641 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.641+0000 7f9398faf640 1 -- start start 2024-03-24T10:36:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9398faf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9394155040 0x7f9394071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9398faf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93940ae570 0x7f9394071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9398faf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f939406d780 0x7f939406db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9398faf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f93940ad840 con 0x7f939406d780 2024-03-24T10:36:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9398faf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f939406e4f0 con 0x7f93940ae570 2024-03-24T10:36:32.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9398faf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f93940ada90 con 0x7f9394155040 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f939406d780 0x7f939406db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f939406d780 0x7f939406db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50744/0 (socket says 172.21.15.72:50744) 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f939259c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9394155040 0x7f9394071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 -- 172.21.15.72:0/3778168214 learned_addr learned my addr 172.21.15.72:0/3778168214 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f938bfff640 1 --2- 172.21.15.72:0/3778168214 >> v2:172.21.15.79:3300/0 conn(0x7f93940ae570 0x7f9394071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 -- 172.21.15.72:0/3778168214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9394155040 msgr2=0x7f9394071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 --2- 172.21.15.72:0/3778168214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9394155040 0x7f9394071670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 -- 172.21.15.72:0/3778168214 >> v2:172.21.15.79:3300/0 conn(0x7f93940ae570 msgr2=0x7f9394071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 --2- 172.21.15.72:0/3778168214 >> v2:172.21.15.79:3300/0 conn(0x7f93940ae570 0x7f9394071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f9392d9d640 1 -- 172.21.15.72:0/3778168214 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93940add70 con 0x7f939406d780 2024-03-24T10:36:32.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f938bfff640 1 --2- 172.21.15.72:0/3778168214 >> v2:172.21.15.79:3300/0 conn(0x7f93940ae570 0x7f9394071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.642+0000 7f939259c640 1 --2- 172.21.15.72:0/3778168214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9394155040 0x7f9394071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.643+0000 7f9392d9d640 1 --2- 172.21.15.72:0/3778168214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939406d780 0x7f939406db80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93940744d0 tx=0x7f938c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8f06ee07e6257e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.643+0000 7f9391d9b640 1 -- 172.21.15.72:0/3778168214 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c02c9e0 con 0x7f939406d780 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.643+0000 7f9391d9b640 1 -- 172.21.15.72:0/3778168214 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c02cb40 con 0x7f939406d780 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.643+0000 7f9391d9b640 1 -- 172.21.15.72:0/3778168214 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0343f0 con 0x7f939406d780 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 -- 172.21.15.72:0/3778168214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939406d780 msgr2=0x7f939406db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 --2- 172.21.15.72:0/3778168214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939406d780 0x7f939406db80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f93940744d0 tx=0x7f938c02be40 comp rx=0 tx=0).stop 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 -- 172.21.15.72:0/3778168214 shutdown_connections 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 --2- 172.21.15.72:0/3778168214 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f939406d780 0x7f939406db80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 --2- 172.21.15.72:0/3778168214 >> v2:172.21.15.79:3300/0 conn(0x7f93940ae570 0x7f9394071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.645 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 --2- 172.21.15.72:0/3778168214 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9394155040 0x7f9394071670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 -- 172.21.15.72:0/3778168214 >> 172.21.15.72:0/3778168214 conn(0x7f939406b310 msgr2=0x7f939406b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 -- 172.21.15.72:0/3778168214 shutdown_connections 2024-03-24T10:36:32.646 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.644+0000 7f9398faf640 1 -- 172.21.15.72:0/3778168214 wait complete. 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.645+0000 7f9398faf640 1 Processor -- start 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.645+0000 7f9398faf640 1 -- start start 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939406d780 0x7f939415e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 0x7f939415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394155040 0x7f93940b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93941f7680 con 0x7f93940ae570 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f939415f1d0 con 0x7f9394155040 2024-03-24T10:36:32.649 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f939415f4b0 con 0x7f939406d780 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 0x7f939415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 0x7f939415eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50760/0 (socket says 172.21.15.72:50760) 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 -- 172.21.15.72:0/767222878 learned_addr learned my addr 172.21.15.72:0/767222878 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f939259c640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939406d780 0x7f939415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9392d9d640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394155040 0x7f93940b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 -- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939406d780 msgr2=0x7f939415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939406d780 0x7f939415e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 -- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394155040 msgr2=0x7f93940b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394155040 0x7f93940b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 -- 172.21.15.72:0/767222878 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937c009400 con 0x7f93940ae570 2024-03-24T10:36:32.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9392d9d640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394155040 0x7f93940b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938bfff640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 0x7f939415eba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f937c00e960 tx=0x7f937c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c00ca00 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f937c00cb60 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937c013470 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9384009400 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.646+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938c009b30 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.647+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939406c0c0 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.648+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f937c0135d0 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.648+0000 7f938affd640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f937406b810 0x7f937406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.648+0000 7f939259c640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f937406b810 0x7f937406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.648+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f937c08a6a0 con 0x7f93940ae570 2024-03-24T10:36:32.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.648+0000 7f939259c640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f937406b810 0x7f937406dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9384009c50 tx=0x7f9384009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:32.652 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.652+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f937c054e30 con 0x7f93940ae570 2024-03-24T10:36:32.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.824+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9394072e80 con 0x7f93940ae570 2024-03-24T10:36:32.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.825+0000 7f938affd640 1 -- 172.21.15.72:0/767222878 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f937c0584f0 con 0x7f93940ae570 2024-03-24T10:36:32.825 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:32.826 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f937406b810 msgr2=0x7f937406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f937406b810 0x7f937406dcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9384009c50 tx=0x7f9384009190 comp rx=0 tx=0).stop 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 msgr2=0x7f939415eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 0x7f939415eba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f937c00e960 tx=0x7f937c00ee20 comp rx=0 tx=0).stop 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 shutdown_connections 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f937406b810 0x7f937406dcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9394155040 0x7f93940b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93940ae570 0x7f939415eba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 --2- 172.21.15.72:0/767222878 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f939406d780 0x7f939415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 >> 172.21.15.72:0/767222878 conn(0x7f939406b310 msgr2=0x7f9394071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:32.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 shutdown_connections 2024-03-24T10:36:32.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:32.827+0000 7f9398faf640 1 -- 172.21.15.72:0/767222878 wait complete. 2024-03-24T10:36:33.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-24T10:36:25.553252+0000', 'modified': '2024-03-24T10:36:30.594205+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/68214934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 68214934}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 68214934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-03-24T10:36:33.241 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-24T10:36:33.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-24T10:36:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.343+0000 7fe7d9d3e640 1 Processor -- start 2024-03-24T10:36:33.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.343+0000 7fe7d9d3e640 1 -- start start 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d9d3e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7d40cffc0 0x7fe7d40d0420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d9d3e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d406cb20 con 0x7fe7d406cfb0 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d9d3e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d40cf170 con 0x7fe7d415e260 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d9d3e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d40cf730 con 0x7fe7d40cffc0 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d2ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7d40cffc0 0x7fe7d40d0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d3fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe7d406cfb0 0x7fe7d40d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58342/0 (socket says 172.21.15.72:58342) 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d3fff640 1 -- 172.21.15.72:0/1689028946 learned_addr learned my addr 172.21.15.72:0/1689028946 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d2ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe7d40cffc0 0x7fe7d40d0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50770/0 (socket says 172.21.15.72:50770) 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1689028946 >> v1:172.21.15.79:6789/0 conn(0x7fe7d415e260 legacy=0x7fe7d40ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1689028946 >> v1:172.21.15.72:6789/0 conn(0x7fe7d406cfb0 legacy=0x7fe7d40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d27fc640 1 -- 172.21.15.72:0/1689028946 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079388735 0 0) 0x7fe7d40cf170 con 0x7fe7d415e260 2024-03-24T10:36:33.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.344+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1689028946 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d40cf450 con 0x7fe7d40cffc0 2024-03-24T10:36:33.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.345+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1689028946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d40d0420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80097a0 tx=0x7fe7c802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda11e2ac3068fba server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.345+0000 7fe7d27fc640 1 -- 172.21.15.72:0/1689028946 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8030710 con 0x7fe7d40cffc0 2024-03-24T10:36:33.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.345+0000 7fe7d27fc640 1 -- 172.21.15.72:0/1689028946 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c802e050 con 0x7fe7d40cffc0 2024-03-24T10:36:33.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.345+0000 7fe7d27fc640 1 -- 172.21.15.72:0/1689028946 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8030a90 con 0x7fe7d40cffc0 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1689028946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 msgr2=0x7fe7d40d0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1689028946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d40d0420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80097a0 tx=0x7fe7c802b710 comp rx=0 tx=0).stop 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1689028946 shutdown_connections 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1689028946 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d40d0420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1689028946 >> 172.21.15.72:0/1689028946 conn(0x7fe7d409a9d0 msgr2=0x7fe7d409ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1689028946 shutdown_connections 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.346+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1689028946 wait complete. 2024-03-24T10:36:33.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.347+0000 7fe7d9d3e640 1 Processor -- start 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.347+0000 7fe7d9d3e640 1 -- start start 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d9d3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d406cfb0 0x7fe7d409df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d9d3e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d9d3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d415e260 0x7fe7d409eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d9d3e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d409e460 con 0x7fe7d40cffc0 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d9d3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d4150810 con 0x7fe7d415e260 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d9d3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d409da90 con 0x7fe7d406cfb0 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50776/0 (socket says 172.21.15.72:50776) 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1443648922 learned_addr learned my addr 172.21.15.72:0/1443648922 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d406cfb0 0x7fe7d409df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d3fff640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d415e260 0x7fe7d409eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d406cfb0 msgr2=0x7fe7d409df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d406cfb0 0x7fe7d409df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d415e260 msgr2=0x7fe7d409eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d415e260 0x7fe7d409eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1443648922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c8009400 con 0x7fe7d40cffc0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.348+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d414fc30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8000c00 tx=0x7fe7c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.349+0000 7fe7bbfff640 1 -- 172.21.15.72:0/1443648922 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c80329d0 con 0x7fe7d40cffc0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.349+0000 7fe7bbfff640 1 -- 172.21.15.72:0/1443648922 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c8032b50 con 0x7fe7d40cffc0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.349+0000 7fe7bbfff640 1 -- 172.21.15.72:0/1443648922 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c803b400 con 0x7fe7d40cffc0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.349+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d40cef40 con 0x7fe7d40cffc0 2024-03-24T10:36:33.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.349+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d409d160 con 0x7fe7d40cffc0 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.350+0000 7fe7bbfff640 1 -- 172.21.15.72:0/1443648922 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe7c8039040 con 0x7fe7d40cffc0 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.351+0000 7fe7bbfff640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe7c006b810 0x7fe7c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.351+0000 7fe7bbfff640 1 -- 172.21.15.72:0/1443648922 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7c80abdb0 con 0x7fe7d40cffc0 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.351+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe7c006b810 0x7fe7c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.351+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe7c006b810 0x7fe7c006dcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4000f60 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.352+0000 7fe7dca01740 1 Processor -- start 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.352+0000 7fe7dca01740 1 -- start start 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df5610 0x557ac6dc85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6df83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dc8af0 0x557ac6df88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7dca01740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557ac6d3c180 con 0x557ac6df59f0 2024-03-24T10:36:33.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ac6d396b0 con 0x557ac6df5610 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x557ac6d34e90 con 0x557ac6dc8af0 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6df83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6df83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50778/0 (socket says 172.21.15.72:50778) 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2772111873 learned_addr learned my addr 172.21.15.72:0/2772111873 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df5610 0x557ac6dc85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d3fff640 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dc8af0 0x557ac6df88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dc8af0 msgr2=0x557ac6df88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dc8af0 0x557ac6df88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df5610 msgr2=0x557ac6dc85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df5610 0x557ac6dc85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2772111873 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac6cf1d80 con 0x557ac6df59f0 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6df83a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80823d0 tx=0x7fe7c8079c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15096bffe6fd8f3b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7b97fa640 1 -- 172.21.15.72:0/2772111873 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8082900 con 0x557ac6df59f0 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7b97fa640 1 -- 172.21.15.72:0/2772111873 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c80785a0 con 0x557ac6df59f0 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.353+0000 7fe7b97fa640 1 -- 172.21.15.72:0/2772111873 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8082470 con 0x557ac6df59f0 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 -- 172.21.15.72:0/2772111873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 msgr2=0x557ac6df83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6df83a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe7c80823d0 tx=0x7fe7c8079c00 comp rx=0 tx=0).stop 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 -- 172.21.15.72:0/2772111873 shutdown_connections 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dc8af0 0x557ac6df88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6df83a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2772111873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df5610 0x557ac6dc85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 -- 172.21.15.72:0/2772111873 >> 172.21.15.72:0/2772111873 conn(0x557ac6dca820 msgr2=0x557ac6e133a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 -- 172.21.15.72:0/2772111873 shutdown_connections 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.354+0000 7fe7dca01740 1 -- 172.21.15.72:0/2772111873 wait complete. 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 -- start start 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 Processor -- start 2024-03-24T10:36:33.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 0x557ac6ded660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df59f0 0x557ac6dfaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dfb450 0x557ac6e11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557ac6cd9d50 con 0x557ac6df5610 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ac6a08310 con 0x557ac6df59f0 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x557ac6cba8f0 con 0x557ac6dfb450 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7dca01740 10 client.0 _ll_register_callbacks cb 0x557ac6a45ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7d37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 0x557ac6ded660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7d37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 0x557ac6ded660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50794/0 (socket says 172.21.15.72:50794) 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7d37fe640 1 -- 172.21.15.72:0/3585448955 learned_addr learned my addr 172.21.15.72:0/3585448955 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7d3fff640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dfb450 0x557ac6e11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.355+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df59f0 0x557ac6dfaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7d37fe640 1 -- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dfb450 msgr2=0x557ac6e11510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dfb450 0x557ac6e11510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7d37fe640 1 -- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df59f0 msgr2=0x557ac6dfaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df59f0 0x557ac6dfaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7d37fe640 1 -- 172.21.15.72:0/3585448955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d409d160 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 0x557ac6ded660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4014700 tx=0x7fe7c4001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ce2b866fdfc3ea server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7b27fc640 1 -- 172.21.15.72:0/3585448955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4013680 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7b27fc640 1 -- 172.21.15.72:0/3585448955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7c401c040 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557ac6a346c0 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7b27fc640 1 -- 172.21.15.72:0/3585448955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe7c40137e0 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 10 client.4434 fetch_fsmap learned FSMap version 6 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557ac6d33510 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7b27fc640 1 -- 172.21.15.72:0/3585448955 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x557ac6a346c0 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7b27fc640 1 -- 172.21.15.72:0/3585448955 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fe7c4012070 con 0x557ac6df5610 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 10 client.4434 fetch_fsmap finished waiting for FSMap version 6 2024-03-24T10:36:33.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 10 client.4434 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 20 client.4434 populate_metadata read hostname 'smithi072' 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e2e5d0 0x557ac6e309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 4 client.4434 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.356+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 --> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ac6a85270 con 0x557ac6e2e5d0 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.357+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e2e5d0 0x557ac6e309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.357+0000 7fe7b27fc640 10 client.4434 ms_handle_connect on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.357+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e2e5d0 0x557ac6e309c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2fd6973ea8f02 server_cookie=925d0b766bc5556e in_seq=0 out_seq=0 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7b27fc640 1 -- 172.21.15.72:0/3585448955 <== mds.0 v2:172.21.15.79:6833/68214934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x557ac6a85270 con 0x557ac6e2e5d0 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7b27fc640 10 client.4434 handle_command_reply: tid=0 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 client.4434 shutdown 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 msgr2=0x557ac6ded660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 0x557ac6ded660 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4014700 tx=0x7fe7c4001080 comp rx=0 tx=0).stop 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 shutdown_connections 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6dfb450 0x557ac6e11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6df59f0 0x557ac6dfaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e2e5d0 0x557ac6e309c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 --2- 172.21.15.72:0/3585448955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df5610 0x557ac6ded660 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7b27fc640 0 client.4434 ms_handle_reset on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 >> 172.21.15.72:0/3585448955 conn(0x557ac6dc8af0 msgr2=0x557ac6dcc530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 shutdown_connections 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 1 -- 172.21.15.72:0/3585448955 wait complete. 2024-03-24T10:36:33.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.358+0000 7fe7dca01740 20 client.4434 trim_cache size 0 max 16384 2024-03-24T10:36:33.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.376+0000 7fe7dca01740 1 Processor -- start 2024-03-24T10:36:33.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.376+0000 7fe7dca01740 1 -- start start 2024-03-24T10:36:33.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6dc38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6e168b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6e16df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7dca01740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557ac6df5270 con 0x557ac6df59f0 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ac6dfa550 con 0x557ac6dfb450 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x557ac6e2cf50 con 0x557ac6df5610 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6e168b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6e168b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50808/0 (socket says 172.21.15.72:50808) 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2232088770 learned_addr learned my addr 172.21.15.72:0/2232088770 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6dc38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d3fff640 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6e16df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 msgr2=0x557ac6dc38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6dc38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 msgr2=0x557ac6e16df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6e16df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/2232088770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ac6ccfa80 con 0x557ac6df59f0 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6e168b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8076700 tx=0x7fe7c807d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a5f560248cdad5 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7b8ff9640 1 -- 172.21.15.72:0/2232088770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8076910 con 0x557ac6df59f0 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7b8ff9640 1 -- 172.21.15.72:0/2232088770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c8076a70 con 0x557ac6df59f0 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.377+0000 7fe7b8ff9640 1 -- 172.21.15.72:0/2232088770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8082690 con 0x557ac6df59f0 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 -- 172.21.15.72:0/2232088770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 msgr2=0x557ac6e168b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6e168b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8076700 tx=0x7fe7c807d000 comp rx=0 tx=0).stop 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 -- 172.21.15.72:0/2232088770 shutdown_connections 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6e16df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6e168b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 --2- 172.21.15.72:0/2232088770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6dc38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 -- 172.21.15.72:0/2232088770 >> 172.21.15.72:0/2232088770 conn(0x557ac6dc8af0 msgr2=0x557ac6dfacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 -- 172.21.15.72:0/2232088770 shutdown_connections 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.378+0000 7fe7dca01740 1 -- 172.21.15.72:0/2232088770 wait complete. 2024-03-24T10:36:33.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 -- start start 2024-03-24T10:36:33.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 Processor -- start 2024-03-24T10:36:33.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6e93f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6dea190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6dea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x557ac6df3890 con 0x557ac6df59f0 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557ac6dc8990 con 0x557ac6dfb450 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x557ac6df4f20 con 0x557ac6df5610 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.379+0000 7fe7dca01740 10 client.0 _ll_register_callbacks cb 0x7fe7c4001de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6dea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6dea190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50810/0 (socket says 172.21.15.72:50810) 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1385751673 learned_addr learned my addr 172.21.15.72:0/1385751673 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6e93f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d3fff640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6dea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 msgr2=0x557ac6e93f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6e93f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 msgr2=0x557ac6dea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6dea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 -- 172.21.15.72:0/1385751673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ac6cf1d80 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7d2ffd640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6dea190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7c802b750 tx=0x7fe7c8006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44928de8d0fc4ba4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7b27fc640 1 -- 172.21.15.72:0/1385751673 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8076910 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7b27fc640 1 -- 172.21.15.72:0/1385751673 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7c8082470 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c80785a0 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7b27fc640 1 -- 172.21.15.72:0/1385751673 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe7c8082630 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 10 client.4440 fetch_fsmap learned FSMap version 6 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557ac6cf57e0 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7b27fc640 1 -- 172.21.15.72:0/1385751673 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c8086080 con 0x557ac6df59f0 2024-03-24T10:36:33.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7b27fc640 1 -- 172.21.15.72:0/1385751673 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7fe7c8082b50 con 0x557ac6df59f0 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 10 client.4440 fetch_fsmap finished waiting for FSMap version 6 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 10 client.4440 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 20 client.4440 populate_metadata read hostname 'smithi072' 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e14930 0x557ac6e14d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 4 client.4440 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.380+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 --> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] -- command(tid 0: {"prefix": "status"}) -- 0x557ac6a71610 con 0x557ac6e14930 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e14930 0x557ac6e14d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7b27fc640 10 client.4440 ms_handle_connect on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7d37fe640 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e14930 0x557ac6e14d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc4cb6bdafed532 server_cookie=f76281aa6ad78aad in_seq=0 out_seq=0 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7b27fc640 1 -- 172.21.15.72:0/1385751673 <== mds.0 v2:172.21.15.79:6833/68214934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x557ac6a71610 con 0x557ac6e14930 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7b27fc640 10 client.4440 handle_command_reply: tid=0 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 client.4440 shutdown 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 msgr2=0x557ac6dea190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6dea190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7c802b750 tx=0x7fe7c8006ef0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 shutdown_connections 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557ac6dfb450 0x557ac6dea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x557ac6e14930 0x557ac6e14d10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x557ac6df59f0 0x557ac6dea190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 --2- 172.21.15.72:0/1385751673 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x557ac6df5610 0x557ac6e93f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7b27fc640 0 client.4440 ms_handle_reset on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 >> 172.21.15.72:0/1385751673 conn(0x557ac6dc8af0 msgr2=0x557ac6e168b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 shutdown_connections 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 1 -- 172.21.15.72:0/1385751673 wait complete. 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.381+0000 7fe7dca01740 20 client.4440 trim_cache size 0 max 16384 2024-03-24T10:36:33.388 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "0cd6a1e7-49c4-4ce2-8320-31fe22775d9b", 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4288, 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 7.1630272899999996, 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 6, 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 24, 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 13.626999107 2024-03-24T10:36:33.389 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-24T10:36:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe7c006b810 msgr2=0x7fe7c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe7c006b810 0x7fe7c006dcd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4000f60 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2024-03-24T10:36:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 msgr2=0x7fe7d414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d414fc30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8000c00 tx=0x7fe7c80046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 shutdown_connections 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe7c006b810 0x7fe7c006dcd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7d415e260 0x7fe7d409eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe7d40cffc0 0x7fe7d414fc30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 --2- 172.21.15.72:0/1443648922 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe7d406cfb0 0x7fe7d409df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 >> 172.21.15.72:0/1443648922 conn(0x7fe7d409a9d0 msgr2=0x7fe7d409af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 shutdown_connections 2024-03-24T10:36:33.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.382+0000 7fe7d9d3e640 1 -- 172.21.15.72:0/1443648922 wait complete. 2024-03-24T10:36:33.392 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-24T10:36:33.392 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:33.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:36:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.493+0000 7f72c9edf640 1 Processor -- start 2024-03-24T10:36:33.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.493+0000 7f72c9edf640 1 -- start start 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c9edf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c415e430 0x7f72c406fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c9edf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f72c41628c0 0x7f72c406d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c9edf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72c406cb70 con 0x7f72c4161d20 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c9edf640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f72c4070390 con 0x7f72c41628c0 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c9edf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f72c406c240 con 0x7f72c415e430 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c37fe640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f72c4161d20 0x7f72c4162100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:58716/0 (socket says 172.21.15.72:58716) 2024-03-24T10:36:33.494 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c37fe640 1 -- 172.21.15.72:0/472181942 learned_addr learned my addr 172.21.15.72:0/472181942 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c3fff640 1 --2- 172.21.15.72:0/472181942 >> v2:172.21.15.79:3300/0 conn(0x7f72c41628c0 0x7f72c406d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.494+0000 7f72c2ffd640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c415e430 0x7f72c406fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c3fff640 1 -- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c415e430 msgr2=0x7f72c406fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c3fff640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c415e430 0x7f72c406fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c3fff640 1 -- 172.21.15.72:0/472181942 >> v1:172.21.15.79:6789/0 conn(0x7f72c4161d20 legacy=0x7f72c4162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c3fff640 1 -- 172.21.15.72:0/472181942 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c406c520 con 0x7f72c41628c0 2024-03-24T10:36:33.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c2ffd640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c415e430 0x7f72c406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c3fff640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c41628c0 0x7f72c406d000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009d90 tx=0x7f72bc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=445b5d5c03305d4f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c27fc640 1 -- 172.21.15.72:0/472181942 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc02cc50 con 0x7f72c41628c0 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.495+0000 7f72c27fc640 1 -- 172.21.15.72:0/472181942 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72bc02cdb0 con 0x7f72c41628c0 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c27fc640 1 -- 172.21.15.72:0/472181942 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72bc034660 con 0x7f72c41628c0 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 -- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c41628c0 msgr2=0x7f72c406d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c41628c0 0x7f72c406d000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009d90 tx=0x7f72bc02bea0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 -- 172.21.15.72:0/472181942 shutdown_connections 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c41628c0 0x7f72c406d000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 --2- 172.21.15.72:0/472181942 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c415e430 0x7f72c406fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 -- 172.21.15.72:0/472181942 >> 172.21.15.72:0/472181942 conn(0x7f72c40b38d0 msgr2=0x7f72c40b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 -- 172.21.15.72:0/472181942 shutdown_connections 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.496+0000 7f72c9edf640 1 -- 172.21.15.72:0/472181942 wait complete. 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.497+0000 7f72c9edf640 1 Processor -- start 2024-03-24T10:36:33.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.497+0000 7f72c9edf640 1 -- start start 2024-03-24T10:36:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c9edf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 0x7f72c40b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c9edf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c41628c0 0x7f72c414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c9edf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c40b74d0 0x7f72c414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c9edf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f72c40b70b0 con 0x7f72c4161d20 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c9edf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f72c40cec90 con 0x7f72c40b74d0 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c9edf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f72c414f5f0 con 0x7f72c41628c0 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 0x7f72c40b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 0x7f72c40b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50824/0 (socket says 172.21.15.72:50824) 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 -- 172.21.15.72:0/1329590004 learned_addr learned my addr 172.21.15.72:0/1329590004 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c3fff640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c40b74d0 0x7f72c414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c2ffd640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c41628c0 0x7f72c414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 -- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c41628c0 msgr2=0x7f72c414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c41628c0 0x7f72c414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 -- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c40b74d0 msgr2=0x7f72c414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c40b74d0 0x7f72c414ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.498+0000 7f72c37fe640 1 -- 172.21.15.72:0/1329590004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b8009400 con 0x7f72c4161d20 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.499+0000 7f72c37fe640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 0x7f72c40b4870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c400 tx=0x7f72b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.499+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b4005ce0 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.499+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b4005e40 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.499+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc009a70 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.499+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b40072d0 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.499+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c40b6cd0 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.500+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c409ff30 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.500+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f72b4007430 con 0x7f72c4161d20 2024-03-24T10:36:33.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.500+0000 7f72abfff640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f72b006b840 0x7f72b006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.501+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f72b4089b10 con 0x7f72c4161d20 2024-03-24T10:36:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.501+0000 7f72c2ffd640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f72b006b840 0x7f72b006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:33.502 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.501+0000 7f72c2ffd640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f72b006b840 0x7f72b006dd00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72c41e8330 tx=0x7f72b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:33.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.505+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f72b4054220 con 0x7f72c4161d20 2024-03-24T10:36:33.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.713+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f72c40cf6b0 con 0x7f72c4161d20 2024-03-24T10:36:33.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.714+0000 7f72abfff640 1 -- 172.21.15.72:0/1329590004 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f72b4017070 con 0x7f72c4161d20 2024-03-24T10:36:33.713 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-24T10:36:33.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f72b006b840 msgr2=0x7f72b006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f72b006b840 0x7f72b006dd00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f72c41e8330 tx=0x7f72b8009190 comp rx=0 tx=0).stop 2024-03-24T10:36:33.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 msgr2=0x7f72c40b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 0x7f72c40b4870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f72b400c400 tx=0x7f72b400c8c0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 shutdown_connections 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f72b006b840 0x7f72b006dd00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f72c40b74d0 0x7f72c414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.715+0000 7f72c9edf640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f72c41628c0 0x7f72c414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.716+0000 7f72c9edf640 1 --2- 172.21.15.72:0/1329590004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f72c4161d20 0x7f72c40b4870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.716+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 >> 172.21.15.72:0/1329590004 conn(0x7f72c40b38d0 msgr2=0x7f72c40cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.716+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 shutdown_connections 2024-03-24T10:36:33.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33.716+0000 7f72c9edf640 1 -- 172.21.15.72:0/1329590004 wait complete. 2024-03-24T10:36:33.726 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-24T10:36:33.726 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:36:33.726 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-03-24T10:36:33.726 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-24T10:36:33.727 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:33.727 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-24T10:36:33.727 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-24T10:36:33.727 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:36:33.727 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-24T10:36:33.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:33.727 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-03-24T10:36:33.742 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42691sec preferred_lft 42691sec 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-24T10:36:33.743 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:36:33.744 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-24T10:36:33.744 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:36:33.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:36:33.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:33.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:33.943 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:36:33.970 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-03-24T10:36:33.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:33.972 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-03-24T10:36:34.043 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-03-24T10:36:34.043 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:36:34.043 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:36:34.043 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:36:34.044 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:36:34.045 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:36:34.045 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:36:34.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:36:34.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:36:34.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:36:34.045 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:36:34.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:36:34.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:34.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:34.407 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-24T10:36:34.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:34.423 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-03-24T10:36:34.479 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:36:34.479 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:36:34.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-24T10:36:34.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-24T10:36:34.480 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:36:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:36:34.594 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:34.600 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-24T10:36:34.601 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:36:34.601 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:36:34.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-24T10:36:34.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-24T10:36:34.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-24T10:36:34.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-24T10:36:34.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-24T10:36:34.602 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:36:34.650 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:36:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:34.736 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:36:34.736 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:36:34.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-03-24T10:36:34.736 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-03-24T10:36:34.737 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:36:34.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:36:34.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:34.819 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-24T10:36:34.819 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:36:34.819 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:34.834 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-24T10:36:34.834 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:36:34.835 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:34.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-03-24T10:36:34.957 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-03-24T10:36:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-03-24T10:36:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-03-24T10:36:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-03-24T10:36:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-03-24T10:36:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-03-24T10:36:35.013 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-03-24T10:36:35.014 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-03-24T10:36:35.015 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-03-24T10:36:35.016 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-24T10:36:35.017 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-24T10:36:35.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:35.017 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-03-24T10:36:35.068 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-24T10:36:35.068 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-24T10:36:35.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2024-03-24T10:36:35.136 DEBUG:teuthology.orchestra.run.smithi072:> cat /proc/self/mounts | awk '{print $2}' 2024-03-24T10:36:35.191 INFO:teuthology.orchestra.run.smithi072.stdout:/proc 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/dev 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/security 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/shm 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/pts 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/run 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/cgroup 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/pstore 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/bpf 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/ 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/selinux 2024-03-24T10:36:35.192 INFO:teuthology.orchestra.run.smithi072.stdout:/proc/sys/fs/binfmt_misc 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/mqueue 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/dev/hugepages 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/debug 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/tracing 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/fs/fuse/connections 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-sysctl.service 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/sys/kernel/config 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/nfs/rpc_pipefs 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/run/user/1000 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-0 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-1 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-2 2024-03-24T10:36:35.193 INFO:teuthology.orchestra.run.smithi072.stdout:/var/lib/ceph/osd/ceph-3 2024-03-24T10:36:35.194 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns 2024-03-24T10:36:35.194 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-24T10:36:35.194 INFO:teuthology.orchestra.run.smithi072.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-24T10:36:35.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:35.194 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2024-03-24T10:36:35.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2024-03-24T10:36:35.196+0000 7f16b0a60480 -1 init, newargv = 0x559b65a7e030 newargc=15 2024-03-24T10:36:35.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[44689]: starting ceph client 2024-03-24T10:36:35.202 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[44689]: starting fuse 2024-03-24T10:36:35.211 INFO:teuthology.orchestra.run.smithi072.stdout:41 2024-03-24T10:36:35.212 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo stdin-killer -- python3 -c ' 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> import re 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> import os 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2024-03-24T10:36:35.212 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> return f 2024-03-24T10:36:35.213 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-24T10:36:35.214 DEBUG:teuthology.orchestra.run.smithi072:> 2024-03-24T10:36:35.214 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2024-03-24T10:36:35.214 DEBUG:teuthology.orchestra.run.smithi072:> ' 2024-03-24T10:36:35.331 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.44689.asok 2024-03-24T10:36:35.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:35.342 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44689.asok 2024-03-24T10:36:35.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:35.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44689.asok status 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "21b3bd672163092b4e542f772797fcba02d3d4de", 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev)", 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-24T10:36:35.478 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "44689", 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4449, 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4449 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1130774341 2024-03-24T10:36:35.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 1130774341 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4449 192.168.0.1:0/1130774341", 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/1130774341", 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 6, 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2024-03-24T10:36:35.480 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2024-03-24T10:36:35.481 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2024-03-24T10:36:35.481 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-24T10:36:35.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:35.486 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2024-03-24T10:36:35.487 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:35.502 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2024-03-24T10:36:35.502 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:35.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:35.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:35.570 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-24T10:36:35.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:36:35.681 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2024-03-24T10:36:35.681 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-24T10:36:35.681 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:35.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:36:35.687 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:36:35.687 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:36:35.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 Processor -- start 2024-03-24T10:36:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 -- start start 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815e140 0x7fa1380d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa13815e520 0x7fa1380b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1380d18c0 con 0x7fa1380d4c80 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa1380b3e30 con 0x7fa13815e520 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.845+0000 7fa13d7a5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa1380b3500 con 0x7fa13815e140 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa13815e520 0x7fa1380b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa13815e520 0x7fa1380b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50836/0 (socket says 172.21.15.72:50836) 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 -- 172.21.15.72:0/1604352820 learned_addr learned my addr 172.21.15.72:0/1604352820 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815e140 0x7fa1380d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa135ffb640 1 -- 172.21.15.72:0/1604352820 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515370429 0 0) 0x7fa128001110 con 0x7fa1380d4c80 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 -- 172.21.15.72:0/1604352820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815e140 msgr2=0x7fa1380d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 --2- 172.21.15.72:0/1604352820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815e140 0x7fa1380d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 -- 172.21.15.72:0/1604352820 >> v1:172.21.15.79:6789/0 conn(0x7fa1380d4c80 legacy=0x7fa1380d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.846+0000 7fa1377fe640 1 -- 172.21.15.72:0/1604352820 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1380b37e0 con 0x7fa13815e520 2024-03-24T10:36:35.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa1377fe640 1 --2- 172.21.15.72:0/1604352820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa13815e520 0x7fa1380b42c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa130009e80 tx=0x7fa13002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c76716a96861f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa135ffb640 1 -- 172.21.15.72:0/1604352820 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13002caf0 con 0x7fa13815e520 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa135ffb640 1 -- 172.21.15.72:0/1604352820 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13002cc50 con 0x7fa13815e520 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa135ffb640 1 -- 172.21.15.72:0/1604352820 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1300343f0 con 0x7fa13815e520 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1604352820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa13815e520 msgr2=0x7fa1380b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1604352820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa13815e520 0x7fa1380b42c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa130009e80 tx=0x7fa13002bf50 comp rx=0 tx=0).stop 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1604352820 shutdown_connections 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1604352820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa13815e520 0x7fa1380b42c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:35.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1604352820 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815e140 0x7fa1380d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1604352820 >> 172.21.15.72:0/1604352820 conn(0x7fa1380d3f30 msgr2=0x7fa1380d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1604352820 shutdown_connections 2024-03-24T10:36:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.847+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1604352820 wait complete. 2024-03-24T10:36:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 Processor -- start 2024-03-24T10:36:35.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 -- start start 2024-03-24T10:36:35.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 0x7fa1381f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:35.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa13815e140 0x7fa1380b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:35.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815b650 0x7fa13806cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:35.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa1381f3f70 con 0x7fa1380d4c80 2024-03-24T10:36:35.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1380b7aa0 con 0x7fa13815e140 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa13d7a5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa1381f4a00 con 0x7fa13815b650 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 0x7fa1381f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 0x7fa1381f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50840/0 (socket says 172.21.15.72:50840) 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.849+0000 7fa136ffd640 1 -- 172.21.15.72:0/1460908907 learned_addr learned my addr 172.21.15.72:0/1460908907 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa1377fe640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815b650 0x7fa13806cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa1367fc640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa13815e140 0x7fa1380b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa136ffd640 1 -- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815b650 msgr2=0x7fa13806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa136ffd640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815b650 0x7fa13806cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa136ffd640 1 -- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa13815e140 msgr2=0x7fa1380b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa136ffd640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa13815e140 0x7fa1380b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa136ffd640 1 -- 172.21.15.72:0/1460908907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa130009b30 con 0x7fa1380d4c80 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa136ffd640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 0x7fa1381f3a30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00e9e0 tx=0x7fa12c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c009670 con 0x7fa1380d4c80 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa12c00c9d0 con 0x7fa1380d4c80 2024-03-24T10:36:35.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c00cd80 con 0x7fa1380d4c80 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1381f4160 con 0x7fa1380d4c80 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.850+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1381f4720 con 0x7fa1380d4c80 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.851+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1380a1ec0 con 0x7fa1380d4c80 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.852+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa12c013470 con 0x7fa1380d4c80 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.852+0000 7fa11f7fe640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa12406b810 0x7fa12406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.852+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa12c08a5d0 con 0x7fa1380d4c80 2024-03-24T10:36:35.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.852+0000 7fa1367fc640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa12406b810 0x7fa12406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:35.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.852+0000 7fa1367fc640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa12406b810 0x7fa12406dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa13815ec60 tx=0x7fa128009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:35.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:35.856+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa12c054df0 con 0x7fa1380d4c80 2024-03-24T10:36:36.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.029+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1380d3d10 con 0x7fa1380d4c80 2024-03-24T10:36:36.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.030+0000 7fa11f7fe640 1 -- 172.21.15.72:0/1460908907 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7fa12c0584b0 con 0x7fa1380d4c80 2024-03-24T10:36:36.031 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:36.031 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa12406b810 msgr2=0x7fa12406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa12406b810 0x7fa12406dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa13815ec60 tx=0x7fa128009040 comp rx=0 tx=0).stop 2024-03-24T10:36:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 msgr2=0x7fa1381f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 0x7fa1381f3a30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa12c00e9e0 tx=0x7fa12c00eea0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 shutdown_connections 2024-03-24T10:36:36.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa12406b810 0x7fa12406dcd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa13815b650 0x7fa13806cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa13815e140 0x7fa1380b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.032+0000 7fa13d7a5640 1 --2- 172.21.15.72:0/1460908907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa1380d4c80 0x7fa1381f3a30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.033+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 >> 172.21.15.72:0/1460908907 conn(0x7fa1380d3f30 msgr2=0x7fa1380b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.033+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 shutdown_connections 2024-03-24T10:36:36.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.033+0000 7fa13d7a5640 1 -- 172.21.15.72:0/1460908907 wait complete. 2024-03-24T10:36:36.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:36:36.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:36:36.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.147+0000 7f9c9ec55640 1 Processor -- start 2024-03-24T10:36:36.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.147+0000 7f9c9ec55640 1 -- start start 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9ec55640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c980b3580 0x7f9c980cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9ec55640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c98072470 0x7f9c9815b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9ec55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3960 0x7f9c9815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9ec55640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9c9815b9c0 con 0x7f9c980b3580 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9ec55640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9c98154ea0 con 0x7f9c98072470 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9ec55640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9c98071460 con 0x7f9c980b3960 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c980b3580 0x7f9c980cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9c980b3580 0x7f9c980cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50846/0 (socket says 172.21.15.72:50846) 2024-03-24T10:36:36.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c97fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9c98072470 0x7f9c9815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3593896468 learned_addr learned my addr 172.21.15.72:0/3593896468 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9d1f2640 1 --2- 172.21.15.72:0/3593896468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3960 0x7f9c9815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3593896468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3960 msgr2=0x7f9c9815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 --2- 172.21.15.72:0/3593896468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3960 0x7f9c9815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3593896468 >> v2:172.21.15.79:3300/0 conn(0x7f9c98072470 msgr2=0x7f9c9815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 --2- 172.21.15.72:0/3593896468 >> v2:172.21.15.79:3300/0 conn(0x7f9c98072470 0x7f9c9815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3593896468 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c98071fe0 con 0x7f9c980b3580 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.148+0000 7f9c97fff640 1 --2- 172.21.15.72:0/3593896468 >> v2:172.21.15.79:3300/0 conn(0x7f9c98072470 0x7f9c9815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9c9f1640 1 --2- 172.21.15.72:0/3593896468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c980b3580 0x7f9c980cf310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c980b4eb0 tx=0x7f9c8c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb577a346b11831 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c977fe640 1 -- 172.21.15.72:0/3593896468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c0317e0 con 0x7f9c980b3580 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c977fe640 1 -- 172.21.15.72:0/3593896468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c031940 con 0x7f9c980b3580 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c977fe640 1 -- 172.21.15.72:0/3593896468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c031cd0 con 0x7f9c980b3580 2024-03-24T10:36:36.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3593896468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c980b3580 msgr2=0x7f9c980cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3593896468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c980b3580 0x7f9c980cf310 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9c980b4eb0 tx=0x7f9c8c02b880 comp rx=0 tx=0).stop 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3593896468 shutdown_connections 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3593896468 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3960 0x7f9c9815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3593896468 >> v2:172.21.15.79:3300/0 conn(0x7f9c98072470 0x7f9c9815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3593896468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c980b3580 0x7f9c980cf310 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3593896468 >> 172.21.15.72:0/3593896468 conn(0x7f9c980b1810 msgr2=0x7f9c980b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3593896468 shutdown_connections 2024-03-24T10:36:36.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.149+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3593896468 wait complete. 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 Processor -- start 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 -- start start 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 0x7f9c981f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3580 0x7f9c98153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c980b3960 0x7f9c98156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9c981f5fa0 con 0x7f9c98072470 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98153fb0 con 0x7f9c980b3960 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.151+0000 7f9c9ec55640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9813fe60 con 0x7f9c980b3580 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 0x7f9c981f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 0x7f9c981f5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50854/0 (socket says 172.21.15.72:50854) 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3887383193 learned_addr learned my addr 172.21.15.72:0/3887383193 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c97fff640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3580 0x7f9c98153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9d1f2640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c980b3960 0x7f9c98156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3580 msgr2=0x7f9c98153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3580 0x7f9c98153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c980b3960 msgr2=0x7f9c98156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c980b3960 0x7f9c98156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 -- 172.21.15.72:0/3887383193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8400a5a0 con 0x7f9c98072470 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9c9f1640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 0x7f9c981f5070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0097c0 tx=0x7f9c8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c032880 con 0x7f9c98072470 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8c0329e0 con 0x7f9c98072470 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8c0094d0 con 0x7f9c98072470 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c032d90 con 0x7f9c98072470 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.152+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c981f59e0 con 0x7f9c98072470 2024-03-24T10:36:36.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.153+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9804f470 con 0x7f9c98072470 2024-03-24T10:36:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.154+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9c8c03b3f0 con 0x7f9c98072470 2024-03-24T10:36:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.154+0000 7f9c957fa640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9c7c06b810 0x7f9c7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.154+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c8c0ac440 con 0x7f9c98072470 2024-03-24T10:36:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.154+0000 7f9c97fff640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9c7c06b810 0x7f9c7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.154+0000 7f9c97fff640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9c7c06b810 0x7f9c7c06dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c981528a0 tx=0x7f9c8400a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.158+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9c8c076bd0 con 0x7f9c98072470 2024-03-24T10:36:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.331+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9c9813fbc0 con 0x7f9c98072470 2024-03-24T10:36:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.331+0000 7f9c957fa640 1 -- 172.21.15.72:0/3887383193 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9c8c07a290 con 0x7f9c98072470 2024-03-24T10:36:36.332 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9c7c06b810 msgr2=0x7f9c7c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9c7c06b810 0x7f9c7c06dcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c981528a0 tx=0x7f9c8400a2a0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 msgr2=0x7f9c981f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 0x7f9c981f5070 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c0097c0 tx=0x7f9c8c0046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 shutdown_connections 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9c7c06b810 0x7f9c7c06dcd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c980b3960 0x7f9c98156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9c980b3580 0x7f9c98153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 --2- 172.21.15.72:0/3887383193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c98072470 0x7f9c981f5070 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 >> 172.21.15.72:0/3887383193 conn(0x7f9c980b1810 msgr2=0x7f9c9815c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 shutdown_connections 2024-03-24T10:36:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.333+0000 7f9c9ec55640 1 -- 172.21.15.72:0/3887383193 wait complete. 2024-03-24T10:36:36.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:36:36.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.447+0000 7f5ccd688640 1 Processor -- start 2024-03-24T10:36:36.448 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.447+0000 7f5ccd688640 1 -- start start 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5ccd688640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5cc80d2b20 0x7f5cc80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5ccd688640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5cc80d0f70 0x7f5cc80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5ccd688640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc80d4950 con 0x7f5cc815e240 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5ccd688640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc80d2270 con 0x7f5cc80d2b20 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5ccd688640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc80b38c0 con 0x7f5cc80d0f70 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5cc80d2b20 0x7f5cc80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5cc80d2b20 0x7f5cc80cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50860/0 (socket says 172.21.15.72:50860) 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 -- 172.21.15.72:0/4022305250 learned_addr learned my addr 172.21.15.72:0/4022305250 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cc77fe640 1 --2- 172.21.15.72:0/4022305250 >> v2:172.21.15.79:3300/0 conn(0x7f5cc80d0f70 0x7f5cc80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 -- 172.21.15.72:0/4022305250 >> v2:172.21.15.79:3300/0 conn(0x7f5cc80d0f70 msgr2=0x7f5cc80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 --2- 172.21.15.72:0/4022305250 >> v2:172.21.15.79:3300/0 conn(0x7f5cc80d0f70 0x7f5cc80cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 -- 172.21.15.72:0/4022305250 >> v1:172.21.15.79:6789/0 conn(0x7f5cc815e240 legacy=0x7f5cc80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.448+0000 7f5cbe7fc640 1 -- 172.21.15.72:0/4022305250 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc80b3550 con 0x7f5cc80d2b20 2024-03-24T10:36:36.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5cbe7fc640 1 --2- 172.21.15.72:0/4022305250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc80d2b20 0x7f5cc80cea40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5cc808c330 tx=0x7f5cb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b043506b66f6e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5cc67fc640 1 -- 172.21.15.72:0/4022305250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0031870 con 0x7f5cc80d2b20 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5cc67fc640 1 -- 172.21.15.72:0/4022305250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb00319d0 con 0x7f5cc80d2b20 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5cc67fc640 1 -- 172.21.15.72:0/4022305250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0031d60 con 0x7f5cc80d2b20 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 -- 172.21.15.72:0/4022305250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc80d2b20 msgr2=0x7f5cc80cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 --2- 172.21.15.72:0/4022305250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc80d2b20 0x7f5cc80cea40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5cc808c330 tx=0x7f5cb002b910 comp rx=0 tx=0).stop 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 -- 172.21.15.72:0/4022305250 shutdown_connections 2024-03-24T10:36:36.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 --2- 172.21.15.72:0/4022305250 >> v2:172.21.15.79:3300/0 conn(0x7f5cc80d0f70 0x7f5cc80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 --2- 172.21.15.72:0/4022305250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc80d2b20 0x7f5cc80cea40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 -- 172.21.15.72:0/4022305250 >> 172.21.15.72:0/4022305250 conn(0x7f5cc80d3e30 msgr2=0x7f5cc80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 -- 172.21.15.72:0/4022305250 shutdown_connections 2024-03-24T10:36:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.449+0000 7f5ccd688640 1 -- 172.21.15.72:0/4022305250 wait complete. 2024-03-24T10:36:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.450+0000 7f5ccd688640 1 Processor -- start 2024-03-24T10:36:36.452 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 -- start start 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5cc80d0f70 0x7f5cc8153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc80d2b20 0x7f5cc8160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 0x7f5cc8160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80ca520 con 0x7f5cc815e240 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80b7d90 con 0x7f5cc80d2b20 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5ccd688640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc80b6ea0 con 0x7f5cc80d0f70 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5cc77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 0x7f5cc8160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5cc77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 0x7f5cc8160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50872/0 (socket says 172.21.15.72:50872) 2024-03-24T10:36:36.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5cc77fe640 1 -- 172.21.15.72:0/174730286 learned_addr learned my addr 172.21.15.72:0/174730286 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.451+0000 7f5cc6ffd640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5cc80d0f70 0x7f5cc8153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cbe7fc640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc80d2b20 0x7f5cc8160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cc77fe640 1 -- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5cc80d0f70 msgr2=0x7f5cc8153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cc77fe640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5cc80d0f70 0x7f5cc8153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cc77fe640 1 -- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc80d2b20 msgr2=0x7f5cc8160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cc77fe640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc80d2b20 0x7f5cc8160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cc77fe640 1 -- 172.21.15.72:0/174730286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb00094d0 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cc77fe640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 0x7f5cc8160fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000efc0 tx=0x7f5cc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0009ba0 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc000f040 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc80b7180 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00146c0 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.452+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc80b7740 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.453+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc80b7f20 con 0x7f5cc815e240 2024-03-24T10:36:36.456 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.453+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5cc0014820 con 0x7f5cc815e240 2024-03-24T10:36:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.454+0000 7f5cbffff640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5ca806b810 0x7f5ca806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.454+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5cc008af10 con 0x7f5cc815e240 2024-03-24T10:36:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.454+0000 7f5cc6ffd640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5ca806b810 0x7f5ca806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.454+0000 7f5cc6ffd640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5ca806b810 0x7f5ca806dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cc814b110 tx=0x7f5cb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.458+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5cc00556a0 con 0x7f5cc815e240 2024-03-24T10:36:36.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.632+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5cc804f470 con 0x7f5cc815e240 2024-03-24T10:36:36.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.632+0000 7f5cbffff640 1 -- 172.21.15.72:0/174730286 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f5cc00180a0 con 0x7f5cc815e240 2024-03-24T10:36:36.633 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5ca806b810 msgr2=0x7f5ca806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5ca806b810 0x7f5ca806dcd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5cc814b110 tx=0x7f5cb8009040 comp rx=0 tx=0).stop 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 msgr2=0x7f5cc8160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 0x7f5cc8160fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000efc0 tx=0x7f5cc000c490 comp rx=0 tx=0).stop 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 shutdown_connections 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5ca806b810 0x7f5ca806dcd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5cc815e240 0x7f5cc8160fa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5cc80d2b20 0x7f5cc8160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 --2- 172.21.15.72:0/174730286 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5cc80d0f70 0x7f5cc8153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 >> 172.21.15.72:0/174730286 conn(0x7f5cc80d3e30 msgr2=0x7f5cc80d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 shutdown_connections 2024-03-24T10:36:36.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.634+0000 7f5ccd688640 1 -- 172.21.15.72:0/174730286 wait complete. 2024-03-24T10:36:36.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:36:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.747+0000 7f5ea3264640 1 Processor -- start 2024-03-24T10:36:36.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea3264640 1 -- start start 2024-03-24T10:36:36.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea3264640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e9c06ba90 0x7f5e9c15ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea3264640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5e9c0b3b10 0x7f5e9c143650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea3264640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e9c15f440 con 0x7f5e9c161ae0 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea3264640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9c06be70 con 0x7f5e9c06ba90 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea3264640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5e9c15e4f0 con 0x7f5e9c0b3b10 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5ea1000640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e9c06ba90 0x7f5e9c15ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.748+0000 7f5e9bfff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f5e9c161ae0 0x7f5e9c0b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:58746/0 (socket says 172.21.15.72:58746) 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5e9bfff640 1 -- 172.21.15.72:0/190036446 learned_addr learned my addr 172.21.15.72:0/190036446 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1801640 1 --2- 172.21.15.72:0/190036446 >> v2:172.21.15.79:3300/0 conn(0x7f5e9c0b3b10 0x7f5e9c143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1000640 1 -- 172.21.15.72:0/190036446 >> v2:172.21.15.79:3300/0 conn(0x7f5e9c0b3b10 msgr2=0x7f5e9c143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1000640 1 --2- 172.21.15.72:0/190036446 >> v2:172.21.15.79:3300/0 conn(0x7f5e9c0b3b10 0x7f5e9c143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1000640 1 -- 172.21.15.72:0/190036446 >> v1:172.21.15.79:6789/0 conn(0x7f5e9c161ae0 legacy=0x7f5e9c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5e9b7fe640 1 -- 172.21.15.72:0/190036446 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189511293 0 0) 0x7f5e9c15f440 con 0x7f5e9c161ae0 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1000640 1 -- 172.21.15.72:0/190036446 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c1624c0 con 0x7f5e9c06ba90 2024-03-24T10:36:36.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1801640 1 --2- 172.21.15.72:0/190036446 >> v2:172.21.15.79:3300/0 conn(0x7f5e9c0b3b10 0x7f5e9c143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.749+0000 7f5ea1000640 1 --2- 172.21.15.72:0/190036446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c15ef00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0097d0 tx=0x7f5e8c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a8fbfa09cc86aa server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5e9b7fe640 1 -- 172.21.15.72:0/190036446 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c031830 con 0x7f5e9c06ba90 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5e9b7fe640 1 -- 172.21.15.72:0/190036446 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c031990 con 0x7f5e9c06ba90 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5e9b7fe640 1 -- 172.21.15.72:0/190036446 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c031d20 con 0x7f5e9c06ba90 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 -- 172.21.15.72:0/190036446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 msgr2=0x7f5e9c15ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 --2- 172.21.15.72:0/190036446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c15ef00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0097d0 tx=0x7f5e8c02b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 -- 172.21.15.72:0/190036446 shutdown_connections 2024-03-24T10:36:36.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 --2- 172.21.15.72:0/190036446 >> v2:172.21.15.79:3300/0 conn(0x7f5e9c0b3b10 0x7f5e9c143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 --2- 172.21.15.72:0/190036446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c15ef00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 -- 172.21.15.72:0/190036446 >> 172.21.15.72:0/190036446 conn(0x7f5e9c0b2100 msgr2=0x7f5e9c0b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 -- 172.21.15.72:0/190036446 shutdown_connections 2024-03-24T10:36:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.750+0000 7f5ea3264640 1 -- 172.21.15.72:0/190036446 wait complete. 2024-03-24T10:36:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.751+0000 7f5ea3264640 1 Processor -- start 2024-03-24T10:36:36.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.751+0000 7f5ea3264640 1 -- start start 2024-03-24T10:36:36.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea3264640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea3264640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e9c0b3b10 0x7f5e9c1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea3264640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e9c161ae0 0x7f5e9c147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea3264640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c1f4be0 con 0x7f5e9c06ba90 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea3264640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c1f4ec0 con 0x7f5e9c161ae0 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea3264640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9c1f51a0 con 0x7f5e9c0b3b10 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea1000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea1000640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50878/0 (socket says 172.21.15.72:50878) 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea1000640 1 -- 172.21.15.72:0/3043140649 learned_addr learned my addr 172.21.15.72:0/3043140649 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.752+0000 7f5ea1801640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e9c161ae0 0x7f5e9c147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5e9bfff640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e9c0b3b10 0x7f5e9c1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea1000640 1 -- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e9c0b3b10 msgr2=0x7f5e9c1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea1000640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e9c0b3b10 0x7f5e9c1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea1000640 1 -- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e9c161ae0 msgr2=0x7f5e9c147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea1000640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e9c161ae0 0x7f5e9c147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea1000640 1 -- 172.21.15.72:0/3043140649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8c009400 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea1000640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c145600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c000c00 tx=0x7f5e8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c03aa60 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8c03abc0 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c1f5480 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0443f0 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.753+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c159b30 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.754+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c04f470 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.754+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5e8c04d450 con 0x7f5e9c06ba90 2024-03-24T10:36:36.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.755+0000 7f5e997fa640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5e7c06b810 0x7f5e7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:36.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.755+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5e8c0ac610 con 0x7f5e9c06ba90 2024-03-24T10:36:36.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.755+0000 7f5e9bfff640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5e7c06b810 0x7f5e7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:36.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.755+0000 7f5e9bfff640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5e7c06b810 0x7f5e7c06dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0cfae0 tx=0x7f5e84007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:36.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.759+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5e8c076cf0 con 0x7f5e9c06ba90 2024-03-24T10:36:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.930+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5e9c143340 con 0x7f5e9c06ba90 2024-03-24T10:36:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.931+0000 7f5e997fa640 1 -- 172.21.15.72:0/3043140649 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f5e8c0350a0 con 0x7f5e9c06ba90 2024-03-24T10:36:36.931 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:36:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5e7c06b810 msgr2=0x7f5e7c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5e7c06b810 0x7f5e7c06dcd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c0cfae0 tx=0x7f5e84007b50 comp rx=0 tx=0).stop 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 msgr2=0x7f5e9c145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c145600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c000c00 tx=0x7f5e8c0046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 shutdown_connections 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5e7c06b810 0x7f5e7c06dcd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e9c161ae0 0x7f5e9c147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5e9c0b3b10 0x7f5e9c1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 --2- 172.21.15.72:0/3043140649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e9c06ba90 0x7f5e9c145600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 >> 172.21.15.72:0/3043140649 conn(0x7f5e9c0b2100 msgr2=0x7f5e9c143e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 shutdown_connections 2024-03-24T10:36:36.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:36.933+0000 7f5ea3264640 1 -- 172.21.15.72:0/3043140649 wait complete. 2024-03-24T10:36:36.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:36:37.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.047+0000 7fc938c42640 1 Processor -- start 2024-03-24T10:36:37.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.047+0000 7fc938c42640 1 -- start start 2024-03-24T10:36:37.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc938c42640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93406e8d0 0x7fc9340b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc938c42640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc93406ecb0 0x7fc93415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc938c42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc9340b4190 0x7fc934144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc938c42640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc93415f980 con 0x7fc93406ecb0 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc938c42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340b30f0 con 0x7fc9340b4190 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc938c42640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc9340b33d0 con 0x7fc93406e8d0 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc93406ecb0 0x7fc93415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc93406ecb0 0x7fc93415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50884/0 (socket says 172.21.15.72:50884) 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 -- 172.21.15.72:0/2967530677 learned_addr learned my addr 172.21.15.72:0/2967530677 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc93259c640 1 --2- 172.21.15.72:0/2967530677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93406e8d0 0x7fc9340b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc932d9d640 1 --2- 172.21.15.72:0/2967530677 >> v2:172.21.15.79:3300/0 conn(0x7fc9340b4190 0x7fc934144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 -- 172.21.15.72:0/2967530677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93406e8d0 msgr2=0x7fc9340b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:37.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 --2- 172.21.15.72:0/2967530677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93406e8d0 0x7fc9340b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 -- 172.21.15.72:0/2967530677 >> v2:172.21.15.79:3300/0 conn(0x7fc9340b4190 msgr2=0x7fc934144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 --2- 172.21.15.72:0/2967530677 >> v2:172.21.15.79:3300/0 conn(0x7fc9340b4190 0x7fc934144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.048+0000 7fc929d9b640 1 -- 172.21.15.72:0/2967530677 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340b36b0 con 0x7fc93406ecb0 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.049+0000 7fc929d9b640 1 --2- 172.21.15.72:0/2967530677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406ecb0 0x7fc93415f440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9340cf660 tx=0x7fc91c02e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd65bd770f6851c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.049+0000 7fc931d9b640 1 -- 172.21.15.72:0/2967530677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c02ee00 con 0x7fc93406ecb0 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.049+0000 7fc931d9b640 1 -- 172.21.15.72:0/2967530677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c036440 con 0x7fc93406ecb0 2024-03-24T10:36:37.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.049+0000 7fc931d9b640 1 -- 172.21.15.72:0/2967530677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c0367d0 con 0x7fc93406ecb0 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 -- 172.21.15.72:0/2967530677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406ecb0 msgr2=0x7fc93415f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 --2- 172.21.15.72:0/2967530677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406ecb0 0x7fc93415f440 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc9340cf660 tx=0x7fc91c02e050 comp rx=0 tx=0).stop 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 -- 172.21.15.72:0/2967530677 shutdown_connections 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 --2- 172.21.15.72:0/2967530677 >> v2:172.21.15.79:3300/0 conn(0x7fc9340b4190 0x7fc934144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 --2- 172.21.15.72:0/2967530677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406ecb0 0x7fc93415f440 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 --2- 172.21.15.72:0/2967530677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc93406e8d0 0x7fc9340b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 -- 172.21.15.72:0/2967530677 >> 172.21.15.72:0/2967530677 conn(0x7fc9340b1810 msgr2=0x7fc9340b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:37.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 -- 172.21.15.72:0/2967530677 shutdown_connections 2024-03-24T10:36:37.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.050+0000 7fc938c42640 1 -- 172.21.15.72:0/2967530677 wait complete. 2024-03-24T10:36:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.051+0000 7fc938c42640 1 Processor -- start 2024-03-24T10:36:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.051+0000 7fc938c42640 1 -- start start 2024-03-24T10:36:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc938c42640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 0x7fc93415b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc938c42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93406ecb0 0x7fc93415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc938c42640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9340b4190 0x7fc9341402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc938c42640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc93415baf0 con 0x7fc93406e8d0 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc938c42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc93415bdd0 con 0x7fc93406ecb0 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc938c42640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc93415c0b0 con 0x7fc9340b4190 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 0x7fc93415b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 0x7fc93415b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50900/0 (socket says 172.21.15.72:50900) 2024-03-24T10:36:37.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 -- 172.21.15.72:0/635244549 learned_addr learned my addr 172.21.15.72:0/635244549 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc929d9b640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93406ecb0 0x7fc93415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc932d9d640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9340b4190 0x7fc9341402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 -- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9340b4190 msgr2=0x7fc9341402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9340b4190 0x7fc9341402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 -- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93406ecb0 msgr2=0x7fc93415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93406ecb0 0x7fc93415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 -- 172.21.15.72:0/635244549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c00b770 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.052+0000 7fc93259c640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 0x7fc93415b510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e890 tx=0x7fc92400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.053+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92400c940 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.053+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92400caa0 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.053+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93415c390 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.053+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92400ce30 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.053+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc934139180 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.054+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93415c520 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.054+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc924013470 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.055+0000 7fc92b7fe640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc91406b810 0x7fc91406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.055+0000 7fc929d9b640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc91406b810 0x7fc91406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.055+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc92408a660 con 0x7fc93406e8d0 2024-03-24T10:36:37.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.055+0000 7fc929d9b640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc91406b810 0x7fc91406dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc91c038000 tx=0x7fc91c032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.059+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc924054df0 con 0x7fc93406e8d0 2024-03-24T10:36:37.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.229+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc93404f470 con 0x7fc93406e8d0 2024-03-24T10:36:37.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.229+0000 7fc92b7fe640 1 -- 172.21.15.72:0/635244549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fc9240584b0 con 0x7fc93406e8d0 2024-03-24T10:36:37.230 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc91406b810 msgr2=0x7fc91406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc91406b810 0x7fc91406dcd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc91c038000 tx=0x7fc91c032000 comp rx=0 tx=0).stop 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 msgr2=0x7fc93415b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 0x7fc93415b510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc92400e890 tx=0x7fc92400ed50 comp rx=0 tx=0).stop 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 shutdown_connections 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc91406b810 0x7fc91406dcd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9340b4190 0x7fc9341402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc93406ecb0 0x7fc93415da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 --2- 172.21.15.72:0/635244549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc93406e8d0 0x7fc93415b510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.231+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 >> 172.21.15.72:0/635244549 conn(0x7fc9340b1810 msgr2=0x7fc934141320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:37.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.232+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 shutdown_connections 2024-03-24T10:36:37.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.232+0000 7fc938c42640 1 -- 172.21.15.72:0/635244549 wait complete. 2024-03-24T10:36:37.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:36:37.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.344+0000 7f189e40b640 1 Processor -- start 2024-03-24T10:36:37.345 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.344+0000 7f189e40b640 1 -- start start 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189e40b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f189806e600 0x7f189806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189e40b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f189815e220 0x7f189806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189e40b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189806ef20 con 0x7f1898162570 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189e40b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f189806d500 con 0x7f189815e220 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189e40b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f189806d7e0 con 0x7f189806e600 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189c9a8640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1898162570 0x7f18980b3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58350/0 (socket says 172.21.15.72:58350) 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f189c9a8640 1 -- 172.21.15.72:0/3928821708 learned_addr learned my addr 172.21.15.72:0/3928821708 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f18977fe640 1 --2- 172.21.15.72:0/3928821708 >> v2:172.21.15.79:3300/0 conn(0x7f189815e220 0x7f189806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f1897fff640 1 --2- 172.21.15.72:0/3928821708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f189806e600 0x7f189806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f1896ffd640 1 -- 172.21.15.72:0/3928821708 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189297624 0 0) 0x7f189806ef20 con 0x7f1898162570 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f1896ffd640 1 -- 172.21.15.72:0/3928821708 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1880003520 con 0x7f1898162570 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.345+0000 7f1897fff640 1 -- 172.21.15.72:0/3928821708 >> v2:172.21.15.79:3300/0 conn(0x7f189815e220 msgr2=0x7f189806e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:37.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1897fff640 1 --2- 172.21.15.72:0/3928821708 >> v2:172.21.15.79:3300/0 conn(0x7f189815e220 0x7f189806e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1897fff640 1 -- 172.21.15.72:0/3928821708 >> v1:172.21.15.72:6789/0 conn(0x7f1898162570 legacy=0x7f18980b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1897fff640 1 -- 172.21.15.72:0/3928821708 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189806dac0 con 0x7f189806e600 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f18977fe640 1 --2- 172.21.15.72:0/3928821708 >> v2:172.21.15.79:3300/0 conn(0x7f189815e220 0x7f189806e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1897fff640 1 --2- 172.21.15.72:0/3928821708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f189806e600 0x7f189806ce20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18880097a0 tx=0x7f188802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c081c32f0c66ce8a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1896ffd640 1 -- 172.21.15.72:0/3928821708 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188802f050 con 0x7f189806e600 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1896ffd640 1 -- 172.21.15.72:0/3928821708 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888031700 con 0x7f189806e600 2024-03-24T10:36:37.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.346+0000 7f1896ffd640 1 -- 172.21.15.72:0/3928821708 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888031a70 con 0x7f189806e600 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 -- 172.21.15.72:0/3928821708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f189806e600 msgr2=0x7f189806ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 --2- 172.21.15.72:0/3928821708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f189806e600 0x7f189806ce20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f18880097a0 tx=0x7f188802b7a0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 -- 172.21.15.72:0/3928821708 shutdown_connections 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 --2- 172.21.15.72:0/3928821708 >> v2:172.21.15.79:3300/0 conn(0x7f189815e220 0x7f189806e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 --2- 172.21.15.72:0/3928821708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f189806e600 0x7f189806ce20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 -- 172.21.15.72:0/3928821708 >> 172.21.15.72:0/3928821708 conn(0x7f18980b1810 msgr2=0x7f18980b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 -- 172.21.15.72:0/3928821708 shutdown_connections 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.347+0000 7f189e40b640 1 -- 172.21.15.72:0/3928821708 wait complete. 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.348+0000 7f189e40b640 1 Processor -- start 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.348+0000 7f189e40b640 1 -- start start 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189e40b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f189806e600 0x7f189814c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189e40b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 0x7f18981582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189e40b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1898162570 0x7f1898158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189e40b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f189815cbc0 con 0x7f189815e220 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189e40b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f189815bb20 con 0x7f189806e600 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189e40b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f189815be00 con 0x7f1898162570 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 0x7f18981582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 0x7f18981582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50902/0 (socket says 172.21.15.72:50902) 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 -- 172.21.15.72:0/2022298761 learned_addr learned my addr 172.21.15.72:0/2022298761 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f1897fff640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f189806e600 0x7f189814c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f189c9a8640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1898162570 0x7f1898158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 -- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1898162570 msgr2=0x7f1898158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1898162570 0x7f1898158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 -- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f189806e600 msgr2=0x7f189814c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f189806e600 0x7f189814c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.349+0000 7f18977fe640 1 -- 172.21.15.72:0/2022298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f188c009400 con 0x7f189815e220 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.350+0000 7f18977fe640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 0x7f18981582f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e9b0 tx=0x7f188c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.352 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.350+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c00ca00 con 0x7f189815e220 2024-03-24T10:36:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.350+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f188c00cb60 con 0x7f189815e220 2024-03-24T10:36:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.350+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1888009400 con 0x7f189815e220 2024-03-24T10:36:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.350+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188c013470 con 0x7f189815e220 2024-03-24T10:36:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.350+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f189815c3c0 con 0x7f189815e220 2024-03-24T10:36:37.353 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.351+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1898073d50 con 0x7f189815e220 2024-03-24T10:36:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.351+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f188c0135d0 con 0x7f189815e220 2024-03-24T10:36:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.352+0000 7f1894ff9640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f188406b810 0x7f188406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.352+0000 7f1897fff640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f188406b810 0x7f188406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.352+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f188c08a390 con 0x7f189815e220 2024-03-24T10:36:37.354 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.352+0000 7f1897fff640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f188406b810 0x7f188406dcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1888035000 tx=0x7f1888008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.356 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.356+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f188c054bb0 con 0x7f189815e220 2024-03-24T10:36:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.540+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1898159d60 con 0x7f189815e220 2024-03-24T10:36:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.541+0000 7f1894ff9640 1 -- 172.21.15.72:0/2022298761 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f188c058270 con 0x7f189815e220 2024-03-24T10:36:37.541 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T10:36:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.542+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f188406b810 msgr2=0x7f188406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.542+0000 7f189e40b640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f188406b810 0x7f188406dcd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1888035000 tx=0x7f1888008030 comp rx=0 tx=0).stop 2024-03-24T10:36:37.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.542+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 msgr2=0x7f18981582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.542+0000 7f189e40b640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 0x7f18981582f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f188c00e9b0 tx=0x7f188c00ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 shutdown_connections 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f188406b810 0x7f188406dcd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1898162570 0x7f1898158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f189815e220 0x7f18981582f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 --2- 172.21.15.72:0/2022298761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f189806e600 0x7f189814c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 >> 172.21.15.72:0/2022298761 conn(0x7f18980b1810 msgr2=0x7f18980ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 shutdown_connections 2024-03-24T10:36:37.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.543+0000 7f189e40b640 1 -- 172.21.15.72:0/2022298761 wait complete. 2024-03-24T10:36:37.554 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:36:37.554 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:36:37.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 Processor -- start 2024-03-24T10:36:37.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 -- start start 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f793415e170 0x7f793415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79340d2450 0x7f79340b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79340d4e50 con 0x7f79340d4930 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f79340cf790 con 0x7f79340d2450 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f793ae88640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f79340cfa70 con 0x7f793415e170 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f7939425640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79340d2450 0x7f79340b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f7939425640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f79340d2450 0x7f79340b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50918/0 (socket says 172.21.15.72:50918) 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f7939425640 1 -- 172.21.15.72:0/597214907 learned_addr learned my addr 172.21.15.72:0/597214907 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.708+0000 7f7938c24640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f793415e170 0x7f793415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f7939425640 1 -- 172.21.15.72:0/597214907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f793415e170 msgr2=0x7f793415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f7939425640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f793415e170 0x7f793415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f792b7fe640 1 -- 172.21.15.72:0/597214907 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437988437 0 0) 0x7f79340d4e50 con 0x7f79340d4930 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f7939425640 1 -- 172.21.15.72:0/597214907 >> v1:172.21.15.79:6789/0 conn(0x7f79340d4930 legacy=0x7f79340d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f7939425640 1 -- 172.21.15.72:0/597214907 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79340cfd50 con 0x7f79340d2450 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f7938c24640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f793415e170 0x7f793415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.709+0000 7f7939425640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d2450 0x7f79340b3c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f792c009e50 tx=0x7f792c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9212057d722da77 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f792b7fe640 1 -- 172.21.15.72:0/597214907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c02ca70 con 0x7f79340d2450 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f792b7fe640 1 -- 172.21.15.72:0/597214907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f792c02cbd0 con 0x7f79340d2450 2024-03-24T10:36:37.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f792b7fe640 1 -- 172.21.15.72:0/597214907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792c0343f0 con 0x7f79340d2450 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 -- 172.21.15.72:0/597214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d2450 msgr2=0x7f79340b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d2450 0x7f79340b3c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f792c009e50 tx=0x7f792c02bed0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 -- 172.21.15.72:0/597214907 shutdown_connections 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d2450 0x7f79340b3c80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 --2- 172.21.15.72:0/597214907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f793415e170 0x7f793415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 -- 172.21.15.72:0/597214907 >> 172.21.15.72:0/597214907 conn(0x7f793409d310 msgr2=0x7f79340d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 -- 172.21.15.72:0/597214907 shutdown_connections 2024-03-24T10:36:37.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.710+0000 7f793ae88640 1 -- 172.21.15.72:0/597214907 wait complete. 2024-03-24T10:36:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.711+0000 7f793ae88640 1 Processor -- start 2024-03-24T10:36:37.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.711+0000 7f793ae88640 1 -- start start 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f793ae88640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79340d2450 0x7f7934155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f793ae88640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 0x7f793409e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f793ae88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f793415e170 0x7f79340cd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f793ae88640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7934155b70 con 0x7f79340d4930 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f793ae88640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79340cde90 con 0x7f793415e170 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f793ae88640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f793409edd0 con 0x7f79340d2450 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f792bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 0x7f793409e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f792bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 0x7f793409e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50930/0 (socket says 172.21.15.72:50930) 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f792bfff640 1 -- 172.21.15.72:0/749150593 learned_addr learned my addr 172.21.15.72:0/749150593 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f7939425640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f793415e170 0x7f79340cd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.712+0000 7f7938c24640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79340d2450 0x7f7934155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f792bfff640 1 -- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79340d2450 msgr2=0x7f7934155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f792bfff640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79340d2450 0x7f7934155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f792bfff640 1 -- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f793415e170 msgr2=0x7f79340cd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f792bfff640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f793415e170 0x7f79340cd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f792bfff640 1 -- 172.21.15.72:0/749150593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7930009400 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f792bfff640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 0x7f793409e890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f792400c4b0 tx=0x7f792400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924005480 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79240035f0 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f792c009b30 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79240039e0 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.713+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793409ddb0 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.714+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79340a1ef0 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.714+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7924003b40 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.715+0000 7f79297fa640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f792006b810 0x7f792006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.715+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7924089a80 con 0x7f79340d4930 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.715+0000 7f7938c24640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f792006b810 0x7f792006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:37.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.715+0000 7f7938c24640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f792006b810 0x7f792006dcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7930009c30 tx=0x7f7930009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:37.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.719+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7924054220 con 0x7f79340d4930 2024-03-24T10:36:37.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.890+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f793404f550 con 0x7f79340d4930 2024-03-24T10:36:37.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.891+0000 7f79297fa640 1 -- 172.21.15.72:0/749150593 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f79240578e0 con 0x7f79340d4930 2024-03-24T10:36:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:37.892 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f792006b810 msgr2=0x7f792006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f792006b810 0x7f792006dcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7930009c30 tx=0x7f7930009190 comp rx=0 tx=0).stop 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 msgr2=0x7f793409e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 0x7f793409e890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f792400c4b0 tx=0x7f792400c970 comp rx=0 tx=0).stop 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 shutdown_connections 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f792006b810 0x7f792006dcd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f793415e170 0x7f79340cd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f79340d4930 0x7f793409e890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 --2- 172.21.15.72:0/749150593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79340d2450 0x7f7934155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 >> 172.21.15.72:0/749150593 conn(0x7f793409d310 msgr2=0x7f79340d3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 shutdown_connections 2024-03-24T10:36:37.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:37.894+0000 7f793ae88640 1 -- 172.21.15.72:0/749150593 wait complete. 2024-03-24T10:36:37.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:36:37.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:36:38.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.008+0000 7f82e4719640 1 Processor -- start 2024-03-24T10:36:38.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.008+0000 7f82e4719640 1 -- start start 2024-03-24T10:36:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e4719640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82dc142490 0x7f82dc0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e4719640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82dc0b2b10 0x7f82dc0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e4719640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82dc0b2f80 con 0x7f82dc0ce1b0 2024-03-24T10:36:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e4719640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f82dc0b3210 con 0x7f82dc142490 2024-03-24T10:36:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e4719640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f82dc0b34f0 con 0x7f82dc0b2b10 2024-03-24T10:36:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82dc142490 0x7f82dc0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f82dc142490 0x7f82dc0b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50940/0 (socket says 172.21.15.72:50940) 2024-03-24T10:36:38.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 -- 172.21.15.72:0/98034385 learned_addr learned my addr 172.21.15.72:0/98034385 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:38.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e1cb4640 1 --2- 172.21.15.72:0/98034385 >> v2:172.21.15.79:3300/0 conn(0x7f82dc0b2b10 0x7f82dc0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 -- 172.21.15.72:0/98034385 >> v2:172.21.15.79:3300/0 conn(0x7f82dc0b2b10 msgr2=0x7f82dc0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:38.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 --2- 172.21.15.72:0/98034385 >> v2:172.21.15.79:3300/0 conn(0x7f82dc0b2b10 0x7f82dc0cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 -- 172.21.15.72:0/98034385 >> v1:172.21.15.79:6789/0 conn(0x7f82dc0ce1b0 legacy=0x7f82dc0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.009+0000 7f82e24b5640 1 -- 172.21.15.72:0/98034385 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc0b37d0 con 0x7f82dc142490 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.010+0000 7f82e24b5640 1 --2- 172.21.15.72:0/98034385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc0b42b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0b4ad0 tx=0x7f82d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151dea24e976f502 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.010+0000 7f82e14b3640 1 -- 172.21.15.72:0/98034385 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d8030860 con 0x7f82dc142490 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.010+0000 7f82e14b3640 1 -- 172.21.15.72:0/98034385 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d80309c0 con 0x7f82dc142490 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.010+0000 7f82e14b3640 1 -- 172.21.15.72:0/98034385 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d8030d50 con 0x7f82dc142490 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.010+0000 7f82e4719640 1 -- 172.21.15.72:0/98034385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 msgr2=0x7f82dc0b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.010+0000 7f82e4719640 1 --2- 172.21.15.72:0/98034385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc0b42b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f82dc0b4ad0 tx=0x7f82d802b9a0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.011+0000 7f82e4719640 1 -- 172.21.15.72:0/98034385 shutdown_connections 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.011+0000 7f82e4719640 1 --2- 172.21.15.72:0/98034385 >> v2:172.21.15.79:3300/0 conn(0x7f82dc0b2b10 0x7f82dc0cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.011+0000 7f82e4719640 1 --2- 172.21.15.72:0/98034385 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc0b42b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.011+0000 7f82e4719640 1 -- 172.21.15.72:0/98034385 >> 172.21.15.72:0/98034385 conn(0x7f82dc0b1810 msgr2=0x7f82dc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.011+0000 7f82e4719640 1 -- 172.21.15.72:0/98034385 shutdown_connections 2024-03-24T10:36:38.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.011+0000 7f82e4719640 1 -- 172.21.15.72:0/98034385 wait complete. 2024-03-24T10:36:38.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 Processor -- start 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 -- start start 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc0b2b10 0x7f82dc15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82dc0ce1b0 0x7f82dc072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc071be0 con 0x7f82dc142490 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc154d20 con 0x7f82dc0b2b10 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.012+0000 7f82e4719640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f82dc070fd0 con 0x7f82dc0ce1b0 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc13e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50944/0 (socket says 172.21.15.72:50944) 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e24b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc0b2b10 0x7f82dc15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 -- 172.21.15.72:0/2665559247 learned_addr learned my addr 172.21.15.72:0/2665559247 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e1cb4640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82dc0ce1b0 0x7f82dc072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 -- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82dc0ce1b0 msgr2=0x7f82dc072410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82dc0ce1b0 0x7f82dc072410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 -- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc0b2b10 msgr2=0x7f82dc15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc0b2b10 0x7f82dc15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 -- 172.21.15.72:0/2665559247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d80094d0 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e2cb6640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc13e3a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c7a0 tx=0x7f82d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4003b70 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82d4003cf0 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4003ea0 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc0712b0 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.013+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc071870 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.014+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82dc04f470 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.015+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f82d400aa90 con 0x7f82dc142490 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.015+0000 7f82d2ffd640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82c006b810 0x7f82c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.015+0000 7f82e24b5640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82c006b810 0x7f82c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.015+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f82d408a200 con 0x7f82dc142490 2024-03-24T10:36:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.015+0000 7f82e24b5640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82c006b810 0x7f82c006dcd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82d8036000 tx=0x7f82d8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.019+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f82d4054990 con 0x7f82dc142490 2024-03-24T10:36:38.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.191+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82dc0afb70 con 0x7f82dc142490 2024-03-24T10:36:38.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.191+0000 7f82d2ffd640 1 -- 172.21.15.72:0/2665559247 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f82d4058050 con 0x7f82dc142490 2024-03-24T10:36:38.194 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:36:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82c006b810 msgr2=0x7f82c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82c006b810 0x7f82c006dcd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f82d8036000 tx=0x7f82d8008030 comp rx=0 tx=0).stop 2024-03-24T10:36:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 msgr2=0x7f82dc13e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc13e3a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f82d400c7a0 tx=0x7f82d400cc60 comp rx=0 tx=0).stop 2024-03-24T10:36:38.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 shutdown_connections 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82c006b810 0x7f82c006dcd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82dc142490 0x7f82dc13e3a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82dc0ce1b0 0x7f82dc072410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 --2- 172.21.15.72:0/2665559247 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc0b2b10 0x7f82dc15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 >> 172.21.15.72:0/2665559247 conn(0x7f82dc0b1810 msgr2=0x7f82dc0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 shutdown_connections 2024-03-24T10:36:38.196 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.193+0000 7f82e4719640 1 -- 172.21.15.72:0/2665559247 wait complete. 2024-03-24T10:36:38.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:36:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.310+0000 7f7deda23640 1 Processor -- start 2024-03-24T10:36:38.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.310+0000 7f7deda23640 1 -- start start 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7deda23640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e180 0x7f7de80d1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7deda23640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7de80ca650 0x7f7de80d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7deda23640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de80c81b0 con 0x7f7de815e560 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7deda23640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f7de80d18d0 con 0x7f7de80ca650 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7deda23640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7de80cfc30 con 0x7f7de815e180 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7de80ca650 0x7f7de80d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7de80ca650 0x7f7de80d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50956/0 (socket says 172.21.15.72:50956) 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 -- 172.21.15.72:0/4026414722 learned_addr learned my addr 172.21.15.72:0/4026414722 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7de6ffd640 1 --2- 172.21.15.72:0/4026414722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e180 0x7f7de80d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 -- 172.21.15.72:0/4026414722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e180 msgr2=0x7f7de80d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:38.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 --2- 172.21.15.72:0/4026414722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e180 0x7f7de80d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 -- 172.21.15.72:0/4026414722 >> v1:172.21.15.79:6789/0 conn(0x7f7de815e560 legacy=0x7f7de80d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7de67fc640 1 -- 172.21.15.72:0/4026414722 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226435290 0 0) 0x7f7de80c81b0 con 0x7f7de815e560 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.311+0000 7f7dde7fc640 1 -- 172.21.15.72:0/4026414722 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de80cff10 con 0x7f7de80ca650 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.312+0000 7f7dde7fc640 1 --2- 172.21.15.72:0/4026414722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de80d06a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009870 tx=0x7f7dd002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2f560934b93cfa server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.312+0000 7f7de67fc640 1 -- 172.21.15.72:0/4026414722 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0030840 con 0x7f7de80ca650 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.312+0000 7f7de67fc640 1 -- 172.21.15.72:0/4026414722 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd00309a0 con 0x7f7de80ca650 2024-03-24T10:36:38.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.312+0000 7f7de67fc640 1 -- 172.21.15.72:0/4026414722 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0030d30 con 0x7f7de80ca650 2024-03-24T10:36:38.318 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 -- 172.21.15.72:0/4026414722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 msgr2=0x7f7de80d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 --2- 172.21.15.72:0/4026414722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de80d06a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0009870 tx=0x7f7dd002b980 comp rx=0 tx=0).stop 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 -- 172.21.15.72:0/4026414722 shutdown_connections 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 --2- 172.21.15.72:0/4026414722 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de80d06a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 --2- 172.21.15.72:0/4026414722 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e180 0x7f7de80d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 -- 172.21.15.72:0/4026414722 >> 172.21.15.72:0/4026414722 conn(0x7f7de80d3f70 msgr2=0x7f7de80d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 -- 172.21.15.72:0/4026414722 shutdown_connections 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.313+0000 7f7deda23640 1 -- 172.21.15.72:0/4026414722 wait complete. 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.314+0000 7f7deda23640 1 Processor -- start 2024-03-24T10:36:38.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.314+0000 7f7deda23640 1 -- start start 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7deda23640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de81f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7deda23640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7de815e180 0x7f7de81f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7deda23640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e560 0x7f7de80c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7deda23640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7de81f4740 con 0x7f7de80ca650 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7deda23640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7de81f35d0 con 0x7f7de815e180 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7deda23640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7de8150110 con 0x7f7de815e560 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de81f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de81f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50960/0 (socket says 172.21.15.72:50960) 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 -- 172.21.15.72:0/2711826386 learned_addr learned my addr 172.21.15.72:0/2711826386 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7dde7fc640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7de815e180 0x7f7de81f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de77fe640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e560 0x7f7de80c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 -- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e560 msgr2=0x7f7de80c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e560 0x7f7de80c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 -- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7de815e180 msgr2=0x7f7de81f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7de815e180 0x7f7de81f3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.315+0000 7f7de6ffd640 1 -- 172.21.15.72:0/2711826386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd00094d0 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.316+0000 7f7de6ffd640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de81f4200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800e9b0 tx=0x7f7dd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.316+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8009670 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.316+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd800c9a0 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.316+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de81503f0 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.316+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800cd50 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.316+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de81509b0 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.317+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de804f470 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.317+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7dd8013470 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.318+0000 7f7de4ff9640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7dc806b810 0x7f7dc806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.318+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7dd808a720 con 0x7f7de80ca650 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.318+0000 7f7dde7fc640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7dc806b810 0x7f7dc806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.318+0000 7f7dde7fc640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7dc806b810 0x7f7dc806dcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0036000 tx=0x7f7dd0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.322+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7dd8054e30 con 0x7f7de80ca650 2024-03-24T10:36:38.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.492+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7de806bc10 con 0x7f7de80ca650 2024-03-24T10:36:38.493 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.492+0000 7f7de4ff9640 1 -- 172.21.15.72:0/2711826386 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f7dd80584f0 con 0x7f7de80ca650 2024-03-24T10:36:38.493 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:38.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7dc806b810 msgr2=0x7f7dc806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7dc806b810 0x7f7dc806dcd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0036000 tx=0x7f7dd0008030 comp rx=0 tx=0).stop 2024-03-24T10:36:38.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 msgr2=0x7f7de81f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.495 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de81f4200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800e9b0 tx=0x7f7dd800ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 shutdown_connections 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7dc806b810 0x7f7dc806dcd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7de815e560 0x7f7de80c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7de815e180 0x7f7de81f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 --2- 172.21.15.72:0/2711826386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7de80ca650 0x7f7de81f4200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.494+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 >> 172.21.15.72:0/2711826386 conn(0x7f7de80d3f70 msgr2=0x7f7de815d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.495+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 shutdown_connections 2024-03-24T10:36:38.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.495+0000 7f7deda23640 1 -- 172.21.15.72:0/2711826386 wait complete. 2024-03-24T10:36:38.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:36:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.608+0000 7ff0d9d3e640 1 Processor -- start 2024-03-24T10:36:38.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.608+0000 7ff0d9d3e640 1 -- start start 2024-03-24T10:36:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d9d3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff0d415e240 0x7ff0d40d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d9d3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40d0f70 0x7ff0d40d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d9d3e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0d40d4950 con 0x7ff0d40b3da0 2024-03-24T10:36:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d9d3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff0d40d2270 con 0x7ff0d415e240 2024-03-24T10:36:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d9d3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40b38c0 con 0x7ff0d40d0f70 2024-03-24T10:36:38.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d3fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff0d40b3da0 0x7ff0d40b4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58362/0 (socket says 172.21.15.72:58362) 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d3fff640 1 -- 172.21.15.72:0/3475362166 learned_addr learned my addr 172.21.15.72:0/3475362166 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d37fe640 1 --2- 172.21.15.72:0/3475362166 >> v2:172.21.15.79:3300/0 conn(0x7ff0d415e240 0x7ff0d40d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.609+0000 7ff0d2ffd640 1 --2- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40d0f70 0x7ff0d40d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.610+0000 7ff0d37fe640 1 -- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40d0f70 msgr2=0x7ff0d40d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.610+0000 7ff0d37fe640 1 --2- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40d0f70 0x7ff0d40d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.610+0000 7ff0d37fe640 1 -- 172.21.15.72:0/3475362166 >> v1:172.21.15.72:6789/0 conn(0x7ff0d40b3da0 legacy=0x7ff0d40b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.610+0000 7ff0d37fe640 1 -- 172.21.15.72:0/3475362166 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d40b3550 con 0x7ff0d415e240 2024-03-24T10:36:38.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.610+0000 7ff0d27fc640 1 -- 172.21.15.72:0/3475362166 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384475513 0 0) 0x7ff0d40d4950 con 0x7ff0d40b3da0 2024-03-24T10:36:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.610+0000 7ff0d37fe640 1 --2- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d40d2410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40097a0 tx=0x7ff0c402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6eaad1a366e061a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d27fc640 1 -- 172.21.15.72:0/3475362166 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c402e070 con 0x7ff0d415e240 2024-03-24T10:36:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d27fc640 1 -- 172.21.15.72:0/3475362166 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c40315a0 con 0x7ff0d415e240 2024-03-24T10:36:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d27fc640 1 -- 172.21.15.72:0/3475362166 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4031930 con 0x7ff0d415e240 2024-03-24T10:36:38.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 msgr2=0x7ff0d40d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d40d2410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff0c40097a0 tx=0x7ff0c402b840 comp rx=0 tx=0).stop 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3475362166 shutdown_connections 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40d0f70 0x7ff0d40d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3475362166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d40d2410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3475362166 >> 172.21.15.72:0/3475362166 conn(0x7ff0d40d3e30 msgr2=0x7ff0d40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3475362166 shutdown_connections 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.611+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3475362166 wait complete. 2024-03-24T10:36:38.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.612+0000 7ff0d9d3e640 1 Processor -- start 2024-03-24T10:36:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.612+0000 7ff0d9d3e640 1 -- start start 2024-03-24T10:36:38.615 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d9d3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40b3da0 0x7ff0d40cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d9d3e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 0x7ff0d415fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d9d3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d4160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d9d3e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d40cbbb0 con 0x7ff0d40d0f70 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d9d3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d415a0e0 con 0x7ff0d415e240 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d9d3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d40cafa0 con 0x7ff0d40b3da0 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 0x7ff0d415fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d2ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 0x7ff0d415fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50966/0 (socket says 172.21.15.72:50966) 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d2ffd640 1 -- 172.21.15.72:0/3436287329 learned_addr learned my addr 172.21.15.72:0/3436287329 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d3fff640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d4160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.613+0000 7ff0d37fe640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40b3da0 0x7ff0d40cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d2ffd640 1 -- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40b3da0 msgr2=0x7ff0d40cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d2ffd640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40b3da0 0x7ff0d40cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d2ffd640 1 -- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 msgr2=0x7ff0d4160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d2ffd640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d4160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d2ffd640 1 -- 172.21.15.72:0/3436287329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c4009400 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d2ffd640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 0x7ff0d415fbe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800e870 tx=0x7ff0c800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c80094f0 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c800c940 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d40cb280 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c800ccd0 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.614+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d40cb840 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.615+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d404f470 con 0x7ff0d40d0f70 2024-03-24T10:36:38.617 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.615+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff0c8013470 con 0x7ff0d40d0f70 2024-03-24T10:36:38.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.616+0000 7ff0bbfff640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff0c006b810 0x7ff0c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.616+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff0c808a5e0 con 0x7ff0d40d0f70 2024-03-24T10:36:38.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.616+0000 7ff0d37fe640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff0c006b810 0x7ff0c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.616+0000 7ff0d37fe640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff0c006b810 0x7ff0c006dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4036000 tx=0x7ff0c403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.620+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff0c8054cf0 con 0x7ff0d40d0f70 2024-03-24T10:36:38.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.792+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff0d415a930 con 0x7ff0d40d0f70 2024-03-24T10:36:38.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.792+0000 7ff0bbfff640 1 -- 172.21.15.72:0/3436287329 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7ff0c8077020 con 0x7ff0d40d0f70 2024-03-24T10:36:38.793 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff0c006b810 msgr2=0x7ff0c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff0c006b810 0x7ff0c006dcd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4036000 tx=0x7ff0c403d040 comp rx=0 tx=0).stop 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 msgr2=0x7ff0d415fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 0x7ff0d415fbe0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800e870 tx=0x7ff0c800ed30 comp rx=0 tx=0).stop 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 shutdown_connections 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff0c006b810 0x7ff0c006dcd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0d415e240 0x7ff0d4160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff0d40d0f70 0x7ff0d415fbe0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 --2- 172.21.15.72:0/3436287329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff0d40b3da0 0x7ff0d40cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 >> 172.21.15.72:0/3436287329 conn(0x7ff0d40d3e30 msgr2=0x7ff0d406c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 shutdown_connections 2024-03-24T10:36:38.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.794+0000 7ff0d9d3e640 1 -- 172.21.15.72:0/3436287329 wait complete. 2024-03-24T10:36:38.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:36:38.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.907+0000 7f05f0ab5640 1 Processor -- start 2024-03-24T10:36:38.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.907+0000 7f05f0ab5640 1 -- start start 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05f0ab5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f05ec0ce8c0 0x7f05ec0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05f0ab5640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ec0b3210 con 0x7f05ec0b2b10 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05f0ab5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05ec0b34f0 con 0x7f05ec142490 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05f0ab5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f05ec0b37d0 con 0x7f05ec0ce8c0 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05ead9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f05ec0b2b10 0x7f05ec142e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58376/0 (socket says 172.21.15.72:58376) 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05ead9d640 1 -- 172.21.15.72:0/1959867843 learned_addr learned my addr 172.21.15.72:0/1959867843 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05e9d9b640 1 --2- 172.21.15.72:0/1959867843 >> v2:172.21.15.79:3300/0 conn(0x7f05ec0ce8c0 0x7f05ec0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05e959a640 1 -- 172.21.15.72:0/1959867843 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560781681 0 0) 0x7f05ec0b3210 con 0x7f05ec0b2b10 2024-03-24T10:36:38.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05e959a640 1 -- 172.21.15.72:0/1959867843 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05d4003520 con 0x7f05ec0b2b10 2024-03-24T10:36:38.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05e9d9b640 1 -- 172.21.15.72:0/1959867843 >> v1:172.21.15.79:6789/0 conn(0x7f05ec142490 legacy=0x7f05ec0ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05e9d9b640 1 -- 172.21.15.72:0/1959867843 >> v1:172.21.15.72:6789/0 conn(0x7f05ec0b2b10 legacy=0x7f05ec142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.908+0000 7f05e9d9b640 1 -- 172.21.15.72:0/1959867843 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05ec0b3ab0 con 0x7f05ec0ce8c0 2024-03-24T10:36:38.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.909+0000 7f05e9d9b640 1 --2- 172.21.15.72:0/1959867843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec0ce8c0 0x7f05ec0b42b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0097a0 tx=0x7f05dc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7ae7402ddcee210 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.909+0000 7f05e959a640 1 -- 172.21.15.72:0/1959867843 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc031830 con 0x7f05ec0ce8c0 2024-03-24T10:36:38.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.909+0000 7f05e959a640 1 -- 172.21.15.72:0/1959867843 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05dc031990 con 0x7f05ec0ce8c0 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.909+0000 7f05e959a640 1 -- 172.21.15.72:0/1959867843 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc031d00 con 0x7f05ec0ce8c0 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 -- 172.21.15.72:0/1959867843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec0ce8c0 msgr2=0x7f05ec0b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/1959867843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec0ce8c0 0x7f05ec0b42b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0097a0 tx=0x7f05dc02b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 -- 172.21.15.72:0/1959867843 shutdown_connections 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/1959867843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec0ce8c0 0x7f05ec0b42b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 -- 172.21.15.72:0/1959867843 >> 172.21.15.72:0/1959867843 conn(0x7f05ec0b1810 msgr2=0x7f05ec0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 -- 172.21.15.72:0/1959867843 shutdown_connections 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.910+0000 7f05f0ab5640 1 -- 172.21.15.72:0/1959867843 wait complete. 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.911+0000 7f05f0ab5640 1 Processor -- start 2024-03-24T10:36:38.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.911+0000 7f05f0ab5640 1 -- start start 2024-03-24T10:36:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05f0ab5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 0x7f05ec159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05f0ab5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05ec0ce8c0 0x7f05ec1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05f0ab5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec142490 0x7f05ec1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05f0ab5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec13a370 con 0x7f05ec0b2b10 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05f0ab5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05ec13a650 con 0x7f05ec142490 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05f0ab5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f05ec13a930 con 0x7f05ec0ce8c0 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 0x7f05ec159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 0x7f05ec159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50980/0 (socket says 172.21.15.72:50980) 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 -- 172.21.15.72:0/840149912 learned_addr learned my addr 172.21.15.72:0/840149912 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ead9d640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec142490 0x7f05ec1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05e9d9b640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05ec0ce8c0 0x7f05ec1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 -- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05ec0ce8c0 msgr2=0x7f05ec1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05ec0ce8c0 0x7f05ec1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 -- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec142490 msgr2=0x7f05ec1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec142490 0x7f05ec1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:38.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.912+0000 7f05ea59c640 1 -- 172.21.15.72:0/840149912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc009400 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.913+0000 7f05ea59c640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 0x7f05ec159b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c3c0 tx=0x7f05e000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.913+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e00052d0 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.913+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05e0005450 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.913+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05ec13ac10 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.913+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05e0007260 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.913+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05ec15e2d0 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.914+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05ec13b130 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.914+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f05e00073c0 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.914+0000 7f05daffd640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f05cc06b810 0x7f05cc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.915+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f05e0089780 con 0x7f05ec0b2b10 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.915+0000 7f05e9d9b640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f05cc06b810 0x7f05cc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:38.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.915+0000 7f05e9d9b640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f05cc06b810 0x7f05cc06dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05dc036000 tx=0x7f05dc03e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:38.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:38.919+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f05ec13b130 con 0x7f05ec0b2b10 2024-03-24T10:36:39.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.090+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f05ec13b130 con 0x7f05ec0b2b10 2024-03-24T10:36:39.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.091+0000 7f05daffd640 1 -- 172.21.15.72:0/840149912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f05ec13b130 con 0x7f05ec0b2b10 2024-03-24T10:36:39.091 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:39.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f05cc06b810 msgr2=0x7f05cc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f05cc06b810 0x7f05cc06dcd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f05dc036000 tx=0x7f05dc03e040 comp rx=0 tx=0).stop 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 msgr2=0x7f05ec159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 0x7f05ec159b20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c3c0 tx=0x7f05e000c880 comp rx=0 tx=0).stop 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 shutdown_connections 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f05cc06b810 0x7f05cc06dcd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05ec142490 0x7f05ec1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f05ec0ce8c0 0x7f05ec1560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 --2- 172.21.15.72:0/840149912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f05ec0b2b10 0x7f05ec159b20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 >> 172.21.15.72:0/840149912 conn(0x7f05ec0b1810 msgr2=0x7f05ec06ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 shutdown_connections 2024-03-24T10:36:39.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.093+0000 7f05f0ab5640 1 -- 172.21.15.72:0/840149912 wait complete. 2024-03-24T10:36:39.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:36:39.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.208+0000 7f2daaa15640 1 Processor -- start 2024-03-24T10:36:39.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.208+0000 7f2daaa15640 1 -- start start 2024-03-24T10:36:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2daaa15640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2da40d2600 0x7f2da40d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2daaa15640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 0x7f2da40cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2daaa15640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2da40d3be0 con 0x7f2da4161910 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2daaa15640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2da406d030 con 0x7f2da40d2600 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2daaa15640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2da406c3b0 con 0x7f2da406bcb0 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2da8fb2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 0x7f2da40cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2da37fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2da40d2600 0x7f2da40d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2da8fb2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 0x7f2da40cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:50366/0 (socket says 172.21.15.72:50366) 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.209+0000 7f2da8fb2640 1 -- 172.21.15.72:0/3916767425 learned_addr learned my addr 172.21.15.72:0/3916767425 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.210+0000 7f2da37fe640 1 -- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 msgr2=0x7f2da40cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.210+0000 7f2da37fe640 1 --2- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 0x7f2da40cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.210+0000 7f2da37fe640 1 -- 172.21.15.72:0/3916767425 >> v1:172.21.15.79:6789/0 conn(0x7f2da4161910 legacy=0x7f2da40d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.210+0000 7f2da37fe640 1 -- 172.21.15.72:0/3916767425 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da406c690 con 0x7f2da40d2600 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.210+0000 7f2da8fb2640 1 --2- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 0x7f2da40cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.210+0000 7f2da37fe640 1 --2- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40d2600 0x7f2da40d34c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d980097a0 tx=0x7f2d9802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e80cd68ba5a897b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2da2ffd640 1 -- 172.21.15.72:0/3916767425 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9802e070 con 0x7f2da40d2600 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2da2ffd640 1 -- 172.21.15.72:0/3916767425 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d980315a0 con 0x7f2da40d2600 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2da2ffd640 1 -- 172.21.15.72:0/3916767425 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98031930 con 0x7f2da40d2600 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 -- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40d2600 msgr2=0x7f2da40d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 --2- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40d2600 0x7f2da40d34c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2d980097a0 tx=0x7f2d9802b840 comp rx=0 tx=0).stop 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 -- 172.21.15.72:0/3916767425 shutdown_connections 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 --2- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da406bcb0 0x7f2da40cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 --2- 172.21.15.72:0/3916767425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da40d2600 0x7f2da40d34c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 -- 172.21.15.72:0/3916767425 >> 172.21.15.72:0/3916767425 conn(0x7f2da40d3ff0 msgr2=0x7f2da40d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 -- 172.21.15.72:0/3916767425 shutdown_connections 2024-03-24T10:36:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.211+0000 7f2daaa15640 1 -- 172.21.15.72:0/3916767425 wait complete. 2024-03-24T10:36:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.212+0000 7f2daaa15640 1 Processor -- start 2024-03-24T10:36:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.212+0000 7f2daaa15640 1 -- start start 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2daaa15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da406bcb0 0x7f2da414c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2daaa15640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da40d2600 0x7f2da40d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2daaa15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da4161910 0x7f2da40d1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2daaa15640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2da40c91d0 con 0x7f2da4161910 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2daaa15640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2da40b7e90 con 0x7f2da406bcb0 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2daaa15640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2da40b8170 con 0x7f2da40d2600 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2da8fb2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da4161910 0x7f2da40d1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:39.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2da3fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da406bcb0 0x7f2da414c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2da8fb2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da4161910 0x7f2da40d1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:50986/0 (socket says 172.21.15.72:50986) 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2da37fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da40d2600 0x7f2da40d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.213+0000 7f2da8fb2640 1 -- 172.21.15.72:0/1805815543 learned_addr learned my addr 172.21.15.72:0/1805815543 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da3fff640 1 -- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da40d2600 msgr2=0x7f2da40d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da3fff640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da40d2600 0x7f2da40d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da3fff640 1 -- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da4161910 msgr2=0x7f2da40d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da3fff640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da4161910 0x7f2da40d1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da3fff640 1 -- 172.21.15.72:0/1805815543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9c009b30 con 0x7f2da406bcb0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da3fff640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da406bcb0 0x7f2da414c030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2da408d9d0 tx=0x7f2d9400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d940052d0 con 0x7f2da406bcb0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d94005450 con 0x7f2da406bcb0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d98009400 con 0x7f2da406bcb0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94003850 con 0x7f2da406bcb0 2024-03-24T10:36:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.214+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da40b8730 con 0x7f2da406bcb0 2024-03-24T10:36:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.215+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da4073d50 con 0x7f2da406bcb0 2024-03-24T10:36:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.215+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2d940039b0 con 0x7f2da406bcb0 2024-03-24T10:36:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.216+0000 7f2da0ff9640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d9006b810 0x7f2d9006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.216+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d940898e0 con 0x7f2da406bcb0 2024-03-24T10:36:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.216+0000 7f2da37fe640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d9006b810 0x7f2d9006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.216+0000 7f2da37fe640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d9006b810 0x7f2d9006dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2d98036000 tx=0x7f2d9803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:39.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.221+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2d94053fd0 con 0x7f2da406bcb0 2024-03-24T10:36:39.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.405+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2da40cae60 con 0x7f2da406bcb0 2024-03-24T10:36:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.406+0000 7f2da0ff9640 1 -- 172.21.15.72:0/1805815543 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f2d94057690 con 0x7f2da406bcb0 2024-03-24T10:36:39.407 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T10:36:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d9006b810 msgr2=0x7f2d9006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d9006b810 0x7f2d9006dcd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2d98036000 tx=0x7f2d9803d040 comp rx=0 tx=0).stop 2024-03-24T10:36:39.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da406bcb0 msgr2=0x7f2da414c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da406bcb0 0x7f2da414c030 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2da408d9d0 tx=0x7f2d9400c760 comp rx=0 tx=0).stop 2024-03-24T10:36:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 shutdown_connections 2024-03-24T10:36:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d9006b810 0x7f2d9006dcd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2da4161910 0x7f2da40d1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2da40d2600 0x7f2da40d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 --2- 172.21.15.72:0/1805815543 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da406bcb0 0x7f2da414c030 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 >> 172.21.15.72:0/1805815543 conn(0x7f2da40d3ff0 msgr2=0x7f2da40d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 shutdown_connections 2024-03-24T10:36:39.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:39.408+0000 7f2daaa15640 1 -- 172.21.15.72:0/1805815543 wait complete. 2024-03-24T10:36:39.419 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2024-03-24T10:36:39.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:39.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-24T10:36:39.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[44689]: fuse finished with error 0 and tester_r 0 2024-03-24T10:36:39.448 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:36:45.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:36:45.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:45.550 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-24T10:36:45.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:45.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.727+0000 7f51e4d93640 1 Processor -- start 2024-03-24T10:36:45.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.727+0000 7f51e4d93640 1 -- start start 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51e4d93640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 0x7f51e00ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51e4d93640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51e006d120 0x7f51e006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51e4d93640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e00cd5a0 con 0x7f51e006ee20 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51e4d93640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f51e0071bb0 con 0x7f51e006d120 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51e4d93640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f51e006daf0 con 0x7f51e015e2f0 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51ded9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51e006d120 0x7f51e006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:45.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 0x7f51e00ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 0x7f51e00ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55278/0 (socket says 172.21.15.72:55278) 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51ded9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f51e006d120 0x7f51e006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:48932/0 (socket says 172.21.15.72:48932) 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 -- 172.21.15.72:0/2289256905 learned_addr learned my addr 172.21.15.72:0/2289256905 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 -- 172.21.15.72:0/2289256905 >> v2:172.21.15.79:3300/0 conn(0x7f51e006d120 msgr2=0x7f51e006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 --2- 172.21.15.72:0/2289256905 >> v2:172.21.15.79:3300/0 conn(0x7f51e006d120 0x7f51e006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 -- 172.21.15.72:0/2289256905 >> v1:172.21.15.79:6789/0 conn(0x7f51e006ee20 legacy=0x7f51e00ace50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.728+0000 7f51de59c640 1 -- 172.21.15.72:0/2289256905 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e00cd2c0 con 0x7f51e015e2f0 2024-03-24T10:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.729+0000 7f51de59c640 1 --2- 172.21.15.72:0/2289256905 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 0x7f51e00ca5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009870 tx=0x7f51d002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e0963547c8c5afb server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.729+0000 7f51dd59a640 1 -- 172.21.15.72:0/2289256905 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d00317c0 con 0x7f51e015e2f0 2024-03-24T10:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.729+0000 7f51dd59a640 1 -- 172.21.15.72:0/2289256905 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d0031920 con 0x7f51e015e2f0 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.729+0000 7f51dd59a640 1 -- 172.21.15.72:0/2289256905 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0031cb0 con 0x7f51e015e2f0 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 -- 172.21.15.72:0/2289256905 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 msgr2=0x7f51e00ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 --2- 172.21.15.72:0/2289256905 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 0x7f51e00ca5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f51d0009870 tx=0x7f51d002b860 comp rx=0 tx=0).stop 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 -- 172.21.15.72:0/2289256905 shutdown_connections 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 --2- 172.21.15.72:0/2289256905 >> v2:172.21.15.79:3300/0 conn(0x7f51e006d120 0x7f51e006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 --2- 172.21.15.72:0/2289256905 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e015e2f0 0x7f51e00ca5f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 -- 172.21.15.72:0/2289256905 >> 172.21.15.72:0/2289256905 conn(0x7f51e00b1b70 msgr2=0x7f51e00b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 -- 172.21.15.72:0/2289256905 shutdown_connections 2024-03-24T10:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.730+0000 7f51e4d93640 1 -- 172.21.15.72:0/2289256905 wait complete. 2024-03-24T10:36:45.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.731+0000 7f51e4d93640 1 Processor -- start 2024-03-24T10:36:45.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.731+0000 7f51e4d93640 1 -- start start 2024-03-24T10:36:45.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51e4d93640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 0x7f51e0161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51e4d93640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e006ee20 0x7f51e00b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51e4d93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e015e2f0 0x7f51e00b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51e4d93640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00c5e00 con 0x7f51e006d120 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51e4d93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f51e00c51f0 con 0x7f51e015e2f0 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51e4d93640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f51e00c54d0 con 0x7f51e006ee20 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51de59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 0x7f51e0161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51de59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 0x7f51e0161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33146/0 (socket says 172.21.15.72:33146) 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51de59c640 1 -- 172.21.15.72:0/1623707317 learned_addr learned my addr 172.21.15.72:0/1623707317 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51ddd9b640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e006ee20 0x7f51e00b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.732+0000 7f51ded9d640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e015e2f0 0x7f51e00b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51de59c640 1 -- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e006ee20 msgr2=0x7f51e00b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51de59c640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e006ee20 0x7f51e00b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51de59c640 1 -- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e015e2f0 msgr2=0x7f51e00b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:45.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51de59c640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e015e2f0 0x7f51e00b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51de59c640 1 -- 172.21.15.72:0/1623707317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d00094d0 con 0x7f51e006d120 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51de59c640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 0x7f51e0161100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51d002b8a0 tx=0x7f51d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0032860 con 0x7f51e006d120 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d00329e0 con 0x7f51e006d120 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e00c57b0 con 0x7f51e006d120 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0032d90 con 0x7f51e006d120 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.733+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e0161640 con 0x7f51e006d120 2024-03-24T10:36:45.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.734+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e00c5610 con 0x7f51e006d120 2024-03-24T10:36:45.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.734+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f51d004e450 con 0x7f51e006d120 2024-03-24T10:36:45.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.735+0000 7f51ceffd640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f51c006b810 0x7f51c006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:45.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.735+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f51d00ac5d0 con 0x7f51e006d120 2024-03-24T10:36:45.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.735+0000 7f51ddd9b640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f51c006b810 0x7f51c006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:45.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.735+0000 7f51ddd9b640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f51c006b810 0x7f51c006dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51e00b2260 tx=0x7f51d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:45.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.739+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f51e00c5610 con 0x7f51e006d120 2024-03-24T10:36:45.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.910+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51e00c5610 con 0x7f51e006d120 2024-03-24T10:36:45.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.911+0000 7f51ceffd640 1 -- 172.21.15.72:0/1623707317 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f51e00c5610 con 0x7f51e006d120 2024-03-24T10:36:45.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:45.912 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:45.913 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f51c006b810 msgr2=0x7f51c006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f51c006b810 0x7f51c006dcd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51e00b2260 tx=0x7f51d4009040 comp rx=0 tx=0).stop 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 msgr2=0x7f51e0161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 0x7f51e0161100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f51d002b8a0 tx=0x7f51d00046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 shutdown_connections 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f51c006b810 0x7f51c006dcd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f51e015e2f0 0x7f51e00b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f51e006ee20 0x7f51e00b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 --2- 172.21.15.72:0/1623707317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f51e006d120 0x7f51e0161100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 >> 172.21.15.72:0/1623707317 conn(0x7f51e00b1b70 msgr2=0x7f51e00ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 shutdown_connections 2024-03-24T10:36:45.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:45.913+0000 7f51e4d93640 1 -- 172.21.15.72:0/1623707317 wait complete. 2024-03-24T10:36:45.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:46.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.025+0000 7fefa8647640 1 Processor -- start 2024-03-24T10:36:46.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.025+0000 7fefa8647640 1 -- start start 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa8647640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa8647640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa0071630 con 0x7fefa00cee90 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa8647640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefa015c220 con 0x7fefa006e500 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa8647640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fefa0160940 con 0x7fefa0160040 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa5be2640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fefa00cee90 0x7fefa015f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49796/0 (socket says 172.21.15.72:49796) 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa5be2640 1 -- 172.21.15.72:0/2937991901 learned_addr learned my addr 172.21.15.72:0/2937991901 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa6be4640 1 --2- 172.21.15.72:0/2937991901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1700245545 0 0) 0x7fefa0071630 con 0x7fefa00cee90 2024-03-24T10:36:46.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef8c003520 con 0x7fefa00cee90 2024-03-24T10:36:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578108174 0 0) 0x7fefa015c220 con 0x7fefa006e500 2024-03-24T10:36:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa0071630 con 0x7fefa006e500 2024-03-24T10:36:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa6be4640 1 -- 172.21.15.72:0/2937991901 >> v1:172.21.15.79:6789/0 conn(0x7fefa006e500 legacy=0x7fefa0071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa6be4640 1 -- 172.21.15.72:0/2937991901 >> v1:172.21.15.72:6789/0 conn(0x7fefa00cee90 legacy=0x7fefa015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.026+0000 7fefa6be4640 1 -- 172.21.15.72:0/2937991901 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa0160660 con 0x7fefa0160040 2024-03-24T10:36:46.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.027+0000 7fefa6be4640 1 --2- 172.21.15.72:0/2937991901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00cf310 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fef98009dc0 tx=0x7fef9802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=382502bb2b197997 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:46.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.027+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9802ccd0 con 0x7fefa0160040 2024-03-24T10:36:46.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.027+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef9802ce30 con 0x7fefa0160040 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.027+0000 7fefa53e1640 1 -- 172.21.15.72:0/2937991901 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef98034660 con 0x7fefa0160040 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 -- 172.21.15.72:0/2937991901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 msgr2=0x7fefa00cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 --2- 172.21.15.72:0/2937991901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00cf310 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fef98009dc0 tx=0x7fef9802bf20 comp rx=0 tx=0).stop 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 -- 172.21.15.72:0/2937991901 shutdown_connections 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 --2- 172.21.15.72:0/2937991901 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00cf310 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 -- 172.21.15.72:0/2937991901 >> 172.21.15.72:0/2937991901 conn(0x7fefa00b1920 msgr2=0x7fefa00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 -- 172.21.15.72:0/2937991901 shutdown_connections 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.028+0000 7fefa8647640 1 -- 172.21.15.72:0/2937991901 wait complete. 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.029+0000 7fefa8647640 1 Processor -- start 2024-03-24T10:36:46.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.029+0000 7fefa8647640 1 -- start start 2024-03-24T10:36:46.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa8647640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa006e500 0x7fefa00b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa8647640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 0x7fefa0150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa8647640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa8647640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fefa00b31e0 con 0x7fefa00cee90 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa8647640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fefa00b34c0 con 0x7fefa006e500 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa8647640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fefa00b37a0 con 0x7fefa0160040 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 0x7fefa0150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 0x7fefa0150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33160/0 (socket says 172.21.15.72:33160) 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 -- 172.21.15.72:0/79018084 learned_addr learned my addr 172.21.15.72:0/79018084 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa6be4640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa63e3640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa006e500 0x7fefa00b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 -- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 msgr2=0x7fefa00ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 -- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa006e500 msgr2=0x7fefa00b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa006e500 0x7fefa00b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 -- 172.21.15.72:0/79018084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef98009a70 con 0x7fefa00cee90 2024-03-24T10:36:46.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa6be4640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.030+0000 7fefa5be2640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 0x7fefa0150690 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef9000c500 tx=0x7fef9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.031+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef90005ce0 con 0x7fefa00cee90 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.031+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef90005e40 con 0x7fefa00cee90 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.031+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef900072f0 con 0x7fefa00cee90 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.031+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa00b3a80 con 0x7fefa00cee90 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.031+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa0150bd0 con 0x7fefa00cee90 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.032+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa004f550 con 0x7fefa00cee90 2024-03-24T10:36:46.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.032+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fef90007450 con 0x7fefa00cee90 2024-03-24T10:36:46.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.032+0000 7fef96ffd640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fef8406b810 0x7fef8406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.033+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fef90089a20 con 0x7fefa00cee90 2024-03-24T10:36:46.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.033+0000 7fefa63e3640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fef8406b810 0x7fef8406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.033+0000 7fefa63e3640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fef8406b810 0x7fef8406dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef9c007fd0 tx=0x7fef9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:46.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.037+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fef900541c0 con 0x7fefa00cee90 2024-03-24T10:36:46.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.208+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefa00b2750 con 0x7fefa00cee90 2024-03-24T10:36:46.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.209+0000 7fef96ffd640 1 -- 172.21.15.72:0/79018084 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7fef90057880 con 0x7fefa00cee90 2024-03-24T10:36:46.211 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:46.211 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fef8406b810 msgr2=0x7fef8406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fef8406b810 0x7fef8406dcd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fef9c007fd0 tx=0x7fef9c009040 comp rx=0 tx=0).stop 2024-03-24T10:36:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 msgr2=0x7fefa0150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 0x7fefa0150690 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef9000c500 tx=0x7fef9000c9c0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 shutdown_connections 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fef8406b810 0x7fef8406dcd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fefa0160040 0x7fefa00ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fefa00cee90 0x7fefa0150690 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 --2- 172.21.15.72:0/79018084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fefa006e500 0x7fefa00b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 >> 172.21.15.72:0/79018084 conn(0x7fefa00b1920 msgr2=0x7fefa015dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 shutdown_connections 2024-03-24T10:36:46.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.211+0000 7fefa8647640 1 -- 172.21.15.72:0/79018084 wait complete. 2024-03-24T10:36:46.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-24T10:36:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.328+0000 7f848f46f640 1 Processor -- start 2024-03-24T10:36:46.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.328+0000 7f848f46f640 1 -- start start 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848f46f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8488142490 0x7f84880b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848f46f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f84880cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848f46f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84880ce1b0 0x7f84880ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848f46f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f84880b2f50 con 0x7f8488142490 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848f46f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f84880b3210 con 0x7f84880ce1b0 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848f46f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f84880b34f0 con 0x7f84880b2b10 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8488142490 0x7f84880b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8488142490 0x7f84880b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33166/0 (socket says 172.21.15.72:33166) 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848da0c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f84880ce1b0 0x7f84880ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.330 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 -- 172.21.15.72:0/2490886674 learned_addr learned my addr 172.21.15.72:0/2490886674 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848ca0a640 1 --2- 172.21.15.72:0/2490886674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f84880cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 -- 172.21.15.72:0/2490886674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 msgr2=0x7f84880cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 --2- 172.21.15.72:0/2490886674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f84880cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 -- 172.21.15.72:0/2490886674 >> v2:172.21.15.79:3300/0 conn(0x7f84880ce1b0 msgr2=0x7f84880ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 --2- 172.21.15.72:0/2490886674 >> v2:172.21.15.79:3300/0 conn(0x7f84880ce1b0 0x7f84880ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848d20b640 1 -- 172.21.15.72:0/2490886674 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84880b37d0 con 0x7f8488142490 2024-03-24T10:36:46.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.329+0000 7f848da0c640 1 --2- 172.21.15.72:0/2490886674 >> v2:172.21.15.79:3300/0 conn(0x7f84880ce1b0 0x7f84880ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.330+0000 7f848d20b640 1 --2- 172.21.15.72:0/2490886674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f84880b42b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8488070830 tx=0x7f848402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b040d94423c735 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.330+0000 7f847ffff640 1 -- 172.21.15.72:0/2490886674 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484031870 con 0x7f8488142490 2024-03-24T10:36:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.330+0000 7f847ffff640 1 -- 172.21.15.72:0/2490886674 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84840319d0 con 0x7f8488142490 2024-03-24T10:36:46.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.330+0000 7f847ffff640 1 -- 172.21.15.72:0/2490886674 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8484031d60 con 0x7f8488142490 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.330+0000 7f848f46f640 1 -- 172.21.15.72:0/2490886674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 msgr2=0x7f84880b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.330+0000 7f848f46f640 1 --2- 172.21.15.72:0/2490886674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f84880b42b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8488070830 tx=0x7f848402b910 comp rx=0 tx=0).stop 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 -- 172.21.15.72:0/2490886674 shutdown_connections 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 --2- 172.21.15.72:0/2490886674 >> v2:172.21.15.79:3300/0 conn(0x7f84880ce1b0 0x7f84880ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 --2- 172.21.15.72:0/2490886674 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f84880cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 --2- 172.21.15.72:0/2490886674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f84880b42b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 -- 172.21.15.72:0/2490886674 >> 172.21.15.72:0/2490886674 conn(0x7f84880b1810 msgr2=0x7f84880b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 -- 172.21.15.72:0/2490886674 shutdown_connections 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.331+0000 7f848f46f640 1 -- 172.21.15.72:0/2490886674 wait complete. 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.332+0000 7f848f46f640 1 Processor -- start 2024-03-24T10:36:46.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.332+0000 7f848f46f640 1 -- start start 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.332+0000 7f848f46f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f8488072150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84880ce1b0 0x7f848814d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f848813f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8488071cc0 con 0x7f8488142490 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84880710b0 con 0x7f84880ce1b0 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8488071390 con 0x7f84880b2b10 2024-03-24T10:36:46.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f848813f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f848813f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33172/0 (socket says 172.21.15.72:33172) 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 -- 172.21.15.72:0/2894537487 learned_addr learned my addr 172.21.15.72:0/2894537487 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848d20b640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f8488072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848ca0a640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84880ce1b0 0x7f848814d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 -- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 msgr2=0x7f8488072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f8488072150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 -- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84880ce1b0 msgr2=0x7f848814d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84880ce1b0 0x7f848814d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 -- 172.21.15.72:0/2894537487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8480009a70 con 0x7f8488142490 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848da0c640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f848813f840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f848000efc0 tx=0x7f8480009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480009d70 con 0x7f8488142490 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848000f040 con 0x7f8488142490 2024-03-24T10:36:46.338 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84840094d0 con 0x7f8488142490 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480003990 con 0x7f8488142490 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.333+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8488071950 con 0x7f8488142490 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.335+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8488071e70 con 0x7f8488142490 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.335+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8480014480 con 0x7f8488142490 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.335+0000 7f847dffb640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f846c06b810 0x7f846c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.335+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f848008b020 con 0x7f8488142490 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.335+0000 7f848d20b640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f846c06b810 0x7f846c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:46.339 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.336+0000 7f848d20b640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f846c06b810 0x7f846c06dcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8484036000 tx=0x7f848403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:46.340 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.339+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8488071e70 con 0x7f8488142490 2024-03-24T10:36:46.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:46.548+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f848804f470 con 0x7f8488142490 2024-03-24T10:36:47.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.285+0000 7f847dffb640 1 -- 172.21.15.72:0/2894537487 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f84800557b0 con 0x7f8488142490 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f846c06b810 msgr2=0x7f846c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f846c06b810 0x7f846c06dcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8484036000 tx=0x7f848403c040 comp rx=0 tx=0).stop 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 msgr2=0x7f848813f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f848813f840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f848000efc0 tx=0x7f8480009f90 comp rx=0 tx=0).stop 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 shutdown_connections 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f846c06b810 0x7f846c06dcd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8488142490 0x7f848813f840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84880ce1b0 0x7f848814d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 --2- 172.21.15.72:0/2894537487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84880b2b10 0x7f8488072150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 >> 172.21.15.72:0/2894537487 conn(0x7f84880b1810 msgr2=0x7f848815eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:47.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 shutdown_connections 2024-03-24T10:36:47.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.288+0000 7f848f46f640 1 -- 172.21.15.72:0/2894537487 wait complete. 2024-03-24T10:36:47.302 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-03-24T10:36:47.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-24T10:36:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.409+0000 7feb7f78a640 1 Processor -- start 2024-03-24T10:36:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.409+0000 7feb7f78a640 1 -- start start 2024-03-24T10:36:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.410+0000 7feb7f78a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb7806b840 0x7feb7806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.410+0000 7feb7f78a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb780afca0 con 0x7feb78159ac0 2024-03-24T10:36:47.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.410+0000 7feb7f78a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb7815c5a0 con 0x7feb78160390 2024-03-24T10:36:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.410+0000 7feb7f78a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7feb7815c390 con 0x7feb7806b840 2024-03-24T10:36:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb7d526640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb78159ac0 0x7feb7806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49808/0 (socket says 172.21.15.72:49808) 2024-03-24T10:36:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb7d526640 1 -- 172.21.15.72:0/2666133815 learned_addr learned my addr 172.21.15.72:0/2666133815 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb7cd25640 1 --2- 172.21.15.72:0/2666133815 >> v2:172.21.15.72:3300/0 conn(0x7feb7806b840 0x7feb7806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb6ffff640 1 -- 172.21.15.72:0/2666133815 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944860895 0 0) 0x7feb7815c5a0 con 0x7feb78160390 2024-03-24T10:36:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb6ffff640 1 -- 172.21.15.72:0/2666133815 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb64003520 con 0x7feb78160390 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb7cd25640 1 -- 172.21.15.72:0/2666133815 >> v1:172.21.15.79:6789/0 conn(0x7feb78160390 legacy=0x7feb7806d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb7cd25640 1 -- 172.21.15.72:0/2666133815 >> v1:172.21.15.72:6789/0 conn(0x7feb78159ac0 legacy=0x7feb7806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb6ffff640 1 -- 172.21.15.72:0/2666133815 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291723041 0 0) 0x7feb780afca0 con 0x7feb78159ac0 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.411+0000 7feb7cd25640 1 -- 172.21.15.72:0/2666133815 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7815d320 con 0x7feb7806b840 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7cd25640 1 --2- 172.21.15.72:0/2666133815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb7806b840 0x7feb7806f0e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb680097a0 tx=0x7feb6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90d15734fc56af5 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb6ffff640 1 -- 172.21.15.72:0/2666133815 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68031830 con 0x7feb7806b840 2024-03-24T10:36:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb6ffff640 1 -- 172.21.15.72:0/2666133815 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb68031990 con 0x7feb7806b840 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb6ffff640 1 -- 172.21.15.72:0/2666133815 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68031d20 con 0x7feb7806b840 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 -- 172.21.15.72:0/2666133815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb7806b840 msgr2=0x7feb7806f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 --2- 172.21.15.72:0/2666133815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb7806b840 0x7feb7806f0e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb680097a0 tx=0x7feb6802b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 -- 172.21.15.72:0/2666133815 shutdown_connections 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 --2- 172.21.15.72:0/2666133815 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb7806b840 0x7feb7806f0e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 -- 172.21.15.72:0/2666133815 >> 172.21.15.72:0/2666133815 conn(0x7feb780b2100 msgr2=0x7feb780b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:47.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 -- 172.21.15.72:0/2666133815 shutdown_connections 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.412+0000 7feb7f78a640 1 -- 172.21.15.72:0/2666133815 wait complete. 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 Processor -- start 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 -- start start 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7806b840 0x7feb7814f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 0x7feb780cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feb78160390 0x7feb780cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feb78150650 con 0x7feb78159ac0 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb7814fa60 con 0x7feb7806b840 2024-03-24T10:36:47.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7f78a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7feb7814fcb0 con 0x7feb78160390 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7cd25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 0x7feb780cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7cd25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 0x7feb780cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33190/0 (socket says 172.21.15.72:33190) 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7cd25640 1 -- 172.21.15.72:0/1545487292 learned_addr learned my addr 172.21.15.72:0/1545487292 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7d526640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7806b840 0x7feb7814f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.414+0000 7feb7dd27640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feb78160390 0x7feb780cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7cd25640 1 -- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feb78160390 msgr2=0x7feb780cef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7cd25640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feb78160390 0x7feb780cef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7cd25640 1 -- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7806b840 msgr2=0x7feb7814f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7cd25640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7806b840 0x7feb7814f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7cd25640 1 -- 172.21.15.72:0/1545487292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb68009400 con 0x7feb78159ac0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7cd25640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 0x7feb780cea10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb680098c0 tx=0x7feb680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6803a630 con 0x7feb78159ac0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6803a7d0 con 0x7feb78159ac0 2024-03-24T10:36:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6803ab80 con 0x7feb78159ac0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7814ff90 con 0x7feb78159ac0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.415+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb78150a70 con 0x7feb78159ac0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.416+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7804f470 con 0x7feb78159ac0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.417+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7feb6803ace0 con 0x7feb78159ac0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.417+0000 7feb6dffb640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feb5c06b810 0x7feb5c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.417+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb680ac1f0 con 0x7feb78159ac0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.417+0000 7feb7d526640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feb5c06b810 0x7feb5c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.418+0000 7feb7d526640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feb5c06b810 0x7feb5c06dcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb74007f70 tx=0x7feb74007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.422+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7feb68076aa0 con 0x7feb78159ac0 2024-03-24T10:36:47.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:47.628+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7feb7806bee0 con 0x7feb78159ac0 2024-03-24T10:36:48.293 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.292+0000 7feb6dffb640 1 -- 172.21.15.72:0/1545487292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7feb680350c0 con 0x7feb78159ac0 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feb5c06b810 msgr2=0x7feb5c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feb5c06b810 0x7feb5c06dcd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb74007f70 tx=0x7feb74007f00 comp rx=0 tx=0).stop 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 msgr2=0x7feb780cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 0x7feb780cea10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb680098c0 tx=0x7feb680046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 shutdown_connections 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feb5c06b810 0x7feb5c06dcd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feb78160390 0x7feb780cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb78159ac0 0x7feb780cea10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 --2- 172.21.15.72:0/1545487292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb7806b840 0x7feb7814f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 >> 172.21.15.72:0/1545487292 conn(0x7feb780b2100 msgr2=0x7feb7806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 shutdown_connections 2024-03-24T10:36:48.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.295+0000 7feb7f78a640 1 -- 172.21.15.72:0/1545487292 wait complete. 2024-03-24T10:36:48.309 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-24T10:36:48.309 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:48.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.415+0000 7f9cc89ac640 1 Processor -- start 2024-03-24T10:36:48.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.415+0000 7f9cc89ac640 1 -- start start 2024-03-24T10:36:48.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc89ac640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cc415e170 0x7f9cc415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc89ac640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9cc40d4930 0x7f9cc40d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc89ac640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cc40d4e50 con 0x7f9cc40d2280 2024-03-24T10:36:48.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc89ac640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc40cf790 con 0x7f9cc415e170 2024-03-24T10:36:48.417 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc89ac640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9cc40cfa70 con 0x7f9cc40d4930 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cc415e170 0x7f9cc415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9cc415e170 0x7f9cc415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33194/0 (socket says 172.21.15.72:33194) 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 -- 172.21.15.72:0/3577540512 learned_addr learned my addr 172.21.15.72:0/3577540512 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cbbfff640 1 --2- 172.21.15.72:0/3577540512 >> v2:172.21.15.79:3300/0 conn(0x7f9cc40d4930 0x7f9cc40d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 -- 172.21.15.72:0/3577540512 >> v2:172.21.15.79:3300/0 conn(0x7f9cc40d4930 msgr2=0x7f9cc40d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 --2- 172.21.15.72:0/3577540512 >> v2:172.21.15.79:3300/0 conn(0x7f9cc40d4930 0x7f9cc40d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 -- 172.21.15.72:0/3577540512 >> v1:172.21.15.79:6789/0 conn(0x7f9cc40d2280 legacy=0x7f9cc40d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.416+0000 7f9cc259c640 1 -- 172.21.15.72:0/3577540512 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc40cfd50 con 0x7f9cc415e170 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc259c640 1 --2- 172.21.15.72:0/3577540512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc415e170 0x7f9cc415e550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cc408dc60 tx=0x7f9cb402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadf65ebf5be9ace server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc1d9b640 1 -- 172.21.15.72:0/3577540512 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4031870 con 0x7f9cc415e170 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc1d9b640 1 -- 172.21.15.72:0/3577540512 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb40319d0 con 0x7f9cc415e170 2024-03-24T10:36:48.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc1d9b640 1 -- 172.21.15.72:0/3577540512 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4031d60 con 0x7f9cc415e170 2024-03-24T10:36:48.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 -- 172.21.15.72:0/3577540512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc415e170 msgr2=0x7f9cc415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/3577540512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc415e170 0x7f9cc415e550 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9cc408dc60 tx=0x7f9cb402b910 comp rx=0 tx=0).stop 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 -- 172.21.15.72:0/3577540512 shutdown_connections 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/3577540512 >> v2:172.21.15.79:3300/0 conn(0x7f9cc40d4930 0x7f9cc40d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/3577540512 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc415e170 0x7f9cc415e550 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 -- 172.21.15.72:0/3577540512 >> 172.21.15.72:0/3577540512 conn(0x7f9cc409d310 msgr2=0x7f9cc40d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.417+0000 7f9cc89ac640 1 -- 172.21.15.72:0/3577540512 shutdown_connections 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.418+0000 7f9cc89ac640 1 -- 172.21.15.72:0/3577540512 wait complete. 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 Processor -- start 2024-03-24T10:36:48.422 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 -- start start 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 0x7f9cc41f4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9cc40d4930 0x7f9cc41f1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc415e170 0x7f9cc40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc40b9410 con 0x7f9cc40d2280 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc41f5280 con 0x7f9cc415e170 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.419+0000 7f9cc89ac640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc40cb4d0 con 0x7f9cc40d4930 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 0x7f9cc41f4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 0x7f9cc41f4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33210/0 (socket says 172.21.15.72:33210) 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 -- 172.21.15.72:0/2508862788 learned_addr learned my addr 172.21.15.72:0/2508862788 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cbbfff640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9cc40d4930 0x7f9cc41f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc2d9d640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc415e170 0x7f9cc40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 -- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9cc40d4930 msgr2=0x7f9cc41f1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9cc40d4930 0x7f9cc41f1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 -- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc415e170 msgr2=0x7f9cc40ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc415e170 0x7f9cc40ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 -- 172.21.15.72:0/2508862788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb40094d0 con 0x7f9cc40d2280 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc259c640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 0x7f9cc41f4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cb402b950 tx=0x7f9cb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb403abe0 con 0x7f9cc40d2280 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb403ad60 con 0x7f9cc40d2280 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4044630 con 0x7f9cc40d2280 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc40cb7b0 con 0x7f9cc40d2280 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.420+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc40cbd70 con 0x7f9cc40d2280 2024-03-24T10:36:48.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.421+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc40b6b80 con 0x7f9cc40d2280 2024-03-24T10:36:48.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.421+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9cb4044790 con 0x7f9cc40d2280 2024-03-24T10:36:48.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.422+0000 7f9cbaffd640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9ca406b810 0x7f9ca406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.422+0000 7f9cbbfff640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9ca406b810 0x7f9ca406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.422+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9cb402d040 con 0x7f9cc40d2280 2024-03-24T10:36:48.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.422+0000 7f9cbbfff640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9ca406b810 0x7f9ca406dcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009aa0 tx=0x7f9cac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:48.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.426+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9cb4077140 con 0x7f9cc40d2280 2024-03-24T10:36:48.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.632+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cc40a1ef0 con 0x7f9cc40d2280 2024-03-24T10:36:48.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.633+0000 7f9cbaffd640 1 -- 172.21.15.72:0/2508862788 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f9cb407fe60 con 0x7f9cc40d2280 2024-03-24T10:36:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:48.634 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:36:48.634 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9ca406b810 msgr2=0x7f9ca406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9ca406b810 0x7f9ca406dcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009aa0 tx=0x7f9cac009190 comp rx=0 tx=0).stop 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 msgr2=0x7f9cc41f4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 0x7f9cc41f4d40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cb402b950 tx=0x7f9cb40046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 shutdown_connections 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9ca406b810 0x7f9ca406dcd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9cc415e170 0x7f9cc40ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9cc40d4930 0x7f9cc41f1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 --2- 172.21.15.72:0/2508862788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9cc40d2280 0x7f9cc41f4d40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 >> 172.21.15.72:0/2508862788 conn(0x7f9cc409d310 msgr2=0x7f9cc415a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 shutdown_connections 2024-03-24T10:36:48.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.635+0000 7f9cc89ac640 1 -- 172.21.15.72:0/2508862788 wait complete. 2024-03-24T10:36:48.647 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:48.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.746+0000 7faf74ba7640 1 Processor -- start 2024-03-24T10:36:48.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.746+0000 7faf74ba7640 1 -- start start 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf74ba7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf70071550 0x7faf701659d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf74ba7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf700725b0 con 0x7faf7006e680 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf74ba7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf70071a10 con 0x7faf7015ae80 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf74ba7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7faf7015b260 con 0x7faf70071550 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf6ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7faf70071550 0x7faf701659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf6dd9b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faf7006e680 0x7faf70070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49818/0 (socket says 172.21.15.72:49818) 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.747+0000 7faf6dd9b640 1 -- 172.21.15.72:0/1721235149 learned_addr learned my addr 172.21.15.72:0/1721235149 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:48.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1721235149 >> v1:172.21.15.79:6789/0 conn(0x7faf7015ae80 legacy=0x7faf7006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1721235149 >> v1:172.21.15.72:6789/0 conn(0x7faf7006e680 legacy=0x7faf70070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1721235149 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf70071c80 con 0x7faf70071550 2024-03-24T10:36:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6ed9d640 1 --2- 172.21.15.72:0/1721235149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf70071550 0x7faf701659d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf680097a0 tx=0x7faf6802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66764585a3c51a6f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6d59a640 1 -- 172.21.15.72:0/1721235149 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68030610 con 0x7faf70071550 2024-03-24T10:36:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6d59a640 1 -- 172.21.15.72:0/1721235149 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf68030770 con 0x7faf70071550 2024-03-24T10:36:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.748+0000 7faf6d59a640 1 -- 172.21.15.72:0/1721235149 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68030b00 con 0x7faf70071550 2024-03-24T10:36:48.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 -- 172.21.15.72:0/1721235149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf70071550 msgr2=0x7faf701659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1721235149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf70071550 0x7faf701659d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7faf680097a0 tx=0x7faf6802b960 comp rx=0 tx=0).stop 2024-03-24T10:36:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 -- 172.21.15.72:0/1721235149 shutdown_connections 2024-03-24T10:36:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1721235149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf70071550 0x7faf701659d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 -- 172.21.15.72:0/1721235149 >> 172.21.15.72:0/1721235149 conn(0x7faf700b1920 msgr2=0x7faf700b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 -- 172.21.15.72:0/1721235149 shutdown_connections 2024-03-24T10:36:48.751 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.749+0000 7faf74ba7640 1 -- 172.21.15.72:0/1721235149 wait complete. 2024-03-24T10:36:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.750+0000 7faf74ba7640 1 Processor -- start 2024-03-24T10:36:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.750+0000 7faf74ba7640 1 -- start start 2024-03-24T10:36:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf74ba7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7006e680 0x7faf7014e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf74ba7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf70071550 0x7faf7015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf74ba7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 0x7faf7015daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf74ba7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faf7009c510 con 0x7faf7015ae80 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf74ba7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faf701f5480 con 0x7faf7006e680 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf74ba7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7faf70157160 con 0x7faf70071550 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 0x7faf7015daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 0x7faf7015daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33226/0 (socket says 172.21.15.72:33226) 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1621535949 learned_addr learned my addr 172.21.15.72:0/1621535949 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6e59c640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7006e680 0x7faf7014e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6dd9b640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf70071550 0x7faf7015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf70071550 msgr2=0x7faf7015d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf70071550 0x7faf7015d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7006e680 msgr2=0x7faf7014e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7006e680 0x7faf7014e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.751+0000 7faf6ed9d640 1 -- 172.21.15.72:0/1621535949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf68009400 con 0x7faf7015ae80 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.752+0000 7faf6ed9d640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 0x7faf7015daf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf680098c0 tx=0x7faf680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:48.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.752+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6803e070 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.752+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf68039990 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.752+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf701f5690 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.752+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf68039d40 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.752+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf701f5c50 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.753+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf7009e080 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.753+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7faf6804b400 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.754+0000 7faf5effd640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf5006b810 0x7faf5006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.754+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faf680ac850 con 0x7faf7015ae80 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.754+0000 7faf6e59c640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf5006b810 0x7faf5006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:48.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.754+0000 7faf6e59c640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf5006b810 0x7faf5006dcd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf60001f10 tx=0x7faf60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:48.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.758+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faf68077190 con 0x7faf7015ae80 2024-03-24T10:36:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.929+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf7004f550 con 0x7faf7015ae80 2024-03-24T10:36:48.931 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.931+0000 7faf5effd640 1 -- 172.21.15.72:0/1621535949 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7faf680aae60 con 0x7faf7015ae80 2024-03-24T10:36:48.931 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:48.931 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.932+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf5006b810 msgr2=0x7faf5006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.932+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf5006b810 0x7faf5006dcd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faf60001f10 tx=0x7faf60009040 comp rx=0 tx=0).stop 2024-03-24T10:36:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 msgr2=0x7faf7015daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:48.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 0x7faf7015daf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faf680098c0 tx=0x7faf680046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 shutdown_connections 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf5006b810 0x7faf5006dcd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faf7015ae80 0x7faf7015daf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faf70071550 0x7faf7015d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 --2- 172.21.15.72:0/1621535949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faf7006e680 0x7faf7014e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 >> 172.21.15.72:0/1621535949 conn(0x7faf700b1920 msgr2=0x7faf700aff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 shutdown_connections 2024-03-24T10:36:48.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:48.933+0000 7faf74ba7640 1 -- 172.21.15.72:0/1621535949 wait complete. 2024-03-24T10:36:48.944 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-24T10:36:48.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:36:49.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 Processor -- start 2024-03-24T10:36:49.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 -- start start 2024-03-24T10:36:49.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda44161640 0x7fda440d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.045 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda440cfd30 0x7fda440d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda440d1c90 con 0x7fda440d2d30 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fda440d1f70 con 0x7fda440cfd30 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.044+0000 7fda496d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fda440d2250 con 0x7fda44161640 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda437fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fda440cfd30 0x7fda440d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda427fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda440d2d30 0x7fda440cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49820/0 (socket says 172.21.15.72:49820) 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda427fc640 1 -- 172.21.15.72:0/2901437646 learned_addr learned my addr 172.21.15.72:0/2901437646 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda42ffd640 1 --2- 172.21.15.72:0/2901437646 >> v2:172.21.15.79:3300/0 conn(0x7fda44161640 0x7fda440d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda437fe640 1 -- 172.21.15.72:0/2901437646 >> v2:172.21.15.79:3300/0 conn(0x7fda44161640 msgr2=0x7fda440d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda437fe640 1 --2- 172.21.15.72:0/2901437646 >> v2:172.21.15.79:3300/0 conn(0x7fda44161640 0x7fda440d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda437fe640 1 -- 172.21.15.72:0/2901437646 >> v1:172.21.15.72:6789/0 conn(0x7fda440d2d30 legacy=0x7fda440cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda437fe640 1 -- 172.21.15.72:0/2901437646 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda440d2530 con 0x7fda440cfd30 2024-03-24T10:36:49.046 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.045+0000 7fda42ffd640 1 --2- 172.21.15.72:0/2901437646 >> v2:172.21.15.79:3300/0 conn(0x7fda44161640 0x7fda440d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda437fe640 1 --2- 172.21.15.72:0/2901437646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda440d0e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda4408ce40 tx=0x7fda3c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca2f9600cbce07 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda41ffb640 1 -- 172.21.15.72:0/2901437646 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c02cbf0 con 0x7fda440cfd30 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda41ffb640 1 -- 172.21.15.72:0/2901437646 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c02cd50 con 0x7fda440cfd30 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda41ffb640 1 -- 172.21.15.72:0/2901437646 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c034660 con 0x7fda440cfd30 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 -- 172.21.15.72:0/2901437646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 msgr2=0x7fda440d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 --2- 172.21.15.72:0/2901437646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda440d0e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda4408ce40 tx=0x7fda3c02be40 comp rx=0 tx=0).stop 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 -- 172.21.15.72:0/2901437646 shutdown_connections 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 --2- 172.21.15.72:0/2901437646 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda440d0e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 --2- 172.21.15.72:0/2901437646 >> v2:172.21.15.79:3300/0 conn(0x7fda44161640 0x7fda440d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 -- 172.21.15.72:0/2901437646 >> 172.21.15.72:0/2901437646 conn(0x7fda4409d2f0 msgr2=0x7fda440d3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 -- 172.21.15.72:0/2901437646 shutdown_connections 2024-03-24T10:36:49.048 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.046+0000 7fda496d4640 1 -- 172.21.15.72:0/2901437646 wait complete. 2024-03-24T10:36:49.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 Processor -- start 2024-03-24T10:36:49.049 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 -- start start 2024-03-24T10:36:49.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda441f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda440d2d30 0x7fda4414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.050 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda44161640 0x7fda440b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fda440b6e60 con 0x7fda440cfd30 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda440b7140 con 0x7fda44161640 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda496d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda440b7420 con 0x7fda440d2d30 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda42ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda441f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda42ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda441f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33240/0 (socket says 172.21.15.72:33240) 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda42ffd640 1 -- 172.21.15.72:0/1178821 learned_addr learned my addr 172.21.15.72:0/1178821 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda437fe640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda44161640 0x7fda440b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.048+0000 7fda427fc640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda440d2d30 0x7fda4414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda42ffd640 1 -- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda440d2d30 msgr2=0x7fda4414f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda42ffd640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda440d2d30 0x7fda4414f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda42ffd640 1 -- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda44161640 msgr2=0x7fda440b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda42ffd640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda44161640 0x7fda440b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda42ffd640 1 -- 172.21.15.72:0/1178821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda34009400 con 0x7fda440cfd30 2024-03-24T10:36:49.051 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda42ffd640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda441f4d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda3400e960 tx=0x7fda3400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3400ca00 con 0x7fda440cfd30 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3400cb60 con 0x7fda440cfd30 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c009a70 con 0x7fda440cfd30 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda34013470 con 0x7fda440cfd30 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.049+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda440b79e0 con 0x7fda440cfd30 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.050+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda440a1ed0 con 0x7fda440cfd30 2024-03-24T10:36:49.052 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.050+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fda340135d0 con 0x7fda440cfd30 2024-03-24T10:36:49.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.051+0000 7fda2b7fe640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3006b810 0x7fda3006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.051+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda3408a6d0 con 0x7fda440cfd30 2024-03-24T10:36:49.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.051+0000 7fda427fc640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3006b810 0x7fda3006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.053 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.051+0000 7fda427fc640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3006b810 0x7fda3006dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda4406d420 tx=0x7fda38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.055+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fda34054e60 con 0x7fda440cfd30 2024-03-24T10:36:49.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.225+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda440b3810 con 0x7fda3006b810 2024-03-24T10:36:49.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.233+0000 7fda2b7fe640 1 -- 172.21.15.72:0/1178821 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fda3800f820 con 0x7fda3006b810 2024-03-24T10:36:49.238 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:49.241 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3006b810 msgr2=0x7fda3006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3006b810 0x7fda3006dcd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fda4406d420 tx=0x7fda38009040 comp rx=0 tx=0).stop 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 msgr2=0x7fda441f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda441f4d30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda3400e960 tx=0x7fda3400ee20 comp rx=0 tx=0).stop 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 shutdown_connections 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda3006b810 0x7fda3006dcd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda44161640 0x7fda440b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda440d2d30 0x7fda4414f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 --2- 172.21.15.72:0/1178821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda440cfd30 0x7fda441f4d30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 >> 172.21.15.72:0/1178821 conn(0x7fda4409d2f0 msgr2=0x7fda440b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 shutdown_connections 2024-03-24T10:36:49.244 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.237+0000 7fda496d4640 1 -- 172.21.15.72:0/1178821 wait complete. 2024-03-24T10:36:49.248 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-03-24T10:36:48.143785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003000"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978256+0000","last_change":"2024-03-24T10:36:25.218550+0000","last_active":"2024-03-24T10:36:31.978256+0000","last_peered":"2024-03-24T10:36:31.978256+0000","last_clean":"2024-03-24T10:36:31.978256+0000","last_became_active":"2024-03-24T10:36:25.218268+0000","last_became_peered":"2024-03-24T10:36:25.218268+0000","last_unstale":"2024-03-24T10:36:31.978256+0000","last_undegraded":"2024-03-24T10:36:31.978256+0000","last_fullsized":"2024-03-24T10:36:31.978256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:50:40.435818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240464+0000","last_change":"2024-03-24T10:36:26.226821+0000","last_active":"2024-03-24T10:36:31.240464+0000","last_peered":"2024-03-24T10:36:31.240464+0000","last_clean":"2024-03-24T10:36:31.240464+0000","last_became_active":"2024-03-24T10:36:26.226545+0000","last_became_peered":"2024-03-24T10:36:26.226545+0000","last_unstale":"2024-03-24T10:36:31.240464+0000","last_undegraded":"2024-03-24T10:36:31.240464+0000","last_fullsized":"2024-03-24T10:36:31.240464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239815+0000","last_change":"2024-03-24T10:36:30.290828+0000","last_active":"2024-03-24T10:36:31.239815+0000","last_peered":"2024-03-24T10:36:31.239815+0000","last_clean":"2024-03-24T10:36:31.239815+0000","last_became_active":"2024-03-24T10:36:30.290163+0000","last_became_peered":"2024-03-24T10:36:30.290163+0000","last_unstale":"2024-03-24T10:36:31.239815+0000","last_undegraded":"2024-03-24T10:36:31.239815+0000","last_fullsized":"2024-03-24T10:36:31.239815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240623+0000","last_change":"2024-03-24T10:36:25.212258+0000","last_active":"2024-03-24T10:36:31.240623+0000","last_peered":"2024-03-24T10:36:31.240623+0000","last_clean":"2024-03-24T10:36:31.240623+0000","last_became_active":"2024-03-24T10:36:25.211985+0000","last_became_peered":"2024-03-24T10:36:25.211985+0000","last_unstale":"2024-03-24T10:36:31.240623+0000","last_undegraded":"2024-03-24T10:36:31.240623+0000","last_fullsized":"2024-03-24T10:36:31.240623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977983+0000","last_change":"2024-03-24T10:36:26.245457+0000","last_active":"2024-03-24T10:36:31.977983+0000","last_peered":"2024-03-24T10:36:31.977983+0000","last_clean":"2024-03-24T10:36:31.977983+0000","last_became_active":"2024-03-24T10:36:26.245157+0000","last_became_peered":"2024-03-24T10:36:26.245157+0000","last_unstale":"2024-03-24T10:36:31.977983+0000","last_undegraded":"2024-03-24T10:36:31.977983+0000","last_fullsized":"2024-03-24T10:36:31.977983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239707+0000","last_change":"2024-03-24T10:36:30.258067+0000","last_active":"2024-03-24T10:36:31.239707+0000","last_peered":"2024-03-24T10:36:31.239707+0000","last_clean":"2024-03-24T10:36:31.239707+0000","last_became_active":"2024-03-24T10:36:30.257502+0000","last_became_peered":"2024-03-24T10:36:30.257502+0000","last_unstale":"2024-03-24T10:36:31.239707+0000","last_undegraded":"2024-03-24T10:36:31.239707+0000","last_fullsized":"2024-03-24T10:36:31.239707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:22.635599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978573+0000","last_change":"2024-03-24T10:36:25.222492+0000","last_active":"2024-03-24T10:36:31.978573+0000","last_peered":"2024-03-24T10:36:31.978573+0000","last_clean":"2024-03-24T10:36:31.978573+0000","last_became_active":"2024-03-24T10:36:25.222187+0000","last_became_peered":"2024-03-24T10:36:25.222187+0000","last_unstale":"2024-03-24T10:36:31.978573+0000","last_undegraded":"2024-03-24T10:36:31.978573+0000","last_fullsized":"2024-03-24T10:36:31.978573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:02.259009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240704+0000","last_change":"2024-03-24T10:36:26.241575+0000","last_active":"2024-03-24T10:36:31.240704+0000","last_peered":"2024-03-24T10:36:31.240704+0000","last_clean":"2024-03-24T10:36:31.240704+0000","last_became_active":"2024-03-24T10:36:26.240567+0000","last_became_peered":"2024-03-24T10:36:26.240567+0000","last_unstale":"2024-03-24T10:36:31.240704+0000","last_undegraded":"2024-03-24T10:36:31.240704+0000","last_fullsized":"2024-03-24T10:36:31.240704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240064+0000","last_change":"2024-03-24T10:36:30.255999+0000","last_active":"2024-03-24T10:36:31.240064+0000","last_peered":"2024-03-24T10:36:31.240064+0000","last_clean":"2024-03-24T10:36:31.240064+0000","last_became_active":"2024-03-24T10:36:30.255602+0000","last_became_peered":"2024-03-24T10:36:30.255602+0000","last_unstale":"2024-03-24T10:36:31.240064+0000","last_undegraded":"2024-03-24T10:36:31.240064+0000","last_fullsized":"2024-03-24T10:36:31.240064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978234+0000","last_change":"2024-03-24T10:36:25.221818+0000","last_active":"2024-03-24T10:36:31.978234+0000","last_peered":"2024-03-24T10:36:31.978234+0000","last_clean":"2024-03-24T10:36:31.978234+0000","last_became_active":"2024-03-24T10:36:25.221527+0000","last_became_peered":"2024-03-24T10:36:25.221527+0000","last_unstale":"2024-03-24T10:36:31.978234+0000","last_undegraded":"2024-03-24T10:36:31.978234+0000","last_fullsized":"2024-03-24T10:36:31.978234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240821+0000","last_change":"2024-03-24T10:36:26.232930+0000","last_active":"2024-03-24T10:36:31.240821+0000","last_peered":"2024-03-24T10:36:31.240821+0000","last_clean":"2024-03-24T10:36:31.240821+0000","last_became_active":"2024-03-24T10:36:26.232665+0000","last_became_peered":"2024-03-24T10:36:26.232665+0000","last_unstale":"2024-03-24T10:36:31.240821+0000","last_undegraded":"2024-03-24T10:36:31.240821+0000","last_fullsized":"2024-03-24T10:36:31.240821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239844+0000","last_change":"2024-03-24T10:36:30.251201+0000","last_active":"2024-03-24T10:36:31.239844+0000","last_peered":"2024-03-24T10:36:31.239844+0000","last_clean":"2024-03-24T10:36:31.239844+0000","last_became_active":"2024-03-24T10:36:30.250845+0000","last_became_peered":"2024-03-24T10:36:30.250845+0000","last_unstale":"2024-03-24T10:36:31.239844+0000","last_undegraded":"2024-03-24T10:36:31.239844+0000","last_fullsized":"2024-03-24T10:36:31.239844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:15.088511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977560+0000","last_change":"2024-03-24T10:36:26.233671+0000","last_active":"2024-03-24T10:36:31.977560+0000","last_peered":"2024-03-24T10:36:31.977560+0000","last_clean":"2024-03-24T10:36:31.977560+0000","last_became_active":"2024-03-24T10:36:26.233382+0000","last_became_peered":"2024-03-24T10:36:26.233382+0000","last_unstale":"2024-03-24T10:36:31.977560+0000","last_undegraded":"2024-03-24T10:36:31.977560+0000","last_fullsized":"2024-03-24T10:36:31.977560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978239+0000","last_change":"2024-03-24T10:36:25.221318+0000","last_active":"2024-03-24T10:36:31.978239+0000","last_peered":"2024-03-24T10:36:31.978239+0000","last_clean":"2024-03-24T10:36:31.978239+0000","last_became_active":"2024-03-24T10:36:25.220530+0000","last_became_peered":"2024-03-24T10:36:25.220530+0000","last_unstale":"2024-03-24T10:36:31.978239+0000","last_undegraded":"2024-03-24T10:36:31.978239+0000","last_fullsized":"2024-03-24T10:36:31.978239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240532+0000","last_change":"2024-03-24T10:36:30.257835+0000","last_active":"2024-03-24T10:36:31.240532+0000","last_peered":"2024-03-24T10:36:31.240532+0000","last_clean":"2024-03-24T10:36:31.240532+0000","last_became_active":"2024-03-24T10:36:30.257484+0000","last_became_peered":"2024-03-24T10:36:30.257484+0000","last_unstale":"2024-03-24T10:36:31.240532+0000","last_undegraded":"2024-03-24T10:36:31.240532+0000","last_fullsized":"2024-03-24T10:36:31.240532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240057+0000","last_change":"2024-03-24T10:36:26.228855+0000","last_active":"2024-03-24T10:36:31.240057+0000","last_peered":"2024-03-24T10:36:31.240057+0000","last_clean":"2024-03-24T10:36:31.240057+0000","last_became_active":"2024-03-24T10:36:26.228590+0000","last_became_peered":"2024-03-24T10:36:26.228590+0000","last_unstale":"2024-03-24T10:36:31.240057+0000","last_undegraded":"2024-03-24T10:36:31.240057+0000","last_fullsized":"2024-03-24T10:36:31.240057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978913+0000","last_change":"2024-03-24T10:36:25.217987+0000","last_active":"2024-03-24T10:36:31.978913+0000","last_peered":"2024-03-24T10:36:31.978913+0000","last_clean":"2024-03-24T10:36:31.978913+0000","last_became_active":"2024-03-24T10:36:25.217693+0000","last_became_peered":"2024-03-24T10:36:25.217693+0000","last_unstale":"2024-03-24T10:36:31.978913+0000","last_undegraded":"2024-03-24T10:36:31.978913+0000","last_fullsized":"2024-03-24T10:36:31.978913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240063+0000","last_change":"2024-03-24T10:36:30.255718+0000","last_active":"2024-03-24T10:36:31.240063+0000","last_peered":"2024-03-24T10:36:31.240063+0000","last_clean":"2024-03-24T10:36:31.240063+0000","last_became_active":"2024-03-24T10:36:30.255368+0000","last_became_peered":"2024-03-24T10:36:30.255368+0000","last_unstale":"2024-03-24T10:36:31.240063+0000","last_undegraded":"2024-03-24T10:36:31.240063+0000","last_fullsized":"2024-03-24T10:36:31.240063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240629+0000","last_change":"2024-03-24T10:36:26.219340+0000","last_active":"2024-03-24T10:36:31.240629+0000","last_peered":"2024-03-24T10:36:31.240629+0000","last_clean":"2024-03-24T10:36:31.240629+0000","last_became_active":"2024-03-24T10:36:26.219047+0000","last_became_peered":"2024-03-24T10:36:26.219047+0000","last_unstale":"2024-03-24T10:36:31.240629+0000","last_undegraded":"2024-03-24T10:36:31.240629+0000","last_fullsized":"2024-03-24T10:36:31.240629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978316+0000","last_change":"2024-03-24T10:36:25.218156+0000","last_active":"2024-03-24T10:36:31.978316+0000","last_peered":"2024-03-24T10:36:31.978316+0000","last_clean":"2024-03-24T10:36:31.978316+0000","last_became_active":"2024-03-24T10:36:25.217886+0000","last_became_peered":"2024-03-24T10:36:25.217886+0000","last_unstale":"2024-03-24T10:36:31.978316+0000","last_undegraded":"2024-03-24T10:36:31.978316+0000","last_fullsized":"2024-03-24T10:36:31.978316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979111+0000","last_change":"2024-03-24T10:36:30.289797+0000","last_active":"2024-03-24T10:36:31.979111+0000","last_peered":"2024-03-24T10:36:31.979111+0000","last_clean":"2024-03-24T10:36:31.979111+0000","last_became_active":"2024-03-24T10:36:30.288673+0000","last_became_peered":"2024-03-24T10:36:30.288673+0000","last_unstale":"2024-03-24T10:36:31.979111+0000","last_undegraded":"2024-03-24T10:36:31.979111+0000","last_fullsized":"2024-03-24T10:36:31.979111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240174+0000","last_change":"2024-03-24T10:36:26.216354+0000","last_active":"2024-03-24T10:36:31.240174+0000","last_peered":"2024-03-24T10:36:31.240174+0000","last_clean":"2024-03-24T10:36:31.240174+0000","last_became_active":"2024-03-24T10:36:26.215438+0000","last_became_peered":"2024-03-24T10:36:26.215438+0000","last_unstale":"2024-03-24T10:36:31.240174+0000","last_undegraded":"2024-03-24T10:36:31.240174+0000","last_fullsized":"2024-03-24T10:36:31.240174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:47:16.583659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:25.219905+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:25.219621+0000","last_became_peered":"2024-03-24T10:36:25.219621+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240448+0000","last_change":"2024-03-24T10:36:30.258214+0000","last_active":"2024-03-24T10:36:31.240448+0000","last_peered":"2024-03-24T10:36:31.240448+0000","last_clean":"2024-03-24T10:36:31.240448+0000","last_became_active":"2024-03-24T10:36:30.257701+0000","last_became_peered":"2024-03-24T10:36:30.257701+0000","last_unstale":"2024-03-24T10:36:31.240448+0000","last_undegraded":"2024-03-24T10:36:31.240448+0000","last_fullsized":"2024-03-24T10:36:31.240448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978555+0000","last_change":"2024-03-24T10:36:26.228673+0000","last_active":"2024-03-24T10:36:31.978555+0000","last_peered":"2024-03-24T10:36:31.978555+0000","last_clean":"2024-03-24T10:36:31.978555+0000","last_became_active":"2024-03-24T10:36:26.228223+0000","last_became_peered":"2024-03-24T10:36:26.228223+0000","last_unstale":"2024-03-24T10:36:31.978555+0000","last_undegraded":"2024-03-24T10:36:31.978555+0000","last_fullsized":"2024-03-24T10:36:31.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978776+0000","last_change":"2024-03-24T10:36:25.218606+0000","last_active":"2024-03-24T10:36:31.978776+0000","last_peered":"2024-03-24T10:36:31.978776+0000","last_clean":"2024-03-24T10:36:31.978776+0000","last_became_active":"2024-03-24T10:36:25.218305+0000","last_became_peered":"2024-03-24T10:36:25.218305+0000","last_unstale":"2024-03-24T10:36:31.978776+0000","last_undegraded":"2024-03-24T10:36:31.978776+0000","last_fullsized":"2024-03-24T10:36:31.978776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239964+0000","last_change":"2024-03-24T10:36:30.291483+0000","last_active":"2024-03-24T10:36:31.239964+0000","last_peered":"2024-03-24T10:36:31.239964+0000","last_clean":"2024-03-24T10:36:31.239964+0000","last_became_active":"2024-03-24T10:36:30.291163+0000","last_became_peered":"2024-03-24T10:36:30.291163+0000","last_unstale":"2024-03-24T10:36:31.239964+0000","last_undegraded":"2024-03-24T10:36:31.239964+0000","last_fullsized":"2024-03-24T10:36:31.239964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240422+0000","last_change":"2024-03-24T10:36:26.234337+0000","last_active":"2024-03-24T10:36:31.240422+0000","last_peered":"2024-03-24T10:36:31.240422+0000","last_clean":"2024-03-24T10:36:31.240422+0000","last_became_active":"2024-03-24T10:36:26.234055+0000","last_became_peered":"2024-03-24T10:36:26.234055+0000","last_unstale":"2024-03-24T10:36:31.240422+0000","last_undegraded":"2024-03-24T10:36:31.240422+0000","last_fullsized":"2024-03-24T10:36:31.240422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979094+0000","last_change":"2024-03-24T10:36:25.216567+0000","last_active":"2024-03-24T10:36:31.979094+0000","last_peered":"2024-03-24T10:36:31.979094+0000","last_clean":"2024-03-24T10:36:31.979094+0000","last_became_active":"2024-03-24T10:36:25.216217+0000","last_became_peered":"2024-03-24T10:36:25.216217+0000","last_unstale":"2024-03-24T10:36:31.979094+0000","last_undegraded":"2024-03-24T10:36:31.979094+0000","last_fullsized":"2024-03-24T10:36:31.979094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239785+0000","last_change":"2024-03-24T10:36:30.292210+0000","last_active":"2024-03-24T10:36:31.239785+0000","last_peered":"2024-03-24T10:36:31.239785+0000","last_clean":"2024-03-24T10:36:31.239785+0000","last_became_active":"2024-03-24T10:36:30.291693+0000","last_became_peered":"2024-03-24T10:36:30.291693+0000","last_unstale":"2024-03-24T10:36:31.239785+0000","last_undegraded":"2024-03-24T10:36:31.239785+0000","last_fullsized":"2024-03-24T10:36:31.239785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978627+0000","last_change":"2024-03-24T10:36:26.216940+0000","last_active":"2024-03-24T10:36:31.978627+0000","last_peered":"2024-03-24T10:36:31.978627+0000","last_clean":"2024-03-24T10:36:31.978627+0000","last_became_active":"2024-03-24T10:36:26.216516+0000","last_became_peered":"2024-03-24T10:36:26.216516+0000","last_unstale":"2024-03-24T10:36:31.978627+0000","last_undegraded":"2024-03-24T10:36:31.978627+0000","last_fullsized":"2024-03-24T10:36:31.978627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978689+0000","last_change":"2024-03-24T10:36:25.220871+0000","last_active":"2024-03-24T10:36:31.978689+0000","last_peered":"2024-03-24T10:36:31.978689+0000","last_clean":"2024-03-24T10:36:31.978689+0000","last_became_active":"2024-03-24T10:36:25.220566+0000","last_became_peered":"2024-03-24T10:36:25.220566+0000","last_unstale":"2024-03-24T10:36:31.978689+0000","last_undegraded":"2024-03-24T10:36:31.978689+0000","last_fullsized":"2024-03-24T10:36:31.978689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:11.467800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978512+0000","last_change":"2024-03-24T10:36:30.287965+0000","last_active":"2024-03-24T10:36:31.978512+0000","last_peered":"2024-03-24T10:36:31.978512+0000","last_clean":"2024-03-24T10:36:31.978512+0000","last_became_active":"2024-03-24T10:36:30.287151+0000","last_became_peered":"2024-03-24T10:36:30.287151+0000","last_unstale":"2024-03-24T10:36:31.978512+0000","last_undegraded":"2024-03-24T10:36:31.978512+0000","last_fullsized":"2024-03-24T10:36:31.978512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:42.603073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240890+0000","last_change":"2024-03-24T10:36:26.228488+0000","last_active":"2024-03-24T10:36:31.240890+0000","last_peered":"2024-03-24T10:36:31.240890+0000","last_clean":"2024-03-24T10:36:31.240890+0000","last_became_active":"2024-03-24T10:36:26.228001+0000","last_became_peered":"2024-03-24T10:36:26.228001+0000","last_unstale":"2024-03-24T10:36:31.240890+0000","last_undegraded":"2024-03-24T10:36:31.240890+0000","last_fullsized":"2024-03-24T10:36:31.240890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978655+0000","last_change":"2024-03-24T10:36:25.213196+0000","last_active":"2024-03-24T10:36:31.978655+0000","last_peered":"2024-03-24T10:36:31.978655+0000","last_clean":"2024-03-24T10:36:31.978655+0000","last_became_active":"2024-03-24T10:36:25.212908+0000","last_became_peered":"2024-03-24T10:36:25.212908+0000","last_unstale":"2024-03-24T10:36:31.978655+0000","last_undegraded":"2024-03-24T10:36:31.978655+0000","last_fullsized":"2024-03-24T10:36:31.978655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977909+0000","last_change":"2024-03-24T10:36:30.257971+0000","last_active":"2024-03-24T10:36:31.977909+0000","last_peered":"2024-03-24T10:36:31.977909+0000","last_clean":"2024-03-24T10:36:31.977909+0000","last_became_active":"2024-03-24T10:36:30.257595+0000","last_became_peered":"2024-03-24T10:36:30.257595+0000","last_unstale":"2024-03-24T10:36:31.977909+0000","last_undegraded":"2024-03-24T10:36:31.977909+0000","last_fullsized":"2024-03-24T10:36:31.977909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240167+0000","last_change":"2024-03-24T10:36:26.230507+0000","last_active":"2024-03-24T10:36:31.240167+0000","last_peered":"2024-03-24T10:36:31.240167+0000","last_clean":"2024-03-24T10:36:31.240167+0000","last_became_active":"2024-03-24T10:36:26.230065+0000","last_became_peered":"2024-03-24T10:36:26.230065+0000","last_unstale":"2024-03-24T10:36:31.240167+0000","last_undegraded":"2024-03-24T10:36:31.240167+0000","last_fullsized":"2024-03-24T10:36:31.240167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240522+0000","last_change":"2024-03-24T10:36:25.215977+0000","last_active":"2024-03-24T10:36:31.240522+0000","last_peered":"2024-03-24T10:36:31.240522+0000","last_clean":"2024-03-24T10:36:31.240522+0000","last_became_active":"2024-03-24T10:36:25.215688+0000","last_became_peered":"2024-03-24T10:36:25.215688+0000","last_unstale":"2024-03-24T10:36:31.240522+0000","last_undegraded":"2024-03-24T10:36:31.240522+0000","last_fullsized":"2024-03-24T10:36:31.240522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978606+0000","last_change":"2024-03-24T10:36:30.255099+0000","last_active":"2024-03-24T10:36:31.978606+0000","last_peered":"2024-03-24T10:36:31.978606+0000","last_clean":"2024-03-24T10:36:31.978606+0000","last_became_active":"2024-03-24T10:36:30.254701+0000","last_became_peered":"2024-03-24T10:36:30.254701+0000","last_unstale":"2024-03-24T10:36:31.978606+0000","last_undegraded":"2024-03-24T10:36:31.978606+0000","last_fullsized":"2024-03-24T10:36:31.978606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977951+0000","last_change":"2024-03-24T10:36:26.218799+0000","last_active":"2024-03-24T10:36:31.977951+0000","last_peered":"2024-03-24T10:36:31.977951+0000","last_clean":"2024-03-24T10:36:31.977951+0000","last_became_active":"2024-03-24T10:36:26.218417+0000","last_became_peered":"2024-03-24T10:36:26.218417+0000","last_unstale":"2024-03-24T10:36:31.977951+0000","last_undegraded":"2024-03-24T10:36:31.977951+0000","last_fullsized":"2024-03-24T10:36:31.977951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638115+0000","last_change":"2024-03-24T10:36:25.215346+0000","last_active":"2024-03-24T10:36:31.638115+0000","last_peered":"2024-03-24T10:36:31.638115+0000","last_clean":"2024-03-24T10:36:31.638115+0000","last_became_active":"2024-03-24T10:36:25.215072+0000","last_became_peered":"2024-03-24T10:36:25.215072+0000","last_unstale":"2024-03-24T10:36:31.638115+0000","last_undegraded":"2024-03-24T10:36:31.638115+0000","last_fullsized":"2024-03-24T10:36:31.638115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979217+0000","last_change":"2024-03-24T10:36:30.258147+0000","last_active":"2024-03-24T10:36:31.979217+0000","last_peered":"2024-03-24T10:36:31.979217+0000","last_clean":"2024-03-24T10:36:31.979217+0000","last_became_active":"2024-03-24T10:36:30.257704+0000","last_became_peered":"2024-03-24T10:36:30.257704+0000","last_unstale":"2024-03-24T10:36:31.979217+0000","last_undegraded":"2024-03-24T10:36:31.979217+0000","last_fullsized":"2024-03-24T10:36:31.979217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977926+0000","last_change":"2024-03-24T10:36:26.235288+0000","last_active":"2024-03-24T10:36:31.977926+0000","last_peered":"2024-03-24T10:36:31.977926+0000","last_clean":"2024-03-24T10:36:31.977926+0000","last_became_active":"2024-03-24T10:36:26.235008+0000","last_became_peered":"2024-03-24T10:36:26.235008+0000","last_unstale":"2024-03-24T10:36:31.977926+0000","last_undegraded":"2024-03-24T10:36:31.977926+0000","last_fullsized":"2024-03-24T10:36:31.977926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:56:34.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978361+0000","last_change":"2024-03-24T10:36:25.223252+0000","last_active":"2024-03-24T10:36:31.978361+0000","last_peered":"2024-03-24T10:36:31.978361+0000","last_clean":"2024-03-24T10:36:31.978361+0000","last_became_active":"2024-03-24T10:36:25.222927+0000","last_became_peered":"2024-03-24T10:36:25.222927+0000","last_unstale":"2024-03-24T10:36:31.978361+0000","last_undegraded":"2024-03-24T10:36:31.978361+0000","last_fullsized":"2024-03-24T10:36:31.978361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978487+0000","last_change":"2024-03-24T10:36:30.287525+0000","last_active":"2024-03-24T10:36:31.978487+0000","last_peered":"2024-03-24T10:36:31.978487+0000","last_clean":"2024-03-24T10:36:31.978487+0000","last_became_active":"2024-03-24T10:36:30.287145+0000","last_became_peered":"2024-03-24T10:36:30.287145+0000","last_unstale":"2024-03-24T10:36:31.978487+0000","last_undegraded":"2024-03-24T10:36:31.978487+0000","last_fullsized":"2024-03-24T10:36:31.978487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239931+0000","last_change":"2024-03-24T10:36:26.245809+0000","last_active":"2024-03-24T10:36:31.239931+0000","last_peered":"2024-03-24T10:36:31.239931+0000","last_clean":"2024-03-24T10:36:31.239931+0000","last_became_active":"2024-03-24T10:36:26.245498+0000","last_became_peered":"2024-03-24T10:36:26.245498+0000","last_unstale":"2024-03-24T10:36:31.239931+0000","last_undegraded":"2024-03-24T10:36:31.239931+0000","last_fullsized":"2024-03-24T10:36:31.239931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240567+0000","last_change":"2024-03-24T10:36:25.216299+0000","last_active":"2024-03-24T10:36:31.240567+0000","last_peered":"2024-03-24T10:36:31.240567+0000","last_clean":"2024-03-24T10:36:31.240567+0000","last_became_active":"2024-03-24T10:36:25.215751+0000","last_became_peered":"2024-03-24T10:36:25.215751+0000","last_unstale":"2024-03-24T10:36:31.240567+0000","last_undegraded":"2024-03-24T10:36:31.240567+0000","last_fullsized":"2024-03-24T10:36:31.240567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978454+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:36:31.978454+0000","last_peered":"2024-03-24T10:36:31.978454+0000","last_clean":"2024-03-24T10:36:31.978454+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:36:31.978454+0000","last_undegraded":"2024-03-24T10:36:31.978454+0000","last_fullsized":"2024-03-24T10:36:31.978454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977877+0000","last_change":"2024-03-24T10:36:30.288784+0000","last_active":"2024-03-24T10:36:31.977877+0000","last_peered":"2024-03-24T10:36:31.977877+0000","last_clean":"2024-03-24T10:36:31.977877+0000","last_became_active":"2024-03-24T10:36:30.288412+0000","last_became_peered":"2024-03-24T10:36:30.288412+0000","last_unstale":"2024-03-24T10:36:31.977877+0000","last_undegraded":"2024-03-24T10:36:31.977877+0000","last_fullsized":"2024-03-24T10:36:31.977877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978384+0000","last_change":"2024-03-24T10:36:26.245642+0000","last_active":"2024-03-24T10:36:31.978384+0000","last_peered":"2024-03-24T10:36:31.978384+0000","last_clean":"2024-03-24T10:36:31.978384+0000","last_became_active":"2024-03-24T10:36:26.245341+0000","last_became_peered":"2024-03-24T10:36:26.245341+0000","last_unstale":"2024-03-24T10:36:31.978384+0000","last_undegraded":"2024-03-24T10:36:31.978384+0000","last_fullsized":"2024-03-24T10:36:31.978384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638364+0000","last_change":"2024-03-24T10:36:25.220827+0000","last_active":"2024-03-24T10:36:31.638364+0000","last_peered":"2024-03-24T10:36:31.638364+0000","last_clean":"2024-03-24T10:36:31.638364+0000","last_became_active":"2024-03-24T10:36:25.220515+0000","last_became_peered":"2024-03-24T10:36:25.220515+0000","last_unstale":"2024-03-24T10:36:31.638364+0000","last_undegraded":"2024-03-24T10:36:31.638364+0000","last_fullsized":"2024-03-24T10:36:31.638364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977666+0000","last_change":"2024-03-24T10:36:30.288795+0000","last_active":"2024-03-24T10:36:31.977666+0000","last_peered":"2024-03-24T10:36:31.977666+0000","last_clean":"2024-03-24T10:36:31.977666+0000","last_became_active":"2024-03-24T10:36:30.288440+0000","last_became_peered":"2024-03-24T10:36:30.288440+0000","last_unstale":"2024-03-24T10:36:31.977666+0000","last_undegraded":"2024-03-24T10:36:31.977666+0000","last_fullsized":"2024-03-24T10:36:31.977666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240779+0000","last_change":"2024-03-24T10:36:26.228495+0000","last_active":"2024-03-24T10:36:31.240779+0000","last_peered":"2024-03-24T10:36:31.240779+0000","last_clean":"2024-03-24T10:36:31.240779+0000","last_became_active":"2024-03-24T10:36:26.227905+0000","last_became_peered":"2024-03-24T10:36:26.227905+0000","last_unstale":"2024-03-24T10:36:31.240779+0000","last_undegraded":"2024-03-24T10:36:31.240779+0000","last_fullsized":"2024-03-24T10:36:31.240779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978754+0000","last_change":"2024-03-24T10:36:25.217156+0000","last_active":"2024-03-24T10:36:31.978754+0000","last_peered":"2024-03-24T10:36:31.978754+0000","last_clean":"2024-03-24T10:36:31.978754+0000","last_became_active":"2024-03-24T10:36:25.216896+0000","last_became_peered":"2024-03-24T10:36:25.216896+0000","last_unstale":"2024-03-24T10:36:31.978754+0000","last_undegraded":"2024-03-24T10:36:31.978754+0000","last_fullsized":"2024-03-24T10:36:31.978754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978225+0000","last_change":"2024-03-24T10:36:30.260197+0000","last_active":"2024-03-24T10:36:31.978225+0000","last_peered":"2024-03-24T10:36:31.978225+0000","last_clean":"2024-03-24T10:36:31.978225+0000","last_became_active":"2024-03-24T10:36:30.259827+0000","last_became_peered":"2024-03-24T10:36:30.259827+0000","last_unstale":"2024-03-24T10:36:31.978225+0000","last_undegraded":"2024-03-24T10:36:31.978225+0000","last_fullsized":"2024-03-24T10:36:31.978225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978711+0000","last_change":"2024-03-24T10:36:26.236212+0000","last_active":"2024-03-24T10:36:31.978711+0000","last_peered":"2024-03-24T10:36:31.978711+0000","last_clean":"2024-03-24T10:36:31.978711+0000","last_became_active":"2024-03-24T10:36:26.235669+0000","last_became_peered":"2024-03-24T10:36:26.235669+0000","last_unstale":"2024-03-24T10:36:31.978711+0000","last_undegraded":"2024-03-24T10:36:31.978711+0000","last_fullsized":"2024-03-24T10:36:31.978711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:22.915113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638384+0000","last_change":"2024-03-24T10:36:25.219420+0000","last_active":"2024-03-24T10:36:31.638384+0000","last_peered":"2024-03-24T10:36:31.638384+0000","last_clean":"2024-03-24T10:36:31.638384+0000","last_became_active":"2024-03-24T10:36:25.218854+0000","last_became_peered":"2024-03-24T10:36:25.218854+0000","last_unstale":"2024-03-24T10:36:31.638384+0000","last_undegraded":"2024-03-24T10:36:31.638384+0000","last_fullsized":"2024-03-24T10:36:31.638384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239363+0000","last_change":"2024-03-24T10:36:30.287411+0000","last_active":"2024-03-24T10:36:31.239363+0000","last_peered":"2024-03-24T10:36:31.239363+0000","last_clean":"2024-03-24T10:36:31.239363+0000","last_became_active":"2024-03-24T10:36:30.286957+0000","last_became_peered":"2024-03-24T10:36:30.286957+0000","last_unstale":"2024-03-24T10:36:31.239363+0000","last_undegraded":"2024-03-24T10:36:31.239363+0000","last_fullsized":"2024-03-24T10:36:31.239363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978539+0000","last_change":"2024-03-24T10:36:26.236702+0000","last_active":"2024-03-24T10:36:31.978539+0000","last_peered":"2024-03-24T10:36:31.978539+0000","last_clean":"2024-03-24T10:36:31.978539+0000","last_became_active":"2024-03-24T10:36:26.236444+0000","last_became_peered":"2024-03-24T10:36:26.236444+0000","last_unstale":"2024-03-24T10:36:31.978539+0000","last_undegraded":"2024-03-24T10:36:31.978539+0000","last_fullsized":"2024-03-24T10:36:31.978539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240722+0000","last_change":"2024-03-24T10:36:25.213103+0000","last_active":"2024-03-24T10:36:31.240722+0000","last_peered":"2024-03-24T10:36:31.240722+0000","last_clean":"2024-03-24T10:36:31.240722+0000","last_became_active":"2024-03-24T10:36:25.212568+0000","last_became_peered":"2024-03-24T10:36:25.212568+0000","last_unstale":"2024-03-24T10:36:31.240722+0000","last_undegraded":"2024-03-24T10:36:31.240722+0000","last_fullsized":"2024-03-24T10:36:31.240722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239802+0000","last_change":"2024-03-24T10:36:30.257883+0000","last_active":"2024-03-24T10:36:31.239802+0000","last_peered":"2024-03-24T10:36:31.239802+0000","last_clean":"2024-03-24T10:36:31.239802+0000","last_became_active":"2024-03-24T10:36:30.257543+0000","last_became_peered":"2024-03-24T10:36:30.257543+0000","last_unstale":"2024-03-24T10:36:31.239802+0000","last_undegraded":"2024-03-24T10:36:31.239802+0000","last_fullsized":"2024-03-24T10:36:31.239802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:25.370328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978339+0000","last_change":"2024-03-24T10:36:26.235416+0000","last_active":"2024-03-24T10:36:31.978339+0000","last_peered":"2024-03-24T10:36:31.978339+0000","last_clean":"2024-03-24T10:36:31.978339+0000","last_became_active":"2024-03-24T10:36:26.235039+0000","last_became_peered":"2024-03-24T10:36:26.235039+0000","last_unstale":"2024-03-24T10:36:31.978339+0000","last_undegraded":"2024-03-24T10:36:31.978339+0000","last_fullsized":"2024-03-24T10:36:31.978339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638000+0000","last_change":"2024-03-24T10:36:25.215430+0000","last_active":"2024-03-24T10:36:31.638000+0000","last_peered":"2024-03-24T10:36:31.638000+0000","last_clean":"2024-03-24T10:36:31.638000+0000","last_became_active":"2024-03-24T10:36:25.215118+0000","last_became_peered":"2024-03-24T10:36:25.215118+0000","last_unstale":"2024-03-24T10:36:31.638000+0000","last_undegraded":"2024-03-24T10:36:31.638000+0000","last_fullsized":"2024-03-24T10:36:31.638000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978465+0000","last_change":"2024-03-24T10:36:30.252499+0000","last_active":"2024-03-24T10:36:31.978465+0000","last_peered":"2024-03-24T10:36:31.978465+0000","last_clean":"2024-03-24T10:36:31.978465+0000","last_became_active":"2024-03-24T10:36:30.252134+0000","last_became_peered":"2024-03-24T10:36:30.252134+0000","last_unstale":"2024-03-24T10:36:31.978465+0000","last_undegraded":"2024-03-24T10:36:31.978465+0000","last_fullsized":"2024-03-24T10:36:31.978465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977517+0000","last_change":"2024-03-24T10:36:26.226532+0000","last_active":"2024-03-24T10:36:31.977517+0000","last_peered":"2024-03-24T10:36:31.977517+0000","last_clean":"2024-03-24T10:36:31.977517+0000","last_became_active":"2024-03-24T10:36:26.226220+0000","last_became_peered":"2024-03-24T10:36:26.226220+0000","last_unstale":"2024-03-24T10:36:31.977517+0000","last_undegraded":"2024-03-24T10:36:31.977517+0000","last_fullsized":"2024-03-24T10:36:31.977517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977582+0000","last_change":"2024-03-24T10:36:25.216401+0000","last_active":"2024-03-24T10:36:31.977582+0000","last_peered":"2024-03-24T10:36:31.977582+0000","last_clean":"2024-03-24T10:36:31.977582+0000","last_became_active":"2024-03-24T10:36:25.216137+0000","last_became_peered":"2024-03-24T10:36:25.216137+0000","last_unstale":"2024-03-24T10:36:31.977582+0000","last_undegraded":"2024-03-24T10:36:31.977582+0000","last_fullsized":"2024-03-24T10:36:31.977582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240400+0000","last_change":"2024-03-24T10:36:30.287578+0000","last_active":"2024-03-24T10:36:31.240400+0000","last_peered":"2024-03-24T10:36:31.240400+0000","last_clean":"2024-03-24T10:36:31.240400+0000","last_became_active":"2024-03-24T10:36:30.287214+0000","last_became_peered":"2024-03-24T10:36:30.287214+0000","last_unstale":"2024-03-24T10:36:31.240400+0000","last_undegraded":"2024-03-24T10:36:31.240400+0000","last_fullsized":"2024-03-24T10:36:31.240400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:27:44.336084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978149+0000","last_change":"2024-03-24T10:36:26.235579+0000","last_active":"2024-03-24T10:36:31.978149+0000","last_peered":"2024-03-24T10:36:31.978149+0000","last_clean":"2024-03-24T10:36:31.978149+0000","last_became_active":"2024-03-24T10:36:26.234789+0000","last_became_peered":"2024-03-24T10:36:26.234789+0000","last_unstale":"2024-03-24T10:36:31.978149+0000","last_undegraded":"2024-03-24T10:36:31.978149+0000","last_fullsized":"2024-03-24T10:36:31.978149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240458+0000","last_change":"2024-03-24T10:36:25.213457+0000","last_active":"2024-03-24T10:36:31.240458+0000","last_peered":"2024-03-24T10:36:31.240458+0000","last_clean":"2024-03-24T10:36:31.240458+0000","last_became_active":"2024-03-24T10:36:25.213160+0000","last_became_peered":"2024-03-24T10:36:25.213160+0000","last_unstale":"2024-03-24T10:36:31.240458+0000","last_undegraded":"2024-03-24T10:36:31.240458+0000","last_fullsized":"2024-03-24T10:36:31.240458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240747+0000","last_change":"2024-03-24T10:36:30.287535+0000","last_active":"2024-03-24T10:36:31.240747+0000","last_peered":"2024-03-24T10:36:31.240747+0000","last_clean":"2024-03-24T10:36:31.240747+0000","last_became_active":"2024-03-24T10:36:30.287117+0000","last_became_peered":"2024-03-24T10:36:30.287117+0000","last_unstale":"2024-03-24T10:36:31.240747+0000","last_undegraded":"2024-03-24T10:36:31.240747+0000","last_fullsized":"2024-03-24T10:36:31.240747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:14:00.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978297+0000","last_change":"2024-03-24T10:36:26.236223+0000","last_active":"2024-03-24T10:36:31.978297+0000","last_peered":"2024-03-24T10:36:31.978297+0000","last_clean":"2024-03-24T10:36:31.978297+0000","last_became_active":"2024-03-24T10:36:26.235923+0000","last_became_peered":"2024-03-24T10:36:26.235923+0000","last_unstale":"2024-03-24T10:36:31.978297+0000","last_undegraded":"2024-03-24T10:36:31.978297+0000","last_fullsized":"2024-03-24T10:36:31.978297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978459+0000","last_change":"2024-03-24T10:36:25.209119+0000","last_active":"2024-03-24T10:36:31.978459+0000","last_peered":"2024-03-24T10:36:31.978459+0000","last_clean":"2024-03-24T10:36:31.978459+0000","last_became_active":"2024-03-24T10:36:25.208379+0000","last_became_peered":"2024-03-24T10:36:25.208379+0000","last_unstale":"2024-03-24T10:36:31.978459+0000","last_undegraded":"2024-03-24T10:36:31.978459+0000","last_fullsized":"2024-03-24T10:36:31.978459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240879+0000","last_change":"2024-03-24T10:36:30.288794+0000","last_active":"2024-03-24T10:36:31.240879+0000","last_peered":"2024-03-24T10:36:31.240879+0000","last_clean":"2024-03-24T10:36:31.240879+0000","last_became_active":"2024-03-24T10:36:30.288455+0000","last_became_peered":"2024-03-24T10:36:30.288455+0000","last_unstale":"2024-03-24T10:36:31.240879+0000","last_undegraded":"2024-03-24T10:36:31.240879+0000","last_fullsized":"2024-03-24T10:36:31.240879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978280+0000","last_change":"2024-03-24T10:36:26.235572+0000","last_active":"2024-03-24T10:36:31.978280+0000","last_peered":"2024-03-24T10:36:31.978280+0000","last_clean":"2024-03-24T10:36:31.978280+0000","last_became_active":"2024-03-24T10:36:26.234988+0000","last_became_peered":"2024-03-24T10:36:26.234988+0000","last_unstale":"2024-03-24T10:36:31.978280+0000","last_undegraded":"2024-03-24T10:36:31.978280+0000","last_fullsized":"2024-03-24T10:36:31.978280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:35.680520+0000","last_change":"2024-03-24T10:36:25.218162+0000","last_active":"2024-03-24T10:36:35.680520+0000","last_peered":"2024-03-24T10:36:35.680520+0000","last_clean":"2024-03-24T10:36:35.680520+0000","last_became_active":"2024-03-24T10:36:25.217883+0000","last_became_peered":"2024-03-24T10:36:25.217883+0000","last_unstale":"2024-03-24T10:36:35.680520+0000","last_undegraded":"2024-03-24T10:36:35.680520+0000","last_fullsized":"2024-03-24T10:36:35.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978846+0000","last_change":"2024-03-24T10:36:30.257936+0000","last_active":"2024-03-24T10:36:31.978846+0000","last_peered":"2024-03-24T10:36:31.978846+0000","last_clean":"2024-03-24T10:36:31.978846+0000","last_became_active":"2024-03-24T10:36:30.257563+0000","last_became_peered":"2024-03-24T10:36:30.257563+0000","last_unstale":"2024-03-24T10:36:31.978846+0000","last_undegraded":"2024-03-24T10:36:31.978846+0000","last_fullsized":"2024-03-24T10:36:31.978846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240985+0000","last_change":"2024-03-24T10:36:26.231768+0000","last_active":"2024-03-24T10:36:31.240985+0000","last_peered":"2024-03-24T10:36:31.240985+0000","last_clean":"2024-03-24T10:36:31.240985+0000","last_became_active":"2024-03-24T10:36:26.231505+0000","last_became_peered":"2024-03-24T10:36:26.231505+0000","last_unstale":"2024-03-24T10:36:31.240985+0000","last_undegraded":"2024-03-24T10:36:31.240985+0000","last_fullsized":"2024-03-24T10:36:31.240985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:12.471736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978654+0000","last_change":"2024-03-24T10:36:25.220658+0000","last_active":"2024-03-24T10:36:31.978654+0000","last_peered":"2024-03-24T10:36:31.978654+0000","last_clean":"2024-03-24T10:36:31.978654+0000","last_became_active":"2024-03-24T10:36:25.220451+0000","last_became_peered":"2024-03-24T10:36:25.220451+0000","last_unstale":"2024-03-24T10:36:31.978654+0000","last_undegraded":"2024-03-24T10:36:31.978654+0000","last_fullsized":"2024-03-24T10:36:31.978654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240105+0000","last_change":"2024-03-24T10:36:30.255676+0000","last_active":"2024-03-24T10:36:31.240105+0000","last_peered":"2024-03-24T10:36:31.240105+0000","last_clean":"2024-03-24T10:36:31.240105+0000","last_became_active":"2024-03-24T10:36:30.255314+0000","last_became_peered":"2024-03-24T10:36:30.255314+0000","last_unstale":"2024-03-24T10:36:31.240105+0000","last_undegraded":"2024-03-24T10:36:31.240105+0000","last_fullsized":"2024-03-24T10:36:31.240105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978164+0000","last_change":"2024-03-24T10:36:26.240945+0000","last_active":"2024-03-24T10:36:31.978164+0000","last_peered":"2024-03-24T10:36:31.978164+0000","last_clean":"2024-03-24T10:36:31.978164+0000","last_became_active":"2024-03-24T10:36:26.240664+0000","last_became_peered":"2024-03-24T10:36:26.240664+0000","last_unstale":"2024-03-24T10:36:31.978164+0000","last_undegraded":"2024-03-24T10:36:31.978164+0000","last_fullsized":"2024-03-24T10:36:31.978164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240312+0000","last_change":"2024-03-24T10:36:25.215416+0000","last_active":"2024-03-24T10:36:31.240312+0000","last_peered":"2024-03-24T10:36:31.240312+0000","last_clean":"2024-03-24T10:36:31.240312+0000","last_became_active":"2024-03-24T10:36:25.215130+0000","last_became_peered":"2024-03-24T10:36:25.215130+0000","last_unstale":"2024-03-24T10:36:31.240312+0000","last_undegraded":"2024-03-24T10:36:31.240312+0000","last_fullsized":"2024-03-24T10:36:31.240312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240235+0000","last_change":"2024-03-24T10:36:30.258107+0000","last_active":"2024-03-24T10:36:31.240235+0000","last_peered":"2024-03-24T10:36:31.240235+0000","last_clean":"2024-03-24T10:36:31.240235+0000","last_became_active":"2024-03-24T10:36:30.257548+0000","last_became_peered":"2024-03-24T10:36:30.257548+0000","last_unstale":"2024-03-24T10:36:31.240235+0000","last_undegraded":"2024-03-24T10:36:31.240235+0000","last_fullsized":"2024-03-24T10:36:31.240235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:27:22.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240228+0000","last_change":"2024-03-24T10:36:26.238486+0000","last_active":"2024-03-24T10:36:31.240228+0000","last_peered":"2024-03-24T10:36:31.240228+0000","last_clean":"2024-03-24T10:36:31.240228+0000","last_became_active":"2024-03-24T10:36:26.237843+0000","last_became_peered":"2024-03-24T10:36:26.237843+0000","last_unstale":"2024-03-24T10:36:31.240228+0000","last_undegraded":"2024-03-24T10:36:31.240228+0000","last_fullsized":"2024-03-24T10:36:31.240228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978669+0000","last_change":"2024-03-24T10:36:25.220880+0000","last_active":"2024-03-24T10:36:31.978669+0000","last_peered":"2024-03-24T10:36:31.978669+0000","last_clean":"2024-03-24T10:36:31.978669+0000","last_became_active":"2024-03-24T10:36:25.220622+0000","last_became_peered":"2024-03-24T10:36:25.220622+0000","last_unstale":"2024-03-24T10:36:31.978669+0000","last_undegraded":"2024-03-24T10:36:31.978669+0000","last_fullsized":"2024-03-24T10:36:31.978669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239888+0000","last_change":"2024-03-24T10:36:30.291355+0000","last_active":"2024-03-24T10:36:31.239888+0000","last_peered":"2024-03-24T10:36:31.239888+0000","last_clean":"2024-03-24T10:36:31.239888+0000","last_became_active":"2024-03-24T10:36:30.290079+0000","last_became_peered":"2024-03-24T10:36:30.290079+0000","last_unstale":"2024-03-24T10:36:31.239888+0000","last_undegraded":"2024-03-24T10:36:31.239888+0000","last_fullsized":"2024-03-24T10:36:31.239888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:26:51.570024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:30.290362+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:30.289924+0000","last_became_peered":"2024-03-24T10:36:30.289924+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978144+0000","last_change":"2024-03-24T10:36:26.223759+0000","last_active":"2024-03-24T10:36:31.978144+0000","last_peered":"2024-03-24T10:36:31.978144+0000","last_clean":"2024-03-24T10:36:31.978144+0000","last_became_active":"2024-03-24T10:36:26.223332+0000","last_became_peered":"2024-03-24T10:36:26.223332+0000","last_unstale":"2024-03-24T10:36:31.978144+0000","last_undegraded":"2024-03-24T10:36:31.978144+0000","last_fullsized":"2024-03-24T10:36:31.978144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239431+0000","last_change":"2024-03-24T10:36:25.211540+0000","last_active":"2024-03-24T10:36:31.239431+0000","last_peered":"2024-03-24T10:36:31.239431+0000","last_clean":"2024-03-24T10:36:31.239431+0000","last_became_active":"2024-03-24T10:36:25.211248+0000","last_became_peered":"2024-03-24T10:36:25.211248+0000","last_unstale":"2024-03-24T10:36:31.239431+0000","last_undegraded":"2024-03-24T10:36:31.239431+0000","last_fullsized":"2024-03-24T10:36:31.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977993+0000","last_change":"2024-03-24T10:36:30.254914+0000","last_active":"2024-03-24T10:36:31.977993+0000","last_peered":"2024-03-24T10:36:31.977993+0000","last_clean":"2024-03-24T10:36:31.977993+0000","last_became_active":"2024-03-24T10:36:30.254506+0000","last_became_peered":"2024-03-24T10:36:30.254506+0000","last_unstale":"2024-03-24T10:36:31.977993+0000","last_undegraded":"2024-03-24T10:36:31.977993+0000","last_fullsized":"2024-03-24T10:36:31.977993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239911+0000","last_change":"2024-03-24T10:36:26.226712+0000","last_active":"2024-03-24T10:36:31.239911+0000","last_peered":"2024-03-24T10:36:31.239911+0000","last_clean":"2024-03-24T10:36:31.239911+0000","last_became_active":"2024-03-24T10:36:26.226434+0000","last_became_peered":"2024-03-24T10:36:26.226434+0000","last_unstale":"2024-03-24T10:36:31.239911+0000","last_undegraded":"2024-03-24T10:36:31.239911+0000","last_fullsized":"2024-03-24T10:36:31.239911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240043+0000","last_change":"2024-03-24T10:36:25.216508+0000","last_active":"2024-03-24T10:36:31.240043+0000","last_peered":"2024-03-24T10:36:31.240043+0000","last_clean":"2024-03-24T10:36:31.240043+0000","last_became_active":"2024-03-24T10:36:25.216249+0000","last_became_peered":"2024-03-24T10:36:25.216249+0000","last_unstale":"2024-03-24T10:36:31.240043+0000","last_undegraded":"2024-03-24T10:36:31.240043+0000","last_fullsized":"2024-03-24T10:36:31.240043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977716+0000","last_change":"2024-03-24T10:36:25.217255+0000","last_active":"2024-03-24T10:36:31.977716+0000","last_peered":"2024-03-24T10:36:31.977716+0000","last_clean":"2024-03-24T10:36:31.977716+0000","last_became_active":"2024-03-24T10:36:25.216974+0000","last_became_peered":"2024-03-24T10:36:25.216974+0000","last_unstale":"2024-03-24T10:36:31.977716+0000","last_undegraded":"2024-03-24T10:36:31.977716+0000","last_fullsized":"2024-03-24T10:36:31.977716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978369+0000","last_change":"2024-03-24T10:36:26.235283+0000","last_active":"2024-03-24T10:36:31.978369+0000","last_peered":"2024-03-24T10:36:31.978369+0000","last_clean":"2024-03-24T10:36:31.978369+0000","last_became_active":"2024-03-24T10:36:26.234957+0000","last_became_peered":"2024-03-24T10:36:26.234957+0000","last_unstale":"2024-03-24T10:36:31.978369+0000","last_undegraded":"2024-03-24T10:36:31.978369+0000","last_fullsized":"2024-03-24T10:36:31.978369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638315+0000","last_change":"2024-03-24T10:36:30.258066+0000","last_active":"2024-03-24T10:36:31.638315+0000","last_peered":"2024-03-24T10:36:31.638315+0000","last_clean":"2024-03-24T10:36:31.638315+0000","last_became_active":"2024-03-24T10:36:30.257721+0000","last_became_peered":"2024-03-24T10:36:30.257721+0000","last_unstale":"2024-03-24T10:36:31.638315+0000","last_undegraded":"2024-03-24T10:36:31.638315+0000","last_fullsized":"2024-03-24T10:36:31.638315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:48.645675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240710+0000","last_change":"2024-03-24T10:36:25.217924+0000","last_active":"2024-03-24T10:36:31.240710+0000","last_peered":"2024-03-24T10:36:31.240710+0000","last_clean":"2024-03-24T10:36:31.240710+0000","last_became_active":"2024-03-24T10:36:25.217653+0000","last_became_peered":"2024-03-24T10:36:25.217653+0000","last_unstale":"2024-03-24T10:36:31.240710+0000","last_undegraded":"2024-03-24T10:36:31.240710+0000","last_fullsized":"2024-03-24T10:36:31.240710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:21:41.967893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239946+0000","last_change":"2024-03-24T10:36:26.222302+0000","last_active":"2024-03-24T10:36:31.239946+0000","last_peered":"2024-03-24T10:36:31.239946+0000","last_clean":"2024-03-24T10:36:31.239946+0000","last_became_active":"2024-03-24T10:36:26.221621+0000","last_became_peered":"2024-03-24T10:36:26.221621+0000","last_unstale":"2024-03-24T10:36:31.239946+0000","last_undegraded":"2024-03-24T10:36:31.239946+0000","last_fullsized":"2024-03-24T10:36:31.239946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240272+0000","last_change":"2024-03-24T10:36:30.252503+0000","last_active":"2024-03-24T10:36:31.240272+0000","last_peered":"2024-03-24T10:36:31.240272+0000","last_clean":"2024-03-24T10:36:31.240272+0000","last_became_active":"2024-03-24T10:36:30.252117+0000","last_became_peered":"2024-03-24T10:36:30.252117+0000","last_unstale":"2024-03-24T10:36:31.240272+0000","last_undegraded":"2024-03-24T10:36:31.240272+0000","last_fullsized":"2024-03-24T10:36:31.240272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:35:10.560451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977432+0000","last_change":"2024-03-24T10:36:26.227933+0000","last_active":"2024-03-24T10:36:31.977432+0000","last_peered":"2024-03-24T10:36:31.977432+0000","last_clean":"2024-03-24T10:36:31.977432+0000","last_became_active":"2024-03-24T10:36:26.227650+0000","last_became_peered":"2024-03-24T10:36:26.227650+0000","last_unstale":"2024-03-24T10:36:31.977432+0000","last_undegraded":"2024-03-24T10:36:31.977432+0000","last_fullsized":"2024-03-24T10:36:31.977432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638092+0000","last_change":"2024-03-24T10:36:26.240695+0000","last_active":"2024-03-24T10:36:31.638092+0000","last_peered":"2024-03-24T10:36:31.638092+0000","last_clean":"2024-03-24T10:36:31.638092+0000","last_became_active":"2024-03-24T10:36:26.240417+0000","last_became_peered":"2024-03-24T10:36:26.240417+0000","last_unstale":"2024-03-24T10:36:31.638092+0000","last_undegraded":"2024-03-24T10:36:31.638092+0000","last_fullsized":"2024-03-24T10:36:31.638092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240378+0000","last_change":"2024-03-24T10:36:26.242019+0000","last_active":"2024-03-24T10:36:31.240378+0000","last_peered":"2024-03-24T10:36:31.240378+0000","last_clean":"2024-03-24T10:36:31.240378+0000","last_became_active":"2024-03-24T10:36:26.241585+0000","last_became_peered":"2024-03-24T10:36:26.241585+0000","last_unstale":"2024-03-24T10:36:31.240378+0000","last_undegraded":"2024-03-24T10:36:31.240378+0000","last_fullsized":"2024-03-24T10:36:31.240378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978268+0000","last_change":"2024-03-24T10:36:26.228956+0000","last_active":"2024-03-24T10:36:31.978268+0000","last_peered":"2024-03-24T10:36:31.978268+0000","last_clean":"2024-03-24T10:36:31.978268+0000","last_became_active":"2024-03-24T10:36:26.228649+0000","last_became_peered":"2024-03-24T10:36:26.228649+0000","last_unstale":"2024-03-24T10:36:31.978268+0000","last_undegraded":"2024-03-24T10:36:31.978268+0000","last_fullsized":"2024-03-24T10:36:31.978268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240896+0000","last_change":"2024-03-24T10:36:26.230293+0000","last_active":"2024-03-24T10:36:31.240896+0000","last_peered":"2024-03-24T10:36:31.240896+0000","last_clean":"2024-03-24T10:36:31.240896+0000","last_became_active":"2024-03-24T10:36:26.229555+0000","last_became_peered":"2024-03-24T10:36:26.229555+0000","last_unstale":"2024-03-24T10:36:31.240896+0000","last_undegraded":"2024-03-24T10:36:31.240896+0000","last_fullsized":"2024-03-24T10:36:31.240896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978476+0000","last_change":"2024-03-24T10:36:26.222799+0000","last_active":"2024-03-24T10:36:31.978476+0000","last_peered":"2024-03-24T10:36:31.978476+0000","last_clean":"2024-03-24T10:36:31.978476+0000","last_became_active":"2024-03-24T10:36:26.221223+0000","last_became_peered":"2024-03-24T10:36:26.221223+0000","last_unstale":"2024-03-24T10:36:31.978476+0000","last_undegraded":"2024-03-24T10:36:31.978476+0000","last_fullsized":"2024-03-24T10:36:31.978476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978086+0000","last_change":"2024-03-24T10:36:26.226953+0000","last_active":"2024-03-24T10:36:31.978086+0000","last_peered":"2024-03-24T10:36:31.978086+0000","last_clean":"2024-03-24T10:36:31.978086+0000","last_became_active":"2024-03-24T10:36:26.226663+0000","last_became_peered":"2024-03-24T10:36:26.226663+0000","last_unstale":"2024-03-24T10:36:31.978086+0000","last_undegraded":"2024-03-24T10:36:31.978086+0000","last_fullsized":"2024-03-24T10:36:31.978086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240327+0000","last_change":"2024-03-24T10:36:26.229550+0000","last_active":"2024-03-24T10:36:31.240327+0000","last_peered":"2024-03-24T10:36:31.240327+0000","last_clean":"2024-03-24T10:36:31.240327+0000","last_became_active":"2024-03-24T10:36:26.229243+0000","last_became_peered":"2024-03-24T10:36:26.229243+0000","last_unstale":"2024-03-24T10:36:31.240327+0000","last_undegraded":"2024-03-24T10:36:31.240327+0000","last_fullsized":"2024-03-24T10:36:31.240327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239502+0000","last_change":"2024-03-24T10:36:26.228357+0000","last_active":"2024-03-24T10:36:31.239502+0000","last_peered":"2024-03-24T10:36:31.239502+0000","last_clean":"2024-03-24T10:36:31.239502+0000","last_became_active":"2024-03-24T10:36:26.228105+0000","last_became_peered":"2024-03-24T10:36:26.228105+0000","last_unstale":"2024-03-24T10:36:31.239502+0000","last_undegraded":"2024-03-24T10:36:31.239502+0000","last_fullsized":"2024-03-24T10:36:31.239502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240201+0000","last_change":"2024-03-24T10:36:26.230259+0000","last_active":"2024-03-24T10:36:31.240201+0000","last_peered":"2024-03-24T10:36:31.240201+0000","last_clean":"2024-03-24T10:36:31.240201+0000","last_became_active":"2024-03-24T10:36:26.229990+0000","last_became_peered":"2024-03-24T10:36:26.229990+0000","last_unstale":"2024-03-24T10:36:31.240201+0000","last_undegraded":"2024-03-24T10:36:31.240201+0000","last_fullsized":"2024-03-24T10:36:31.240201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240293+0000","last_change":"2024-03-24T10:36:26.242160+0000","last_active":"2024-03-24T10:36:31.240293+0000","last_peered":"2024-03-24T10:36:31.240293+0000","last_clean":"2024-03-24T10:36:31.240293+0000","last_became_active":"2024-03-24T10:36:26.241598+0000","last_became_peered":"2024-03-24T10:36:26.241598+0000","last_unstale":"2024-03-24T10:36:31.240293+0000","last_undegraded":"2024-03-24T10:36:31.240293+0000","last_fullsized":"2024-03-24T10:36:31.240293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978044+0000","last_change":"2024-03-24T10:36:26.239300+0000","last_active":"2024-03-24T10:36:31.978044+0000","last_peered":"2024-03-24T10:36:31.978044+0000","last_clean":"2024-03-24T10:36:31.978044+0000","last_became_active":"2024-03-24T10:36:26.239004+0000","last_became_peered":"2024-03-24T10:36:26.239004+0000","last_unstale":"2024-03-24T10:36:31.978044+0000","last_undegraded":"2024-03-24T10:36:31.978044+0000","last_fullsized":"2024-03-24T10:36:31.978044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977873+0000","last_change":"2024-03-24T10:36:26.234784+0000","last_active":"2024-03-24T10:36:31.977873+0000","last_peered":"2024-03-24T10:36:31.977873+0000","last_clean":"2024-03-24T10:36:31.977873+0000","last_became_active":"2024-03-24T10:36:26.234304+0000","last_became_peered":"2024-03-24T10:36:26.234304+0000","last_unstale":"2024-03-24T10:36:31.977873+0000","last_undegraded":"2024-03-24T10:36:31.977873+0000","last_fullsized":"2024-03-24T10:36:31.977873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978675+0000","last_change":"2024-03-24T10:36:26.234967+0000","last_active":"2024-03-24T10:36:31.978675+0000","last_peered":"2024-03-24T10:36:31.978675+0000","last_clean":"2024-03-24T10:36:31.978675+0000","last_became_active":"2024-03-24T10:36:26.234619+0000","last_became_peered":"2024-03-24T10:36:26.234619+0000","last_unstale":"2024-03-24T10:36:31.978675+0000","last_undegraded":"2024-03-24T10:36:31.978675+0000","last_fullsized":"2024-03-24T10:36:31.978675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638313+0000","last_change":"2024-03-24T10:36:26.218406+0000","last_active":"2024-03-24T10:36:31.638313+0000","last_peered":"2024-03-24T10:36:31.638313+0000","last_clean":"2024-03-24T10:36:31.638313+0000","last_became_active":"2024-03-24T10:36:26.218130+0000","last_became_peered":"2024-03-24T10:36:26.218130+0000","last_unstale":"2024-03-24T10:36:31.638313+0000","last_undegraded":"2024-03-24T10:36:31.638313+0000","last_fullsized":"2024-03-24T10:36:31.638313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240564+0000","last_change":"2024-03-24T10:36:26.241244+0000","last_active":"2024-03-24T10:36:31.240564+0000","last_peered":"2024-03-24T10:36:31.240564+0000","last_clean":"2024-03-24T10:36:31.240564+0000","last_became_active":"2024-03-24T10:36:26.240263+0000","last_became_peered":"2024-03-24T10:36:26.240263+0000","last_unstale":"2024-03-24T10:36:31.240564+0000","last_undegraded":"2024-03-24T10:36:31.240564+0000","last_fullsized":"2024-03-24T10:36:31.240564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239339+0000","last_change":"2024-03-24T10:36:26.233360+0000","last_active":"2024-03-24T10:36:31.239339+0000","last_peered":"2024-03-24T10:36:31.239339+0000","last_clean":"2024-03-24T10:36:31.239339+0000","last_became_active":"2024-03-24T10:36:26.232820+0000","last_became_peered":"2024-03-24T10:36:26.232820+0000","last_unstale":"2024-03-24T10:36:31.239339+0000","last_undegraded":"2024-03-24T10:36:31.239339+0000","last_fullsized":"2024-03-24T10:36:31.239339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978230+0000","last_change":"2024-03-24T10:36:26.229654+0000","last_active":"2024-03-24T10:36:31.978230+0000","last_peered":"2024-03-24T10:36:31.978230+0000","last_clean":"2024-03-24T10:36:31.978230+0000","last_became_active":"2024-03-24T10:36:26.229360+0000","last_became_peered":"2024-03-24T10:36:26.229360+0000","last_unstale":"2024-03-24T10:36:31.978230+0000","last_undegraded":"2024-03-24T10:36:31.978230+0000","last_fullsized":"2024-03-24T10:36:31.978230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978201+0000","last_change":"2024-03-24T10:36:26.232307+0000","last_active":"2024-03-24T10:36:31.978201+0000","last_peered":"2024-03-24T10:36:31.978201+0000","last_clean":"2024-03-24T10:36:31.978201+0000","last_became_active":"2024-03-24T10:36:26.232003+0000","last_became_peered":"2024-03-24T10:36:26.232003+0000","last_unstale":"2024-03-24T10:36:31.978201+0000","last_undegraded":"2024-03-24T10:36:31.978201+0000","last_fullsized":"2024-03-24T10:36:31.978201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240018+0000","last_change":"2024-03-24T10:36:26.227231+0000","last_active":"2024-03-24T10:36:31.240018+0000","last_peered":"2024-03-24T10:36:31.240018+0000","last_clean":"2024-03-24T10:36:31.240018+0000","last_became_active":"2024-03-24T10:36:26.225847+0000","last_became_peered":"2024-03-24T10:36:26.225847+0000","last_unstale":"2024-03-24T10:36:31.240018+0000","last_undegraded":"2024-03-24T10:36:31.240018+0000","last_fullsized":"2024-03-24T10:36:31.240018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240927+0000","last_change":"2024-03-24T10:36:26.232739+0000","last_active":"2024-03-24T10:36:31.240927+0000","last_peered":"2024-03-24T10:36:31.240927+0000","last_clean":"2024-03-24T10:36:31.240927+0000","last_became_active":"2024-03-24T10:36:26.231159+0000","last_became_peered":"2024-03-24T10:36:26.231159+0000","last_unstale":"2024-03-24T10:36:31.240927+0000","last_undegraded":"2024-03-24T10:36:31.240927+0000","last_fullsized":"2024-03-24T10:36:31.240927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977892+0000","last_change":"2024-03-24T10:36:26.244230+0000","last_active":"2024-03-24T10:36:31.977892+0000","last_peered":"2024-03-24T10:36:31.977892+0000","last_clean":"2024-03-24T10:36:31.977892+0000","last_became_active":"2024-03-24T10:36:26.243918+0000","last_became_peered":"2024-03-24T10:36:26.243918+0000","last_unstale":"2024-03-24T10:36:31.977892+0000","last_undegraded":"2024-03-24T10:36:31.977892+0000","last_fullsized":"2024-03-24T10:36:31.977892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978041+0000","last_change":"2024-03-24T10:36:26.244721+0000","last_active":"2024-03-24T10:36:31.978041+0000","last_peered":"2024-03-24T10:36:31.978041+0000","last_clean":"2024-03-24T10:36:31.978041+0000","last_became_active":"2024-03-24T10:36:26.244427+0000","last_became_peered":"2024-03-24T10:36:26.244427+0000","last_unstale":"2024-03-24T10:36:31.978041+0000","last_undegraded":"2024-03-24T10:36:31.978041+0000","last_fullsized":"2024-03-24T10:36:31.978041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978616+0000","last_change":"2024-03-24T10:36:26.242508+0000","last_active":"2024-03-24T10:36:31.978616+0000","last_peered":"2024-03-24T10:36:31.978616+0000","last_clean":"2024-03-24T10:36:31.978616+0000","last_became_active":"2024-03-24T10:36:26.242179+0000","last_became_peered":"2024-03-24T10:36:26.242179+0000","last_unstale":"2024-03-24T10:36:31.978616+0000","last_undegraded":"2024-03-24T10:36:31.978616+0000","last_fullsized":"2024-03-24T10:36:31.978616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:38.572103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239819+0000","last_change":"2024-03-24T10:36:26.235232+0000","last_active":"2024-03-24T10:36:31.239819+0000","last_peered":"2024-03-24T10:36:31.239819+0000","last_clean":"2024-03-24T10:36:31.239819+0000","last_became_active":"2024-03-24T10:36:26.234954+0000","last_became_peered":"2024-03-24T10:36:26.234954+0000","last_unstale":"2024-03-24T10:36:31.239819+0000","last_undegraded":"2024-03-24T10:36:31.239819+0000","last_fullsized":"2024-03-24T10:36:31.239819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978320+0000","last_change":"2024-03-24T10:36:26.235229+0000","last_active":"2024-03-24T10:36:31.978320+0000","last_peered":"2024-03-24T10:36:31.978320+0000","last_clean":"2024-03-24T10:36:31.978320+0000","last_became_active":"2024-03-24T10:36:26.234686+0000","last_became_peered":"2024-03-24T10:36:26.234686+0000","last_unstale":"2024-03-24T10:36:31.978320+0000","last_undegraded":"2024-03-24T10:36:31.978320+0000","last_fullsized":"2024-03-24T10:36:31.978320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240402+0000","last_change":"2024-03-24T10:36:26.242391+0000","last_active":"2024-03-24T10:36:31.240402+0000","last_peered":"2024-03-24T10:36:31.240402+0000","last_clean":"2024-03-24T10:36:31.240402+0000","last_became_active":"2024-03-24T10:36:26.241891+0000","last_became_peered":"2024-03-24T10:36:26.241891+0000","last_unstale":"2024-03-24T10:36:31.240402+0000","last_undegraded":"2024-03-24T10:36:31.240402+0000","last_fullsized":"2024-03-24T10:36:31.240402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978072+0000","last_change":"2024-03-24T10:36:26.224899+0000","last_active":"2024-03-24T10:36:31.978072+0000","last_peered":"2024-03-24T10:36:31.978072+0000","last_clean":"2024-03-24T10:36:31.978072+0000","last_became_active":"2024-03-24T10:36:26.224612+0000","last_became_peered":"2024-03-24T10:36:26.224612+0000","last_unstale":"2024-03-24T10:36:31.978072+0000","last_undegraded":"2024-03-24T10:36:31.978072+0000","last_fullsized":"2024-03-24T10:36:31.978072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240698+0000","last_change":"2024-03-24T10:36:26.241713+0000","last_active":"2024-03-24T10:36:31.240698+0000","last_peered":"2024-03-24T10:36:31.240698+0000","last_clean":"2024-03-24T10:36:31.240698+0000","last_became_active":"2024-03-24T10:36:26.241441+0000","last_became_peered":"2024-03-24T10:36:26.241441+0000","last_unstale":"2024-03-24T10:36:31.240698+0000","last_undegraded":"2024-03-24T10:36:31.240698+0000","last_fullsized":"2024-03-24T10:36:31.240698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978166+0000","last_change":"2024-03-24T10:36:26.229024+0000","last_active":"2024-03-24T10:36:31.978166+0000","last_peered":"2024-03-24T10:36:31.978166+0000","last_clean":"2024-03-24T10:36:31.978166+0000","last_became_active":"2024-03-24T10:36:26.228715+0000","last_became_peered":"2024-03-24T10:36:26.228715+0000","last_unstale":"2024-03-24T10:36:31.978166+0000","last_undegraded":"2024-03-24T10:36:31.978166+0000","last_fullsized":"2024-03-24T10:36:31.978166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979045+0000","last_change":"2024-03-24T10:36:26.226685+0000","last_active":"2024-03-24T10:36:31.979045+0000","last_peered":"2024-03-24T10:36:31.979045+0000","last_clean":"2024-03-24T10:36:31.979045+0000","last_became_active":"2024-03-24T10:36:26.226405+0000","last_became_peered":"2024-03-24T10:36:26.226405+0000","last_unstale":"2024-03-24T10:36:31.979045+0000","last_undegraded":"2024-03-24T10:36:31.979045+0000","last_fullsized":"2024-03-24T10:36:31.979045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978516+0000","last_change":"2024-03-24T10:36:26.234917+0000","last_active":"2024-03-24T10:36:31.978516+0000","last_peered":"2024-03-24T10:36:31.978516+0000","last_clean":"2024-03-24T10:36:31.978516+0000","last_became_active":"2024-03-24T10:36:26.234583+0000","last_became_peered":"2024-03-24T10:36:26.234583+0000","last_unstale":"2024-03-24T10:36:31.978516+0000","last_undegraded":"2024-03-24T10:36:31.978516+0000","last_fullsized":"2024-03-24T10:36:31.978516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:36:49.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:36:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.388+0000 7fbcf7ad0640 1 Processor -- start 2024-03-24T10:36:49.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.388+0000 7fbcf7ad0640 1 -- start start 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf7ad0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbcf0152b80 0x7fbcf015c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf7ad0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcf0072fc0 0x7fbcf0165e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf7ad0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcf01533f0 con 0x7fbcf0152f60 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf7ad0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf015f8b0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf7ad0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbcf015d3d0 con 0x7fbcf0152b80 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf606d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbcf0072fc0 0x7fbcf0165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf506b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbcf0152f60 0x7fbcf00728b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49828/0 (socket says 172.21.15.72:49828) 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf506b640 1 -- 172.21.15.72:0/1220729133 learned_addr learned my addr 172.21.15.72:0/1220729133 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf586c640 1 --2- 172.21.15.72:0/1220729133 >> v2:172.21.15.79:3300/0 conn(0x7fbcf0152b80 0x7fbcf015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf606d640 1 -- 172.21.15.72:0/1220729133 >> v2:172.21.15.79:3300/0 conn(0x7fbcf0152b80 msgr2=0x7fbcf015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf606d640 1 --2- 172.21.15.72:0/1220729133 >> v2:172.21.15.79:3300/0 conn(0x7fbcf0152b80 0x7fbcf015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf606d640 1 -- 172.21.15.72:0/1220729133 >> v1:172.21.15.72:6789/0 conn(0x7fbcf0152f60 legacy=0x7fbcf00728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf606d640 1 -- 172.21.15.72:0/1220729133 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf00af8a0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf586c640 1 --2- 172.21.15.72:0/1220729133 >> v2:172.21.15.79:3300/0 conn(0x7fbcf0152b80 0x7fbcf015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.389+0000 7fbcf486a640 1 -- 172.21.15.72:0/1220729133 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040554779 0 0) 0x7fbcf01533f0 con 0x7fbcf0152f60 2024-03-24T10:36:49.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf606d640 1 --2- 172.21.15.72:0/1220729133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf0165e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00b2b50 tx=0x7fbce802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9338147c40dafea server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf486a640 1 -- 172.21.15.72:0/1220729133 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce802cbf0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf486a640 1 -- 172.21.15.72:0/1220729133 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbce802cd50 con 0x7fbcf0072fc0 2024-03-24T10:36:49.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf486a640 1 -- 172.21.15.72:0/1220729133 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8034660 con 0x7fbcf0072fc0 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/1220729133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 msgr2=0x7fbcf0165e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/1220729133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf0165e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00b2b50 tx=0x7fbce802be40 comp rx=0 tx=0).stop 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/1220729133 shutdown_connections 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/1220729133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf0165e10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/1220729133 >> v2:172.21.15.79:3300/0 conn(0x7fbcf0152b80 0x7fbcf015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.390+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/1220729133 >> 172.21.15.72:0/1220729133 conn(0x7fbcf00b1b70 msgr2=0x7fbcf00b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.391+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/1220729133 shutdown_connections 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.391+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/1220729133 wait complete. 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 Processor -- start 2024-03-24T10:36:49.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 -- start start 2024-03-24T10:36:49.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbcf0152b80 0x7fbcf01f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcf0152f60 0x7fbcf01f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00ca850 con 0x7fbcf0072fc0 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf00cab30 con 0x7fbcf0152f60 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf7ad0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbcf00cae10 con 0x7fbcf0152b80 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.392+0000 7fbcf586c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf00ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33256/0 (socket says 172.21.15.72:33256) 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 -- 172.21.15.72:0/2785877598 learned_addr learned my addr 172.21.15.72:0/2785877598 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf606d640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcf0152f60 0x7fbcf01f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf506b640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbcf0152b80 0x7fbcf01f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 -- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbcf0152b80 msgr2=0x7fbcf01f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbcf0152b80 0x7fbcf01f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 -- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcf0152f60 msgr2=0x7fbcf01f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcf0152f60 0x7fbcf01f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 -- 172.21.15.72:0/2785877598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcec009400 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf586c640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf00ccbd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00ebe0 tx=0x7fbcec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec009760 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcec00cc30 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce8009a70 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00eee0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.393+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf00cb3d0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.394+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcf009e1d0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.395+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbcec013470 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.395+0000 7fbce67fc640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbcd406b810 0x7fbcd406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.395+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbcec08a740 con 0x7fbcf0072fc0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.395+0000 7fbcf506b640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbcd406b810 0x7fbcd406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.395+0000 7fbcf506b640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbcd406b810 0x7fbcd406dcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbcf015f770 tx=0x7fbce0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.399+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbcec054ed0 con 0x7fbcf0072fc0 2024-03-24T10:36:49.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.567+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbcf00b1f50 con 0x7fbcd406b810 2024-03-24T10:36:49.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.574+0000 7fbce67fc640 1 -- 172.21.15.72:0/2785877598 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fbcf00b1f50 con 0x7fbcd406b810 2024-03-24T10:36:49.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:49.580 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:36:49.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbcd406b810 msgr2=0x7fbcd406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbcd406b810 0x7fbcd406dcd0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbcf015f770 tx=0x7fbce0007de0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 msgr2=0x7fbcf00ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf00ccbd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00ebe0 tx=0x7fbcec00c520 comp rx=0 tx=0).stop 2024-03-24T10:36:49.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 shutdown_connections 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbcd406b810 0x7fbcd406dcd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcf0152f60 0x7fbcf01f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbcf0152b80 0x7fbcf01f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 --2- 172.21.15.72:0/2785877598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbcf0072fc0 0x7fbcf00ccbd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 >> 172.21.15.72:0/2785877598 conn(0x7fbcf00b1b70 msgr2=0x7fbcf00acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.577+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 shutdown_connections 2024-03-24T10:36:49.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.578+0000 7fbcf7ad0640 1 -- 172.21.15.72:0/2785877598 wait complete. 2024-03-24T10:36:49.589 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-03-24T10:36:48.143785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003000"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978256+0000","last_change":"2024-03-24T10:36:25.218550+0000","last_active":"2024-03-24T10:36:31.978256+0000","last_peered":"2024-03-24T10:36:31.978256+0000","last_clean":"2024-03-24T10:36:31.978256+0000","last_became_active":"2024-03-24T10:36:25.218268+0000","last_became_peered":"2024-03-24T10:36:25.218268+0000","last_unstale":"2024-03-24T10:36:31.978256+0000","last_undegraded":"2024-03-24T10:36:31.978256+0000","last_fullsized":"2024-03-24T10:36:31.978256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:50:40.435818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240464+0000","last_change":"2024-03-24T10:36:26.226821+0000","last_active":"2024-03-24T10:36:31.240464+0000","last_peered":"2024-03-24T10:36:31.240464+0000","last_clean":"2024-03-24T10:36:31.240464+0000","last_became_active":"2024-03-24T10:36:26.226545+0000","last_became_peered":"2024-03-24T10:36:26.226545+0000","last_unstale":"2024-03-24T10:36:31.240464+0000","last_undegraded":"2024-03-24T10:36:31.240464+0000","last_fullsized":"2024-03-24T10:36:31.240464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239815+0000","last_change":"2024-03-24T10:36:30.290828+0000","last_active":"2024-03-24T10:36:31.239815+0000","last_peered":"2024-03-24T10:36:31.239815+0000","last_clean":"2024-03-24T10:36:31.239815+0000","last_became_active":"2024-03-24T10:36:30.290163+0000","last_became_peered":"2024-03-24T10:36:30.290163+0000","last_unstale":"2024-03-24T10:36:31.239815+0000","last_undegraded":"2024-03-24T10:36:31.239815+0000","last_fullsized":"2024-03-24T10:36:31.239815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240623+0000","last_change":"2024-03-24T10:36:25.212258+0000","last_active":"2024-03-24T10:36:31.240623+0000","last_peered":"2024-03-24T10:36:31.240623+0000","last_clean":"2024-03-24T10:36:31.240623+0000","last_became_active":"2024-03-24T10:36:25.211985+0000","last_became_peered":"2024-03-24T10:36:25.211985+0000","last_unstale":"2024-03-24T10:36:31.240623+0000","last_undegraded":"2024-03-24T10:36:31.240623+0000","last_fullsized":"2024-03-24T10:36:31.240623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977983+0000","last_change":"2024-03-24T10:36:26.245457+0000","last_active":"2024-03-24T10:36:31.977983+0000","last_peered":"2024-03-24T10:36:31.977983+0000","last_clean":"2024-03-24T10:36:31.977983+0000","last_became_active":"2024-03-24T10:36:26.245157+0000","last_became_peered":"2024-03-24T10:36:26.245157+0000","last_unstale":"2024-03-24T10:36:31.977983+0000","last_undegraded":"2024-03-24T10:36:31.977983+0000","last_fullsized":"2024-03-24T10:36:31.977983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239707+0000","last_change":"2024-03-24T10:36:30.258067+0000","last_active":"2024-03-24T10:36:31.239707+0000","last_peered":"2024-03-24T10:36:31.239707+0000","last_clean":"2024-03-24T10:36:31.239707+0000","last_became_active":"2024-03-24T10:36:30.257502+0000","last_became_peered":"2024-03-24T10:36:30.257502+0000","last_unstale":"2024-03-24T10:36:31.239707+0000","last_undegraded":"2024-03-24T10:36:31.239707+0000","last_fullsized":"2024-03-24T10:36:31.239707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:22.635599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978573+0000","last_change":"2024-03-24T10:36:25.222492+0000","last_active":"2024-03-24T10:36:31.978573+0000","last_peered":"2024-03-24T10:36:31.978573+0000","last_clean":"2024-03-24T10:36:31.978573+0000","last_became_active":"2024-03-24T10:36:25.222187+0000","last_became_peered":"2024-03-24T10:36:25.222187+0000","last_unstale":"2024-03-24T10:36:31.978573+0000","last_undegraded":"2024-03-24T10:36:31.978573+0000","last_fullsized":"2024-03-24T10:36:31.978573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:02.259009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240704+0000","last_change":"2024-03-24T10:36:26.241575+0000","last_active":"2024-03-24T10:36:31.240704+0000","last_peered":"2024-03-24T10:36:31.240704+0000","last_clean":"2024-03-24T10:36:31.240704+0000","last_became_active":"2024-03-24T10:36:26.240567+0000","last_became_peered":"2024-03-24T10:36:26.240567+0000","last_unstale":"2024-03-24T10:36:31.240704+0000","last_undegraded":"2024-03-24T10:36:31.240704+0000","last_fullsized":"2024-03-24T10:36:31.240704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240064+0000","last_change":"2024-03-24T10:36:30.255999+0000","last_active":"2024-03-24T10:36:31.240064+0000","last_peered":"2024-03-24T10:36:31.240064+0000","last_clean":"2024-03-24T10:36:31.240064+0000","last_became_active":"2024-03-24T10:36:30.255602+0000","last_became_peered":"2024-03-24T10:36:30.255602+0000","last_unstale":"2024-03-24T10:36:31.240064+0000","last_undegraded":"2024-03-24T10:36:31.240064+0000","last_fullsized":"2024-03-24T10:36:31.240064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978234+0000","last_change":"2024-03-24T10:36:25.221818+0000","last_active":"2024-03-24T10:36:31.978234+0000","last_peered":"2024-03-24T10:36:31.978234+0000","last_clean":"2024-03-24T10:36:31.978234+0000","last_became_active":"2024-03-24T10:36:25.221527+0000","last_became_peered":"2024-03-24T10:36:25.221527+0000","last_unstale":"2024-03-24T10:36:31.978234+0000","last_undegraded":"2024-03-24T10:36:31.978234+0000","last_fullsized":"2024-03-24T10:36:31.978234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240821+0000","last_change":"2024-03-24T10:36:26.232930+0000","last_active":"2024-03-24T10:36:31.240821+0000","last_peered":"2024-03-24T10:36:31.240821+0000","last_clean":"2024-03-24T10:36:31.240821+0000","last_became_active":"2024-03-24T10:36:26.232665+0000","last_became_peered":"2024-03-24T10:36:26.232665+0000","last_unstale":"2024-03-24T10:36:31.240821+0000","last_undegraded":"2024-03-24T10:36:31.240821+0000","last_fullsized":"2024-03-24T10:36:31.240821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239844+0000","last_change":"2024-03-24T10:36:30.251201+0000","last_active":"2024-03-24T10:36:31.239844+0000","last_peered":"2024-03-24T10:36:31.239844+0000","last_clean":"2024-03-24T10:36:31.239844+0000","last_became_active":"2024-03-24T10:36:30.250845+0000","last_became_peered":"2024-03-24T10:36:30.250845+0000","last_unstale":"2024-03-24T10:36:31.239844+0000","last_undegraded":"2024-03-24T10:36:31.239844+0000","last_fullsized":"2024-03-24T10:36:31.239844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:15.088511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977560+0000","last_change":"2024-03-24T10:36:26.233671+0000","last_active":"2024-03-24T10:36:31.977560+0000","last_peered":"2024-03-24T10:36:31.977560+0000","last_clean":"2024-03-24T10:36:31.977560+0000","last_became_active":"2024-03-24T10:36:26.233382+0000","last_became_peered":"2024-03-24T10:36:26.233382+0000","last_unstale":"2024-03-24T10:36:31.977560+0000","last_undegraded":"2024-03-24T10:36:31.977560+0000","last_fullsized":"2024-03-24T10:36:31.977560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978239+0000","last_change":"2024-03-24T10:36:25.221318+0000","last_active":"2024-03-24T10:36:31.978239+0000","last_peered":"2024-03-24T10:36:31.978239+0000","last_clean":"2024-03-24T10:36:31.978239+0000","last_became_active":"2024-03-24T10:36:25.220530+0000","last_became_peered":"2024-03-24T10:36:25.220530+0000","last_unstale":"2024-03-24T10:36:31.978239+0000","last_undegraded":"2024-03-24T10:36:31.978239+0000","last_fullsized":"2024-03-24T10:36:31.978239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240532+0000","last_change":"2024-03-24T10:36:30.257835+0000","last_active":"2024-03-24T10:36:31.240532+0000","last_peered":"2024-03-24T10:36:31.240532+0000","last_clean":"2024-03-24T10:36:31.240532+0000","last_became_active":"2024-03-24T10:36:30.257484+0000","last_became_peered":"2024-03-24T10:36:30.257484+0000","last_unstale":"2024-03-24T10:36:31.240532+0000","last_undegraded":"2024-03-24T10:36:31.240532+0000","last_fullsized":"2024-03-24T10:36:31.240532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240057+0000","last_change":"2024-03-24T10:36:26.228855+0000","last_active":"2024-03-24T10:36:31.240057+0000","last_peered":"2024-03-24T10:36:31.240057+0000","last_clean":"2024-03-24T10:36:31.240057+0000","last_became_active":"2024-03-24T10:36:26.228590+0000","last_became_peered":"2024-03-24T10:36:26.228590+0000","last_unstale":"2024-03-24T10:36:31.240057+0000","last_undegraded":"2024-03-24T10:36:31.240057+0000","last_fullsized":"2024-03-24T10:36:31.240057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978913+0000","last_change":"2024-03-24T10:36:25.217987+0000","last_active":"2024-03-24T10:36:31.978913+0000","last_peered":"2024-03-24T10:36:31.978913+0000","last_clean":"2024-03-24T10:36:31.978913+0000","last_became_active":"2024-03-24T10:36:25.217693+0000","last_became_peered":"2024-03-24T10:36:25.217693+0000","last_unstale":"2024-03-24T10:36:31.978913+0000","last_undegraded":"2024-03-24T10:36:31.978913+0000","last_fullsized":"2024-03-24T10:36:31.978913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240063+0000","last_change":"2024-03-24T10:36:30.255718+0000","last_active":"2024-03-24T10:36:31.240063+0000","last_peered":"2024-03-24T10:36:31.240063+0000","last_clean":"2024-03-24T10:36:31.240063+0000","last_became_active":"2024-03-24T10:36:30.255368+0000","last_became_peered":"2024-03-24T10:36:30.255368+0000","last_unstale":"2024-03-24T10:36:31.240063+0000","last_undegraded":"2024-03-24T10:36:31.240063+0000","last_fullsized":"2024-03-24T10:36:31.240063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240629+0000","last_change":"2024-03-24T10:36:26.219340+0000","last_active":"2024-03-24T10:36:31.240629+0000","last_peered":"2024-03-24T10:36:31.240629+0000","last_clean":"2024-03-24T10:36:31.240629+0000","last_became_active":"2024-03-24T10:36:26.219047+0000","last_became_peered":"2024-03-24T10:36:26.219047+0000","last_unstale":"2024-03-24T10:36:31.240629+0000","last_undegraded":"2024-03-24T10:36:31.240629+0000","last_fullsized":"2024-03-24T10:36:31.240629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978316+0000","last_change":"2024-03-24T10:36:25.218156+0000","last_active":"2024-03-24T10:36:31.978316+0000","last_peered":"2024-03-24T10:36:31.978316+0000","last_clean":"2024-03-24T10:36:31.978316+0000","last_became_active":"2024-03-24T10:36:25.217886+0000","last_became_peered":"2024-03-24T10:36:25.217886+0000","last_unstale":"2024-03-24T10:36:31.978316+0000","last_undegraded":"2024-03-24T10:36:31.978316+0000","last_fullsized":"2024-03-24T10:36:31.978316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979111+0000","last_change":"2024-03-24T10:36:30.289797+0000","last_active":"2024-03-24T10:36:31.979111+0000","last_peered":"2024-03-24T10:36:31.979111+0000","last_clean":"2024-03-24T10:36:31.979111+0000","last_became_active":"2024-03-24T10:36:30.288673+0000","last_became_peered":"2024-03-24T10:36:30.288673+0000","last_unstale":"2024-03-24T10:36:31.979111+0000","last_undegraded":"2024-03-24T10:36:31.979111+0000","last_fullsized":"2024-03-24T10:36:31.979111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240174+0000","last_change":"2024-03-24T10:36:26.216354+0000","last_active":"2024-03-24T10:36:31.240174+0000","last_peered":"2024-03-24T10:36:31.240174+0000","last_clean":"2024-03-24T10:36:31.240174+0000","last_became_active":"2024-03-24T10:36:26.215438+0000","last_became_peered":"2024-03-24T10:36:26.215438+0000","last_unstale":"2024-03-24T10:36:31.240174+0000","last_undegraded":"2024-03-24T10:36:31.240174+0000","last_fullsized":"2024-03-24T10:36:31.240174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:47:16.583659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:25.219905+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:25.219621+0000","last_became_peered":"2024-03-24T10:36:25.219621+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240448+0000","last_change":"2024-03-24T10:36:30.258214+0000","last_active":"2024-03-24T10:36:31.240448+0000","last_peered":"2024-03-24T10:36:31.240448+0000","last_clean":"2024-03-24T10:36:31.240448+0000","last_became_active":"2024-03-24T10:36:30.257701+0000","last_became_peered":"2024-03-24T10:36:30.257701+0000","last_unstale":"2024-03-24T10:36:31.240448+0000","last_undegraded":"2024-03-24T10:36:31.240448+0000","last_fullsized":"2024-03-24T10:36:31.240448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978555+0000","last_change":"2024-03-24T10:36:26.228673+0000","last_active":"2024-03-24T10:36:31.978555+0000","last_peered":"2024-03-24T10:36:31.978555+0000","last_clean":"2024-03-24T10:36:31.978555+0000","last_became_active":"2024-03-24T10:36:26.228223+0000","last_became_peered":"2024-03-24T10:36:26.228223+0000","last_unstale":"2024-03-24T10:36:31.978555+0000","last_undegraded":"2024-03-24T10:36:31.978555+0000","last_fullsized":"2024-03-24T10:36:31.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978776+0000","last_change":"2024-03-24T10:36:25.218606+0000","last_active":"2024-03-24T10:36:31.978776+0000","last_peered":"2024-03-24T10:36:31.978776+0000","last_clean":"2024-03-24T10:36:31.978776+0000","last_became_active":"2024-03-24T10:36:25.218305+0000","last_became_peered":"2024-03-24T10:36:25.218305+0000","last_unstale":"2024-03-24T10:36:31.978776+0000","last_undegraded":"2024-03-24T10:36:31.978776+0000","last_fullsized":"2024-03-24T10:36:31.978776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239964+0000","last_change":"2024-03-24T10:36:30.291483+0000","last_active":"2024-03-24T10:36:31.239964+0000","last_peered":"2024-03-24T10:36:31.239964+0000","last_clean":"2024-03-24T10:36:31.239964+0000","last_became_active":"2024-03-24T10:36:30.291163+0000","last_became_peered":"2024-03-24T10:36:30.291163+0000","last_unstale":"2024-03-24T10:36:31.239964+0000","last_undegraded":"2024-03-24T10:36:31.239964+0000","last_fullsized":"2024-03-24T10:36:31.239964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240422+0000","last_change":"2024-03-24T10:36:26.234337+0000","last_active":"2024-03-24T10:36:31.240422+0000","last_peered":"2024-03-24T10:36:31.240422+0000","last_clean":"2024-03-24T10:36:31.240422+0000","last_became_active":"2024-03-24T10:36:26.234055+0000","last_became_peered":"2024-03-24T10:36:26.234055+0000","last_unstale":"2024-03-24T10:36:31.240422+0000","last_undegraded":"2024-03-24T10:36:31.240422+0000","last_fullsized":"2024-03-24T10:36:31.240422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979094+0000","last_change":"2024-03-24T10:36:25.216567+0000","last_active":"2024-03-24T10:36:31.979094+0000","last_peered":"2024-03-24T10:36:31.979094+0000","last_clean":"2024-03-24T10:36:31.979094+0000","last_became_active":"2024-03-24T10:36:25.216217+0000","last_became_peered":"2024-03-24T10:36:25.216217+0000","last_unstale":"2024-03-24T10:36:31.979094+0000","last_undegraded":"2024-03-24T10:36:31.979094+0000","last_fullsized":"2024-03-24T10:36:31.979094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239785+0000","last_change":"2024-03-24T10:36:30.292210+0000","last_active":"2024-03-24T10:36:31.239785+0000","last_peered":"2024-03-24T10:36:31.239785+0000","last_clean":"2024-03-24T10:36:31.239785+0000","last_became_active":"2024-03-24T10:36:30.291693+0000","last_became_peered":"2024-03-24T10:36:30.291693+0000","last_unstale":"2024-03-24T10:36:31.239785+0000","last_undegraded":"2024-03-24T10:36:31.239785+0000","last_fullsized":"2024-03-24T10:36:31.239785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978627+0000","last_change":"2024-03-24T10:36:26.216940+0000","last_active":"2024-03-24T10:36:31.978627+0000","last_peered":"2024-03-24T10:36:31.978627+0000","last_clean":"2024-03-24T10:36:31.978627+0000","last_became_active":"2024-03-24T10:36:26.216516+0000","last_became_peered":"2024-03-24T10:36:26.216516+0000","last_unstale":"2024-03-24T10:36:31.978627+0000","last_undegraded":"2024-03-24T10:36:31.978627+0000","last_fullsized":"2024-03-24T10:36:31.978627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978689+0000","last_change":"2024-03-24T10:36:25.220871+0000","last_active":"2024-03-24T10:36:31.978689+0000","last_peered":"2024-03-24T10:36:31.978689+0000","last_clean":"2024-03-24T10:36:31.978689+0000","last_became_active":"2024-03-24T10:36:25.220566+0000","last_became_peered":"2024-03-24T10:36:25.220566+0000","last_unstale":"2024-03-24T10:36:31.978689+0000","last_undegraded":"2024-03-24T10:36:31.978689+0000","last_fullsized":"2024-03-24T10:36:31.978689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:11.467800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978512+0000","last_change":"2024-03-24T10:36:30.287965+0000","last_active":"2024-03-24T10:36:31.978512+0000","last_peered":"2024-03-24T10:36:31.978512+0000","last_clean":"2024-03-24T10:36:31.978512+0000","last_became_active":"2024-03-24T10:36:30.287151+0000","last_became_peered":"2024-03-24T10:36:30.287151+0000","last_unstale":"2024-03-24T10:36:31.978512+0000","last_undegraded":"2024-03-24T10:36:31.978512+0000","last_fullsized":"2024-03-24T10:36:31.978512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:42.603073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240890+0000","last_change":"2024-03-24T10:36:26.228488+0000","last_active":"2024-03-24T10:36:31.240890+0000","last_peered":"2024-03-24T10:36:31.240890+0000","last_clean":"2024-03-24T10:36:31.240890+0000","last_became_active":"2024-03-24T10:36:26.228001+0000","last_became_peered":"2024-03-24T10:36:26.228001+0000","last_unstale":"2024-03-24T10:36:31.240890+0000","last_undegraded":"2024-03-24T10:36:31.240890+0000","last_fullsized":"2024-03-24T10:36:31.240890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978655+0000","last_change":"2024-03-24T10:36:25.213196+0000","last_active":"2024-03-24T10:36:31.978655+0000","last_peered":"2024-03-24T10:36:31.978655+0000","last_clean":"2024-03-24T10:36:31.978655+0000","last_became_active":"2024-03-24T10:36:25.212908+0000","last_became_peered":"2024-03-24T10:36:25.212908+0000","last_unstale":"2024-03-24T10:36:31.978655+0000","last_undegraded":"2024-03-24T10:36:31.978655+0000","last_fullsized":"2024-03-24T10:36:31.978655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977909+0000","last_change":"2024-03-24T10:36:30.257971+0000","last_active":"2024-03-24T10:36:31.977909+0000","last_peered":"2024-03-24T10:36:31.977909+0000","last_clean":"2024-03-24T10:36:31.977909+0000","last_became_active":"2024-03-24T10:36:30.257595+0000","last_became_peered":"2024-03-24T10:36:30.257595+0000","last_unstale":"2024-03-24T10:36:31.977909+0000","last_undegraded":"2024-03-24T10:36:31.977909+0000","last_fullsized":"2024-03-24T10:36:31.977909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240167+0000","last_change":"2024-03-24T10:36:26.230507+0000","last_active":"2024-03-24T10:36:31.240167+0000","last_peered":"2024-03-24T10:36:31.240167+0000","last_clean":"2024-03-24T10:36:31.240167+0000","last_became_active":"2024-03-24T10:36:26.230065+0000","last_became_peered":"2024-03-24T10:36:26.230065+0000","last_unstale":"2024-03-24T10:36:31.240167+0000","last_undegraded":"2024-03-24T10:36:31.240167+0000","last_fullsized":"2024-03-24T10:36:31.240167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240522+0000","last_change":"2024-03-24T10:36:25.215977+0000","last_active":"2024-03-24T10:36:31.240522+0000","last_peered":"2024-03-24T10:36:31.240522+0000","last_clean":"2024-03-24T10:36:31.240522+0000","last_became_active":"2024-03-24T10:36:25.215688+0000","last_became_peered":"2024-03-24T10:36:25.215688+0000","last_unstale":"2024-03-24T10:36:31.240522+0000","last_undegraded":"2024-03-24T10:36:31.240522+0000","last_fullsized":"2024-03-24T10:36:31.240522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978606+0000","last_change":"2024-03-24T10:36:30.255099+0000","last_active":"2024-03-24T10:36:31.978606+0000","last_peered":"2024-03-24T10:36:31.978606+0000","last_clean":"2024-03-24T10:36:31.978606+0000","last_became_active":"2024-03-24T10:36:30.254701+0000","last_became_peered":"2024-03-24T10:36:30.254701+0000","last_unstale":"2024-03-24T10:36:31.978606+0000","last_undegraded":"2024-03-24T10:36:31.978606+0000","last_fullsized":"2024-03-24T10:36:31.978606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977951+0000","last_change":"2024-03-24T10:36:26.218799+0000","last_active":"2024-03-24T10:36:31.977951+0000","last_peered":"2024-03-24T10:36:31.977951+0000","last_clean":"2024-03-24T10:36:31.977951+0000","last_became_active":"2024-03-24T10:36:26.218417+0000","last_became_peered":"2024-03-24T10:36:26.218417+0000","last_unstale":"2024-03-24T10:36:31.977951+0000","last_undegraded":"2024-03-24T10:36:31.977951+0000","last_fullsized":"2024-03-24T10:36:31.977951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638115+0000","last_change":"2024-03-24T10:36:25.215346+0000","last_active":"2024-03-24T10:36:31.638115+0000","last_peered":"2024-03-24T10:36:31.638115+0000","last_clean":"2024-03-24T10:36:31.638115+0000","last_became_active":"2024-03-24T10:36:25.215072+0000","last_became_peered":"2024-03-24T10:36:25.215072+0000","last_unstale":"2024-03-24T10:36:31.638115+0000","last_undegraded":"2024-03-24T10:36:31.638115+0000","last_fullsized":"2024-03-24T10:36:31.638115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979217+0000","last_change":"2024-03-24T10:36:30.258147+0000","last_active":"2024-03-24T10:36:31.979217+0000","last_peered":"2024-03-24T10:36:31.979217+0000","last_clean":"2024-03-24T10:36:31.979217+0000","last_became_active":"2024-03-24T10:36:30.257704+0000","last_became_peered":"2024-03-24T10:36:30.257704+0000","last_unstale":"2024-03-24T10:36:31.979217+0000","last_undegraded":"2024-03-24T10:36:31.979217+0000","last_fullsized":"2024-03-24T10:36:31.979217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977926+0000","last_change":"2024-03-24T10:36:26.235288+0000","last_active":"2024-03-24T10:36:31.977926+0000","last_peered":"2024-03-24T10:36:31.977926+0000","last_clean":"2024-03-24T10:36:31.977926+0000","last_became_active":"2024-03-24T10:36:26.235008+0000","last_became_peered":"2024-03-24T10:36:26.235008+0000","last_unstale":"2024-03-24T10:36:31.977926+0000","last_undegraded":"2024-03-24T10:36:31.977926+0000","last_fullsized":"2024-03-24T10:36:31.977926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:56:34.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978361+0000","last_change":"2024-03-24T10:36:25.223252+0000","last_active":"2024-03-24T10:36:31.978361+0000","last_peered":"2024-03-24T10:36:31.978361+0000","last_clean":"2024-03-24T10:36:31.978361+0000","last_became_active":"2024-03-24T10:36:25.222927+0000","last_became_peered":"2024-03-24T10:36:25.222927+0000","last_unstale":"2024-03-24T10:36:31.978361+0000","last_undegraded":"2024-03-24T10:36:31.978361+0000","last_fullsized":"2024-03-24T10:36:31.978361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978487+0000","last_change":"2024-03-24T10:36:30.287525+0000","last_active":"2024-03-24T10:36:31.978487+0000","last_peered":"2024-03-24T10:36:31.978487+0000","last_clean":"2024-03-24T10:36:31.978487+0000","last_became_active":"2024-03-24T10:36:30.287145+0000","last_became_peered":"2024-03-24T10:36:30.287145+0000","last_unstale":"2024-03-24T10:36:31.978487+0000","last_undegraded":"2024-03-24T10:36:31.978487+0000","last_fullsized":"2024-03-24T10:36:31.978487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239931+0000","last_change":"2024-03-24T10:36:26.245809+0000","last_active":"2024-03-24T10:36:31.239931+0000","last_peered":"2024-03-24T10:36:31.239931+0000","last_clean":"2024-03-24T10:36:31.239931+0000","last_became_active":"2024-03-24T10:36:26.245498+0000","last_became_peered":"2024-03-24T10:36:26.245498+0000","last_unstale":"2024-03-24T10:36:31.239931+0000","last_undegraded":"2024-03-24T10:36:31.239931+0000","last_fullsized":"2024-03-24T10:36:31.239931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240567+0000","last_change":"2024-03-24T10:36:25.216299+0000","last_active":"2024-03-24T10:36:31.240567+0000","last_peered":"2024-03-24T10:36:31.240567+0000","last_clean":"2024-03-24T10:36:31.240567+0000","last_became_active":"2024-03-24T10:36:25.215751+0000","last_became_peered":"2024-03-24T10:36:25.215751+0000","last_unstale":"2024-03-24T10:36:31.240567+0000","last_undegraded":"2024-03-24T10:36:31.240567+0000","last_fullsized":"2024-03-24T10:36:31.240567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978454+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:36:31.978454+0000","last_peered":"2024-03-24T10:36:31.978454+0000","last_clean":"2024-03-24T10:36:31.978454+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:36:31.978454+0000","last_undegraded":"2024-03-24T10:36:31.978454+0000","last_fullsized":"2024-03-24T10:36:31.978454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977877+0000","last_change":"2024-03-24T10:36:30.288784+0000","last_active":"2024-03-24T10:36:31.977877+0000","last_peered":"2024-03-24T10:36:31.977877+0000","last_clean":"2024-03-24T10:36:31.977877+0000","last_became_active":"2024-03-24T10:36:30.288412+0000","last_became_peered":"2024-03-24T10:36:30.288412+0000","last_unstale":"2024-03-24T10:36:31.977877+0000","last_undegraded":"2024-03-24T10:36:31.977877+0000","last_fullsized":"2024-03-24T10:36:31.977877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978384+0000","last_change":"2024-03-24T10:36:26.245642+0000","last_active":"2024-03-24T10:36:31.978384+0000","last_peered":"2024-03-24T10:36:31.978384+0000","last_clean":"2024-03-24T10:36:31.978384+0000","last_became_active":"2024-03-24T10:36:26.245341+0000","last_became_peered":"2024-03-24T10:36:26.245341+0000","last_unstale":"2024-03-24T10:36:31.978384+0000","last_undegraded":"2024-03-24T10:36:31.978384+0000","last_fullsized":"2024-03-24T10:36:31.978384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638364+0000","last_change":"2024-03-24T10:36:25.220827+0000","last_active":"2024-03-24T10:36:31.638364+0000","last_peered":"2024-03-24T10:36:31.638364+0000","last_clean":"2024-03-24T10:36:31.638364+0000","last_became_active":"2024-03-24T10:36:25.220515+0000","last_became_peered":"2024-03-24T10:36:25.220515+0000","last_unstale":"2024-03-24T10:36:31.638364+0000","last_undegraded":"2024-03-24T10:36:31.638364+0000","last_fullsized":"2024-03-24T10:36:31.638364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977666+0000","last_change":"2024-03-24T10:36:30.288795+0000","last_active":"2024-03-24T10:36:31.977666+0000","last_peered":"2024-03-24T10:36:31.977666+0000","last_clean":"2024-03-24T10:36:31.977666+0000","last_became_active":"2024-03-24T10:36:30.288440+0000","last_became_peered":"2024-03-24T10:36:30.288440+0000","last_unstale":"2024-03-24T10:36:31.977666+0000","last_undegraded":"2024-03-24T10:36:31.977666+0000","last_fullsized":"2024-03-24T10:36:31.977666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240779+0000","last_change":"2024-03-24T10:36:26.228495+0000","last_active":"2024-03-24T10:36:31.240779+0000","last_peered":"2024-03-24T10:36:31.240779+0000","last_clean":"2024-03-24T10:36:31.240779+0000","last_became_active":"2024-03-24T10:36:26.227905+0000","last_became_peered":"2024-03-24T10:36:26.227905+0000","last_unstale":"2024-03-24T10:36:31.240779+0000","last_undegraded":"2024-03-24T10:36:31.240779+0000","last_fullsized":"2024-03-24T10:36:31.240779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978754+0000","last_change":"2024-03-24T10:36:25.217156+0000","last_active":"2024-03-24T10:36:31.978754+0000","last_peered":"2024-03-24T10:36:31.978754+0000","last_clean":"2024-03-24T10:36:31.978754+0000","last_became_active":"2024-03-24T10:36:25.216896+0000","last_became_peered":"2024-03-24T10:36:25.216896+0000","last_unstale":"2024-03-24T10:36:31.978754+0000","last_undegraded":"2024-03-24T10:36:31.978754+0000","last_fullsized":"2024-03-24T10:36:31.978754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978225+0000","last_change":"2024-03-24T10:36:30.260197+0000","last_active":"2024-03-24T10:36:31.978225+0000","last_peered":"2024-03-24T10:36:31.978225+0000","last_clean":"2024-03-24T10:36:31.978225+0000","last_became_active":"2024-03-24T10:36:30.259827+0000","last_became_peered":"2024-03-24T10:36:30.259827+0000","last_unstale":"2024-03-24T10:36:31.978225+0000","last_undegraded":"2024-03-24T10:36:31.978225+0000","last_fullsized":"2024-03-24T10:36:31.978225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978711+0000","last_change":"2024-03-24T10:36:26.236212+0000","last_active":"2024-03-24T10:36:31.978711+0000","last_peered":"2024-03-24T10:36:31.978711+0000","last_clean":"2024-03-24T10:36:31.978711+0000","last_became_active":"2024-03-24T10:36:26.235669+0000","last_became_peered":"2024-03-24T10:36:26.235669+0000","last_unstale":"2024-03-24T10:36:31.978711+0000","last_undegraded":"2024-03-24T10:36:31.978711+0000","last_fullsized":"2024-03-24T10:36:31.978711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:22.915113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638384+0000","last_change":"2024-03-24T10:36:25.219420+0000","last_active":"2024-03-24T10:36:31.638384+0000","last_peered":"2024-03-24T10:36:31.638384+0000","last_clean":"2024-03-24T10:36:31.638384+0000","last_became_active":"2024-03-24T10:36:25.218854+0000","last_became_peered":"2024-03-24T10:36:25.218854+0000","last_unstale":"2024-03-24T10:36:31.638384+0000","last_undegraded":"2024-03-24T10:36:31.638384+0000","last_fullsized":"2024-03-24T10:36:31.638384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239363+0000","last_change":"2024-03-24T10:36:30.287411+0000","last_active":"2024-03-24T10:36:31.239363+0000","last_peered":"2024-03-24T10:36:31.239363+0000","last_clean":"2024-03-24T10:36:31.239363+0000","last_became_active":"2024-03-24T10:36:30.286957+0000","last_became_peered":"2024-03-24T10:36:30.286957+0000","last_unstale":"2024-03-24T10:36:31.239363+0000","last_undegraded":"2024-03-24T10:36:31.239363+0000","last_fullsized":"2024-03-24T10:36:31.239363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978539+0000","last_change":"2024-03-24T10:36:26.236702+0000","last_active":"2024-03-24T10:36:31.978539+0000","last_peered":"2024-03-24T10:36:31.978539+0000","last_clean":"2024-03-24T10:36:31.978539+0000","last_became_active":"2024-03-24T10:36:26.236444+0000","last_became_peered":"2024-03-24T10:36:26.236444+0000","last_unstale":"2024-03-24T10:36:31.978539+0000","last_undegraded":"2024-03-24T10:36:31.978539+0000","last_fullsized":"2024-03-24T10:36:31.978539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240722+0000","last_change":"2024-03-24T10:36:25.213103+0000","last_active":"2024-03-24T10:36:31.240722+0000","last_peered":"2024-03-24T10:36:31.240722+0000","last_clean":"2024-03-24T10:36:31.240722+0000","last_became_active":"2024-03-24T10:36:25.212568+0000","last_became_peered":"2024-03-24T10:36:25.212568+0000","last_unstale":"2024-03-24T10:36:31.240722+0000","last_undegraded":"2024-03-24T10:36:31.240722+0000","last_fullsized":"2024-03-24T10:36:31.240722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239802+0000","last_change":"2024-03-24T10:36:30.257883+0000","last_active":"2024-03-24T10:36:31.239802+0000","last_peered":"2024-03-24T10:36:31.239802+0000","last_clean":"2024-03-24T10:36:31.239802+0000","last_became_active":"2024-03-24T10:36:30.257543+0000","last_became_peered":"2024-03-24T10:36:30.257543+0000","last_unstale":"2024-03-24T10:36:31.239802+0000","last_undegraded":"2024-03-24T10:36:31.239802+0000","last_fullsized":"2024-03-24T10:36:31.239802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:25.370328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978339+0000","last_change":"2024-03-24T10:36:26.235416+0000","last_active":"2024-03-24T10:36:31.978339+0000","last_peered":"2024-03-24T10:36:31.978339+0000","last_clean":"2024-03-24T10:36:31.978339+0000","last_became_active":"2024-03-24T10:36:26.235039+0000","last_became_peered":"2024-03-24T10:36:26.235039+0000","last_unstale":"2024-03-24T10:36:31.978339+0000","last_undegraded":"2024-03-24T10:36:31.978339+0000","last_fullsized":"2024-03-24T10:36:31.978339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638000+0000","last_change":"2024-03-24T10:36:25.215430+0000","last_active":"2024-03-24T10:36:31.638000+0000","last_peered":"2024-03-24T10:36:31.638000+0000","last_clean":"2024-03-24T10:36:31.638000+0000","last_became_active":"2024-03-24T10:36:25.215118+0000","last_became_peered":"2024-03-24T10:36:25.215118+0000","last_unstale":"2024-03-24T10:36:31.638000+0000","last_undegraded":"2024-03-24T10:36:31.638000+0000","last_fullsized":"2024-03-24T10:36:31.638000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978465+0000","last_change":"2024-03-24T10:36:30.252499+0000","last_active":"2024-03-24T10:36:31.978465+0000","last_peered":"2024-03-24T10:36:31.978465+0000","last_clean":"2024-03-24T10:36:31.978465+0000","last_became_active":"2024-03-24T10:36:30.252134+0000","last_became_peered":"2024-03-24T10:36:30.252134+0000","last_unstale":"2024-03-24T10:36:31.978465+0000","last_undegraded":"2024-03-24T10:36:31.978465+0000","last_fullsized":"2024-03-24T10:36:31.978465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977517+0000","last_change":"2024-03-24T10:36:26.226532+0000","last_active":"2024-03-24T10:36:31.977517+0000","last_peered":"2024-03-24T10:36:31.977517+0000","last_clean":"2024-03-24T10:36:31.977517+0000","last_became_active":"2024-03-24T10:36:26.226220+0000","last_became_peered":"2024-03-24T10:36:26.226220+0000","last_unstale":"2024-03-24T10:36:31.977517+0000","last_undegraded":"2024-03-24T10:36:31.977517+0000","last_fullsized":"2024-03-24T10:36:31.977517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977582+0000","last_change":"2024-03-24T10:36:25.216401+0000","last_active":"2024-03-24T10:36:31.977582+0000","last_peered":"2024-03-24T10:36:31.977582+0000","last_clean":"2024-03-24T10:36:31.977582+0000","last_became_active":"2024-03-24T10:36:25.216137+0000","last_became_peered":"2024-03-24T10:36:25.216137+0000","last_unstale":"2024-03-24T10:36:31.977582+0000","last_undegraded":"2024-03-24T10:36:31.977582+0000","last_fullsized":"2024-03-24T10:36:31.977582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240400+0000","last_change":"2024-03-24T10:36:30.287578+0000","last_active":"2024-03-24T10:36:31.240400+0000","last_peered":"2024-03-24T10:36:31.240400+0000","last_clean":"2024-03-24T10:36:31.240400+0000","last_became_active":"2024-03-24T10:36:30.287214+0000","last_became_peered":"2024-03-24T10:36:30.287214+0000","last_unstale":"2024-03-24T10:36:31.240400+0000","last_undegraded":"2024-03-24T10:36:31.240400+0000","last_fullsized":"2024-03-24T10:36:31.240400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:27:44.336084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978149+0000","last_change":"2024-03-24T10:36:26.235579+0000","last_active":"2024-03-24T10:36:31.978149+0000","last_peered":"2024-03-24T10:36:31.978149+0000","last_clean":"2024-03-24T10:36:31.978149+0000","last_became_active":"2024-03-24T10:36:26.234789+0000","last_became_peered":"2024-03-24T10:36:26.234789+0000","last_unstale":"2024-03-24T10:36:31.978149+0000","last_undegraded":"2024-03-24T10:36:31.978149+0000","last_fullsized":"2024-03-24T10:36:31.978149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240458+0000","last_change":"2024-03-24T10:36:25.213457+0000","last_active":"2024-03-24T10:36:31.240458+0000","last_peered":"2024-03-24T10:36:31.240458+0000","last_clean":"2024-03-24T10:36:31.240458+0000","last_became_active":"2024-03-24T10:36:25.213160+0000","last_became_peered":"2024-03-24T10:36:25.213160+0000","last_unstale":"2024-03-24T10:36:31.240458+0000","last_undegraded":"2024-03-24T10:36:31.240458+0000","last_fullsized":"2024-03-24T10:36:31.240458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240747+0000","last_change":"2024-03-24T10:36:30.287535+0000","last_active":"2024-03-24T10:36:31.240747+0000","last_peered":"2024-03-24T10:36:31.240747+0000","last_clean":"2024-03-24T10:36:31.240747+0000","last_became_active":"2024-03-24T10:36:30.287117+0000","last_became_peered":"2024-03-24T10:36:30.287117+0000","last_unstale":"2024-03-24T10:36:31.240747+0000","last_undegraded":"2024-03-24T10:36:31.240747+0000","last_fullsized":"2024-03-24T10:36:31.240747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:14:00.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978297+0000","last_change":"2024-03-24T10:36:26.236223+0000","last_active":"2024-03-24T10:36:31.978297+0000","last_peered":"2024-03-24T10:36:31.978297+0000","last_clean":"2024-03-24T10:36:31.978297+0000","last_became_active":"2024-03-24T10:36:26.235923+0000","last_became_peered":"2024-03-24T10:36:26.235923+0000","last_unstale":"2024-03-24T10:36:31.978297+0000","last_undegraded":"2024-03-24T10:36:31.978297+0000","last_fullsized":"2024-03-24T10:36:31.978297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978459+0000","last_change":"2024-03-24T10:36:25.209119+0000","last_active":"2024-03-24T10:36:31.978459+0000","last_peered":"2024-03-24T10:36:31.978459+0000","last_clean":"2024-03-24T10:36:31.978459+0000","last_became_active":"2024-03-24T10:36:25.208379+0000","last_became_peered":"2024-03-24T10:36:25.208379+0000","last_unstale":"2024-03-24T10:36:31.978459+0000","last_undegraded":"2024-03-24T10:36:31.978459+0000","last_fullsized":"2024-03-24T10:36:31.978459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240879+0000","last_change":"2024-03-24T10:36:30.288794+0000","last_active":"2024-03-24T10:36:31.240879+0000","last_peered":"2024-03-24T10:36:31.240879+0000","last_clean":"2024-03-24T10:36:31.240879+0000","last_became_active":"2024-03-24T10:36:30.288455+0000","last_became_peered":"2024-03-24T10:36:30.288455+0000","last_unstale":"2024-03-24T10:36:31.240879+0000","last_undegraded":"2024-03-24T10:36:31.240879+0000","last_fullsized":"2024-03-24T10:36:31.240879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978280+0000","last_change":"2024-03-24T10:36:26.235572+0000","last_active":"2024-03-24T10:36:31.978280+0000","last_peered":"2024-03-24T10:36:31.978280+0000","last_clean":"2024-03-24T10:36:31.978280+0000","last_became_active":"2024-03-24T10:36:26.234988+0000","last_became_peered":"2024-03-24T10:36:26.234988+0000","last_unstale":"2024-03-24T10:36:31.978280+0000","last_undegraded":"2024-03-24T10:36:31.978280+0000","last_fullsized":"2024-03-24T10:36:31.978280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:35.680520+0000","last_change":"2024-03-24T10:36:25.218162+0000","last_active":"2024-03-24T10:36:35.680520+0000","last_peered":"2024-03-24T10:36:35.680520+0000","last_clean":"2024-03-24T10:36:35.680520+0000","last_became_active":"2024-03-24T10:36:25.217883+0000","last_became_peered":"2024-03-24T10:36:25.217883+0000","last_unstale":"2024-03-24T10:36:35.680520+0000","last_undegraded":"2024-03-24T10:36:35.680520+0000","last_fullsized":"2024-03-24T10:36:35.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978846+0000","last_change":"2024-03-24T10:36:30.257936+0000","last_active":"2024-03-24T10:36:31.978846+0000","last_peered":"2024-03-24T10:36:31.978846+0000","last_clean":"2024-03-24T10:36:31.978846+0000","last_became_active":"2024-03-24T10:36:30.257563+0000","last_became_peered":"2024-03-24T10:36:30.257563+0000","last_unstale":"2024-03-24T10:36:31.978846+0000","last_undegraded":"2024-03-24T10:36:31.978846+0000","last_fullsized":"2024-03-24T10:36:31.978846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240985+0000","last_change":"2024-03-24T10:36:26.231768+0000","last_active":"2024-03-24T10:36:31.240985+0000","last_peered":"2024-03-24T10:36:31.240985+0000","last_clean":"2024-03-24T10:36:31.240985+0000","last_became_active":"2024-03-24T10:36:26.231505+0000","last_became_peered":"2024-03-24T10:36:26.231505+0000","last_unstale":"2024-03-24T10:36:31.240985+0000","last_undegraded":"2024-03-24T10:36:31.240985+0000","last_fullsized":"2024-03-24T10:36:31.240985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:12.471736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978654+0000","last_change":"2024-03-24T10:36:25.220658+0000","last_active":"2024-03-24T10:36:31.978654+0000","last_peered":"2024-03-24T10:36:31.978654+0000","last_clean":"2024-03-24T10:36:31.978654+0000","last_became_active":"2024-03-24T10:36:25.220451+0000","last_became_peered":"2024-03-24T10:36:25.220451+0000","last_unstale":"2024-03-24T10:36:31.978654+0000","last_undegraded":"2024-03-24T10:36:31.978654+0000","last_fullsized":"2024-03-24T10:36:31.978654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240105+0000","last_change":"2024-03-24T10:36:30.255676+0000","last_active":"2024-03-24T10:36:31.240105+0000","last_peered":"2024-03-24T10:36:31.240105+0000","last_clean":"2024-03-24T10:36:31.240105+0000","last_became_active":"2024-03-24T10:36:30.255314+0000","last_became_peered":"2024-03-24T10:36:30.255314+0000","last_unstale":"2024-03-24T10:36:31.240105+0000","last_undegraded":"2024-03-24T10:36:31.240105+0000","last_fullsized":"2024-03-24T10:36:31.240105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978164+0000","last_change":"2024-03-24T10:36:26.240945+0000","last_active":"2024-03-24T10:36:31.978164+0000","last_peered":"2024-03-24T10:36:31.978164+0000","last_clean":"2024-03-24T10:36:31.978164+0000","last_became_active":"2024-03-24T10:36:26.240664+0000","last_became_peered":"2024-03-24T10:36:26.240664+0000","last_unstale":"2024-03-24T10:36:31.978164+0000","last_undegraded":"2024-03-24T10:36:31.978164+0000","last_fullsized":"2024-03-24T10:36:31.978164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240312+0000","last_change":"2024-03-24T10:36:25.215416+0000","last_active":"2024-03-24T10:36:31.240312+0000","last_peered":"2024-03-24T10:36:31.240312+0000","last_clean":"2024-03-24T10:36:31.240312+0000","last_became_active":"2024-03-24T10:36:25.215130+0000","last_became_peered":"2024-03-24T10:36:25.215130+0000","last_unstale":"2024-03-24T10:36:31.240312+0000","last_undegraded":"2024-03-24T10:36:31.240312+0000","last_fullsized":"2024-03-24T10:36:31.240312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240235+0000","last_change":"2024-03-24T10:36:30.258107+0000","last_active":"2024-03-24T10:36:31.240235+0000","last_peered":"2024-03-24T10:36:31.240235+0000","last_clean":"2024-03-24T10:36:31.240235+0000","last_became_active":"2024-03-24T10:36:30.257548+0000","last_became_peered":"2024-03-24T10:36:30.257548+0000","last_unstale":"2024-03-24T10:36:31.240235+0000","last_undegraded":"2024-03-24T10:36:31.240235+0000","last_fullsized":"2024-03-24T10:36:31.240235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:27:22.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240228+0000","last_change":"2024-03-24T10:36:26.238486+0000","last_active":"2024-03-24T10:36:31.240228+0000","last_peered":"2024-03-24T10:36:31.240228+0000","last_clean":"2024-03-24T10:36:31.240228+0000","last_became_active":"2024-03-24T10:36:26.237843+0000","last_became_peered":"2024-03-24T10:36:26.237843+0000","last_unstale":"2024-03-24T10:36:31.240228+0000","last_undegraded":"2024-03-24T10:36:31.240228+0000","last_fullsized":"2024-03-24T10:36:31.240228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978669+0000","last_change":"2024-03-24T10:36:25.220880+0000","last_active":"2024-03-24T10:36:31.978669+0000","last_peered":"2024-03-24T10:36:31.978669+0000","last_clean":"2024-03-24T10:36:31.978669+0000","last_became_active":"2024-03-24T10:36:25.220622+0000","last_became_peered":"2024-03-24T10:36:25.220622+0000","last_unstale":"2024-03-24T10:36:31.978669+0000","last_undegraded":"2024-03-24T10:36:31.978669+0000","last_fullsized":"2024-03-24T10:36:31.978669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239888+0000","last_change":"2024-03-24T10:36:30.291355+0000","last_active":"2024-03-24T10:36:31.239888+0000","last_peered":"2024-03-24T10:36:31.239888+0000","last_clean":"2024-03-24T10:36:31.239888+0000","last_became_active":"2024-03-24T10:36:30.290079+0000","last_became_peered":"2024-03-24T10:36:30.290079+0000","last_unstale":"2024-03-24T10:36:31.239888+0000","last_undegraded":"2024-03-24T10:36:31.239888+0000","last_fullsized":"2024-03-24T10:36:31.239888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:26:51.570024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:30.290362+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:30.289924+0000","last_became_peered":"2024-03-24T10:36:30.289924+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978144+0000","last_change":"2024-03-24T10:36:26.223759+0000","last_active":"2024-03-24T10:36:31.978144+0000","last_peered":"2024-03-24T10:36:31.978144+0000","last_clean":"2024-03-24T10:36:31.978144+0000","last_became_active":"2024-03-24T10:36:26.223332+0000","last_became_peered":"2024-03-24T10:36:26.223332+0000","last_unstale":"2024-03-24T10:36:31.978144+0000","last_undegraded":"2024-03-24T10:36:31.978144+0000","last_fullsized":"2024-03-24T10:36:31.978144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239431+0000","last_change":"2024-03-24T10:36:25.211540+0000","last_active":"2024-03-24T10:36:31.239431+0000","last_peered":"2024-03-24T10:36:31.239431+0000","last_clean":"2024-03-24T10:36:31.239431+0000","last_became_active":"2024-03-24T10:36:25.211248+0000","last_became_peered":"2024-03-24T10:36:25.211248+0000","last_unstale":"2024-03-24T10:36:31.239431+0000","last_undegraded":"2024-03-24T10:36:31.239431+0000","last_fullsized":"2024-03-24T10:36:31.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977993+0000","last_change":"2024-03-24T10:36:30.254914+0000","last_active":"2024-03-24T10:36:31.977993+0000","last_peered":"2024-03-24T10:36:31.977993+0000","last_clean":"2024-03-24T10:36:31.977993+0000","last_became_active":"2024-03-24T10:36:30.254506+0000","last_became_peered":"2024-03-24T10:36:30.254506+0000","last_unstale":"2024-03-24T10:36:31.977993+0000","last_undegraded":"2024-03-24T10:36:31.977993+0000","last_fullsized":"2024-03-24T10:36:31.977993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239911+0000","last_change":"2024-03-24T10:36:26.226712+0000","last_active":"2024-03-24T10:36:31.239911+0000","last_peered":"2024-03-24T10:36:31.239911+0000","last_clean":"2024-03-24T10:36:31.239911+0000","last_became_active":"2024-03-24T10:36:26.226434+0000","last_became_peered":"2024-03-24T10:36:26.226434+0000","last_unstale":"2024-03-24T10:36:31.239911+0000","last_undegraded":"2024-03-24T10:36:31.239911+0000","last_fullsized":"2024-03-24T10:36:31.239911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240043+0000","last_change":"2024-03-24T10:36:25.216508+0000","last_active":"2024-03-24T10:36:31.240043+0000","last_peered":"2024-03-24T10:36:31.240043+0000","last_clean":"2024-03-24T10:36:31.240043+0000","last_became_active":"2024-03-24T10:36:25.216249+0000","last_became_peered":"2024-03-24T10:36:25.216249+0000","last_unstale":"2024-03-24T10:36:31.240043+0000","last_undegraded":"2024-03-24T10:36:31.240043+0000","last_fullsized":"2024-03-24T10:36:31.240043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977716+0000","last_change":"2024-03-24T10:36:25.217255+0000","last_active":"2024-03-24T10:36:31.977716+0000","last_peered":"2024-03-24T10:36:31.977716+0000","last_clean":"2024-03-24T10:36:31.977716+0000","last_became_active":"2024-03-24T10:36:25.216974+0000","last_became_peered":"2024-03-24T10:36:25.216974+0000","last_unstale":"2024-03-24T10:36:31.977716+0000","last_undegraded":"2024-03-24T10:36:31.977716+0000","last_fullsized":"2024-03-24T10:36:31.977716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978369+0000","last_change":"2024-03-24T10:36:26.235283+0000","last_active":"2024-03-24T10:36:31.978369+0000","last_peered":"2024-03-24T10:36:31.978369+0000","last_clean":"2024-03-24T10:36:31.978369+0000","last_became_active":"2024-03-24T10:36:26.234957+0000","last_became_peered":"2024-03-24T10:36:26.234957+0000","last_unstale":"2024-03-24T10:36:31.978369+0000","last_undegraded":"2024-03-24T10:36:31.978369+0000","last_fullsized":"2024-03-24T10:36:31.978369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638315+0000","last_change":"2024-03-24T10:36:30.258066+0000","last_active":"2024-03-24T10:36:31.638315+0000","last_peered":"2024-03-24T10:36:31.638315+0000","last_clean":"2024-03-24T10:36:31.638315+0000","last_became_active":"2024-03-24T10:36:30.257721+0000","last_became_peered":"2024-03-24T10:36:30.257721+0000","last_unstale":"2024-03-24T10:36:31.638315+0000","last_undegraded":"2024-03-24T10:36:31.638315+0000","last_fullsized":"2024-03-24T10:36:31.638315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:48.645675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240710+0000","last_change":"2024-03-24T10:36:25.217924+0000","last_active":"2024-03-24T10:36:31.240710+0000","last_peered":"2024-03-24T10:36:31.240710+0000","last_clean":"2024-03-24T10:36:31.240710+0000","last_became_active":"2024-03-24T10:36:25.217653+0000","last_became_peered":"2024-03-24T10:36:25.217653+0000","last_unstale":"2024-03-24T10:36:31.240710+0000","last_undegraded":"2024-03-24T10:36:31.240710+0000","last_fullsized":"2024-03-24T10:36:31.240710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:21:41.967893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239946+0000","last_change":"2024-03-24T10:36:26.222302+0000","last_active":"2024-03-24T10:36:31.239946+0000","last_peered":"2024-03-24T10:36:31.239946+0000","last_clean":"2024-03-24T10:36:31.239946+0000","last_became_active":"2024-03-24T10:36:26.221621+0000","last_became_peered":"2024-03-24T10:36:26.221621+0000","last_unstale":"2024-03-24T10:36:31.239946+0000","last_undegraded":"2024-03-24T10:36:31.239946+0000","last_fullsized":"2024-03-24T10:36:31.239946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240272+0000","last_change":"2024-03-24T10:36:30.252503+0000","last_active":"2024-03-24T10:36:31.240272+0000","last_peered":"2024-03-24T10:36:31.240272+0000","last_clean":"2024-03-24T10:36:31.240272+0000","last_became_active":"2024-03-24T10:36:30.252117+0000","last_became_peered":"2024-03-24T10:36:30.252117+0000","last_unstale":"2024-03-24T10:36:31.240272+0000","last_undegraded":"2024-03-24T10:36:31.240272+0000","last_fullsized":"2024-03-24T10:36:31.240272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:35:10.560451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977432+0000","last_change":"2024-03-24T10:36:26.227933+0000","last_active":"2024-03-24T10:36:31.977432+0000","last_peered":"2024-03-24T10:36:31.977432+0000","last_clean":"2024-03-24T10:36:31.977432+0000","last_became_active":"2024-03-24T10:36:26.227650+0000","last_became_peered":"2024-03-24T10:36:26.227650+0000","last_unstale":"2024-03-24T10:36:31.977432+0000","last_undegraded":"2024-03-24T10:36:31.977432+0000","last_fullsized":"2024-03-24T10:36:31.977432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638092+0000","last_change":"2024-03-24T10:36:26.240695+0000","last_active":"2024-03-24T10:36:31.638092+0000","last_peered":"2024-03-24T10:36:31.638092+0000","last_clean":"2024-03-24T10:36:31.638092+0000","last_became_active":"2024-03-24T10:36:26.240417+0000","last_became_peered":"2024-03-24T10:36:26.240417+0000","last_unstale":"2024-03-24T10:36:31.638092+0000","last_undegraded":"2024-03-24T10:36:31.638092+0000","last_fullsized":"2024-03-24T10:36:31.638092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240378+0000","last_change":"2024-03-24T10:36:26.242019+0000","last_active":"2024-03-24T10:36:31.240378+0000","last_peered":"2024-03-24T10:36:31.240378+0000","last_clean":"2024-03-24T10:36:31.240378+0000","last_became_active":"2024-03-24T10:36:26.241585+0000","last_became_peered":"2024-03-24T10:36:26.241585+0000","last_unstale":"2024-03-24T10:36:31.240378+0000","last_undegraded":"2024-03-24T10:36:31.240378+0000","last_fullsized":"2024-03-24T10:36:31.240378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978268+0000","last_change":"2024-03-24T10:36:26.228956+0000","last_active":"2024-03-24T10:36:31.978268+0000","last_peered":"2024-03-24T10:36:31.978268+0000","last_clean":"2024-03-24T10:36:31.978268+0000","last_became_active":"2024-03-24T10:36:26.228649+0000","last_became_peered":"2024-03-24T10:36:26.228649+0000","last_unstale":"2024-03-24T10:36:31.978268+0000","last_undegraded":"2024-03-24T10:36:31.978268+0000","last_fullsized":"2024-03-24T10:36:31.978268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240896+0000","last_change":"2024-03-24T10:36:26.230293+0000","last_active":"2024-03-24T10:36:31.240896+0000","last_peered":"2024-03-24T10:36:31.240896+0000","last_clean":"2024-03-24T10:36:31.240896+0000","last_became_active":"2024-03-24T10:36:26.229555+0000","last_became_peered":"2024-03-24T10:36:26.229555+0000","last_unstale":"2024-03-24T10:36:31.240896+0000","last_undegraded":"2024-03-24T10:36:31.240896+0000","last_fullsized":"2024-03-24T10:36:31.240896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978476+0000","last_change":"2024-03-24T10:36:26.222799+0000","last_active":"2024-03-24T10:36:31.978476+0000","last_peered":"2024-03-24T10:36:31.978476+0000","last_clean":"2024-03-24T10:36:31.978476+0000","last_became_active":"2024-03-24T10:36:26.221223+0000","last_became_peered":"2024-03-24T10:36:26.221223+0000","last_unstale":"2024-03-24T10:36:31.978476+0000","last_undegraded":"2024-03-24T10:36:31.978476+0000","last_fullsized":"2024-03-24T10:36:31.978476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978086+0000","last_change":"2024-03-24T10:36:26.226953+0000","last_active":"2024-03-24T10:36:31.978086+0000","last_peered":"2024-03-24T10:36:31.978086+0000","last_clean":"2024-03-24T10:36:31.978086+0000","last_became_active":"2024-03-24T10:36:26.226663+0000","last_became_peered":"2024-03-24T10:36:26.226663+0000","last_unstale":"2024-03-24T10:36:31.978086+0000","last_undegraded":"2024-03-24T10:36:31.978086+0000","last_fullsized":"2024-03-24T10:36:31.978086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240327+0000","last_change":"2024-03-24T10:36:26.229550+0000","last_active":"2024-03-24T10:36:31.240327+0000","last_peered":"2024-03-24T10:36:31.240327+0000","last_clean":"2024-03-24T10:36:31.240327+0000","last_became_active":"2024-03-24T10:36:26.229243+0000","last_became_peered":"2024-03-24T10:36:26.229243+0000","last_unstale":"2024-03-24T10:36:31.240327+0000","last_undegraded":"2024-03-24T10:36:31.240327+0000","last_fullsized":"2024-03-24T10:36:31.240327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239502+0000","last_change":"2024-03-24T10:36:26.228357+0000","last_active":"2024-03-24T10:36:31.239502+0000","last_peered":"2024-03-24T10:36:31.239502+0000","last_clean":"2024-03-24T10:36:31.239502+0000","last_became_active":"2024-03-24T10:36:26.228105+0000","last_became_peered":"2024-03-24T10:36:26.228105+0000","last_unstale":"2024-03-24T10:36:31.239502+0000","last_undegraded":"2024-03-24T10:36:31.239502+0000","last_fullsized":"2024-03-24T10:36:31.239502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240201+0000","last_change":"2024-03-24T10:36:26.230259+0000","last_active":"2024-03-24T10:36:31.240201+0000","last_peered":"2024-03-24T10:36:31.240201+0000","last_clean":"2024-03-24T10:36:31.240201+0000","last_became_active":"2024-03-24T10:36:26.229990+0000","last_became_peered":"2024-03-24T10:36:26.229990+0000","last_unstale":"2024-03-24T10:36:31.240201+0000","last_undegraded":"2024-03-24T10:36:31.240201+0000","last_fullsized":"2024-03-24T10:36:31.240201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240293+0000","last_change":"2024-03-24T10:36:26.242160+0000","last_active":"2024-03-24T10:36:31.240293+0000","last_peered":"2024-03-24T10:36:31.240293+0000","last_clean":"2024-03-24T10:36:31.240293+0000","last_became_active":"2024-03-24T10:36:26.241598+0000","last_became_peered":"2024-03-24T10:36:26.241598+0000","last_unstale":"2024-03-24T10:36:31.240293+0000","last_undegraded":"2024-03-24T10:36:31.240293+0000","last_fullsized":"2024-03-24T10:36:31.240293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978044+0000","last_change":"2024-03-24T10:36:26.239300+0000","last_active":"2024-03-24T10:36:31.978044+0000","last_peered":"2024-03-24T10:36:31.978044+0000","last_clean":"2024-03-24T10:36:31.978044+0000","last_became_active":"2024-03-24T10:36:26.239004+0000","last_became_peered":"2024-03-24T10:36:26.239004+0000","last_unstale":"2024-03-24T10:36:31.978044+0000","last_undegraded":"2024-03-24T10:36:31.978044+0000","last_fullsized":"2024-03-24T10:36:31.978044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977873+0000","last_change":"2024-03-24T10:36:26.234784+0000","last_active":"2024-03-24T10:36:31.977873+0000","last_peered":"2024-03-24T10:36:31.977873+0000","last_clean":"2024-03-24T10:36:31.977873+0000","last_became_active":"2024-03-24T10:36:26.234304+0000","last_became_peered":"2024-03-24T10:36:26.234304+0000","last_unstale":"2024-03-24T10:36:31.977873+0000","last_undegraded":"2024-03-24T10:36:31.977873+0000","last_fullsized":"2024-03-24T10:36:31.977873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978675+0000","last_change":"2024-03-24T10:36:26.234967+0000","last_active":"2024-03-24T10:36:31.978675+0000","last_peered":"2024-03-24T10:36:31.978675+0000","last_clean":"2024-03-24T10:36:31.978675+0000","last_became_active":"2024-03-24T10:36:26.234619+0000","last_became_peered":"2024-03-24T10:36:26.234619+0000","last_unstale":"2024-03-24T10:36:31.978675+0000","last_undegraded":"2024-03-24T10:36:31.978675+0000","last_fullsized":"2024-03-24T10:36:31.978675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638313+0000","last_change":"2024-03-24T10:36:26.218406+0000","last_active":"2024-03-24T10:36:31.638313+0000","last_peered":"2024-03-24T10:36:31.638313+0000","last_clean":"2024-03-24T10:36:31.638313+0000","last_became_active":"2024-03-24T10:36:26.218130+0000","last_became_peered":"2024-03-24T10:36:26.218130+0000","last_unstale":"2024-03-24T10:36:31.638313+0000","last_undegraded":"2024-03-24T10:36:31.638313+0000","last_fullsized":"2024-03-24T10:36:31.638313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240564+0000","last_change":"2024-03-24T10:36:26.241244+0000","last_active":"2024-03-24T10:36:31.240564+0000","last_peered":"2024-03-24T10:36:31.240564+0000","last_clean":"2024-03-24T10:36:31.240564+0000","last_became_active":"2024-03-24T10:36:26.240263+0000","last_became_peered":"2024-03-24T10:36:26.240263+0000","last_unstale":"2024-03-24T10:36:31.240564+0000","last_undegraded":"2024-03-24T10:36:31.240564+0000","last_fullsized":"2024-03-24T10:36:31.240564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239339+0000","last_change":"2024-03-24T10:36:26.233360+0000","last_active":"2024-03-24T10:36:31.239339+0000","last_peered":"2024-03-24T10:36:31.239339+0000","last_clean":"2024-03-24T10:36:31.239339+0000","last_became_active":"2024-03-24T10:36:26.232820+0000","last_became_peered":"2024-03-24T10:36:26.232820+0000","last_unstale":"2024-03-24T10:36:31.239339+0000","last_undegraded":"2024-03-24T10:36:31.239339+0000","last_fullsized":"2024-03-24T10:36:31.239339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978230+0000","last_change":"2024-03-24T10:36:26.229654+0000","last_active":"2024-03-24T10:36:31.978230+0000","last_peered":"2024-03-24T10:36:31.978230+0000","last_clean":"2024-03-24T10:36:31.978230+0000","last_became_active":"2024-03-24T10:36:26.229360+0000","last_became_peered":"2024-03-24T10:36:26.229360+0000","last_unstale":"2024-03-24T10:36:31.978230+0000","last_undegraded":"2024-03-24T10:36:31.978230+0000","last_fullsized":"2024-03-24T10:36:31.978230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978201+0000","last_change":"2024-03-24T10:36:26.232307+0000","last_active":"2024-03-24T10:36:31.978201+0000","last_peered":"2024-03-24T10:36:31.978201+0000","last_clean":"2024-03-24T10:36:31.978201+0000","last_became_active":"2024-03-24T10:36:26.232003+0000","last_became_peered":"2024-03-24T10:36:26.232003+0000","last_unstale":"2024-03-24T10:36:31.978201+0000","last_undegraded":"2024-03-24T10:36:31.978201+0000","last_fullsized":"2024-03-24T10:36:31.978201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240018+0000","last_change":"2024-03-24T10:36:26.227231+0000","last_active":"2024-03-24T10:36:31.240018+0000","last_peered":"2024-03-24T10:36:31.240018+0000","last_clean":"2024-03-24T10:36:31.240018+0000","last_became_active":"2024-03-24T10:36:26.225847+0000","last_became_peered":"2024-03-24T10:36:26.225847+0000","last_unstale":"2024-03-24T10:36:31.240018+0000","last_undegraded":"2024-03-24T10:36:31.240018+0000","last_fullsized":"2024-03-24T10:36:31.240018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240927+0000","last_change":"2024-03-24T10:36:26.232739+0000","last_active":"2024-03-24T10:36:31.240927+0000","last_peered":"2024-03-24T10:36:31.240927+0000","last_clean":"2024-03-24T10:36:31.240927+0000","last_became_active":"2024-03-24T10:36:26.231159+0000","last_became_peered":"2024-03-24T10:36:26.231159+0000","last_unstale":"2024-03-24T10:36:31.240927+0000","last_undegraded":"2024-03-24T10:36:31.240927+0000","last_fullsized":"2024-03-24T10:36:31.240927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977892+0000","last_change":"2024-03-24T10:36:26.244230+0000","last_active":"2024-03-24T10:36:31.977892+0000","last_peered":"2024-03-24T10:36:31.977892+0000","last_clean":"2024-03-24T10:36:31.977892+0000","last_became_active":"2024-03-24T10:36:26.243918+0000","last_became_peered":"2024-03-24T10:36:26.243918+0000","last_unstale":"2024-03-24T10:36:31.977892+0000","last_undegraded":"2024-03-24T10:36:31.977892+0000","last_fullsized":"2024-03-24T10:36:31.977892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978041+0000","last_change":"2024-03-24T10:36:26.244721+0000","last_active":"2024-03-24T10:36:31.978041+0000","last_peered":"2024-03-24T10:36:31.978041+0000","last_clean":"2024-03-24T10:36:31.978041+0000","last_became_active":"2024-03-24T10:36:26.244427+0000","last_became_peered":"2024-03-24T10:36:26.244427+0000","last_unstale":"2024-03-24T10:36:31.978041+0000","last_undegraded":"2024-03-24T10:36:31.978041+0000","last_fullsized":"2024-03-24T10:36:31.978041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978616+0000","last_change":"2024-03-24T10:36:26.242508+0000","last_active":"2024-03-24T10:36:31.978616+0000","last_peered":"2024-03-24T10:36:31.978616+0000","last_clean":"2024-03-24T10:36:31.978616+0000","last_became_active":"2024-03-24T10:36:26.242179+0000","last_became_peered":"2024-03-24T10:36:26.242179+0000","last_unstale":"2024-03-24T10:36:31.978616+0000","last_undegraded":"2024-03-24T10:36:31.978616+0000","last_fullsized":"2024-03-24T10:36:31.978616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:38.572103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239819+0000","last_change":"2024-03-24T10:36:26.235232+0000","last_active":"2024-03-24T10:36:31.239819+0000","last_peered":"2024-03-24T10:36:31.239819+0000","last_clean":"2024-03-24T10:36:31.239819+0000","last_became_active":"2024-03-24T10:36:26.234954+0000","last_became_peered":"2024-03-24T10:36:26.234954+0000","last_unstale":"2024-03-24T10:36:31.239819+0000","last_undegraded":"2024-03-24T10:36:31.239819+0000","last_fullsized":"2024-03-24T10:36:31.239819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978320+0000","last_change":"2024-03-24T10:36:26.235229+0000","last_active":"2024-03-24T10:36:31.978320+0000","last_peered":"2024-03-24T10:36:31.978320+0000","last_clean":"2024-03-24T10:36:31.978320+0000","last_became_active":"2024-03-24T10:36:26.234686+0000","last_became_peered":"2024-03-24T10:36:26.234686+0000","last_unstale":"2024-03-24T10:36:31.978320+0000","last_undegraded":"2024-03-24T10:36:31.978320+0000","last_fullsized":"2024-03-24T10:36:31.978320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240402+0000","last_change":"2024-03-24T10:36:26.242391+0000","last_active":"2024-03-24T10:36:31.240402+0000","last_peered":"2024-03-24T10:36:31.240402+0000","last_clean":"2024-03-24T10:36:31.240402+0000","last_became_active":"2024-03-24T10:36:26.241891+0000","last_became_peered":"2024-03-24T10:36:26.241891+0000","last_unstale":"2024-03-24T10:36:31.240402+0000","last_undegraded":"2024-03-24T10:36:31.240402+0000","last_fullsized":"2024-03-24T10:36:31.240402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978072+0000","last_change":"2024-03-24T10:36:26.224899+0000","last_active":"2024-03-24T10:36:31.978072+0000","last_peered":"2024-03-24T10:36:31.978072+0000","last_clean":"2024-03-24T10:36:31.978072+0000","last_became_active":"2024-03-24T10:36:26.224612+0000","last_became_peered":"2024-03-24T10:36:26.224612+0000","last_unstale":"2024-03-24T10:36:31.978072+0000","last_undegraded":"2024-03-24T10:36:31.978072+0000","last_fullsized":"2024-03-24T10:36:31.978072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240698+0000","last_change":"2024-03-24T10:36:26.241713+0000","last_active":"2024-03-24T10:36:31.240698+0000","last_peered":"2024-03-24T10:36:31.240698+0000","last_clean":"2024-03-24T10:36:31.240698+0000","last_became_active":"2024-03-24T10:36:26.241441+0000","last_became_peered":"2024-03-24T10:36:26.241441+0000","last_unstale":"2024-03-24T10:36:31.240698+0000","last_undegraded":"2024-03-24T10:36:31.240698+0000","last_fullsized":"2024-03-24T10:36:31.240698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978166+0000","last_change":"2024-03-24T10:36:26.229024+0000","last_active":"2024-03-24T10:36:31.978166+0000","last_peered":"2024-03-24T10:36:31.978166+0000","last_clean":"2024-03-24T10:36:31.978166+0000","last_became_active":"2024-03-24T10:36:26.228715+0000","last_became_peered":"2024-03-24T10:36:26.228715+0000","last_unstale":"2024-03-24T10:36:31.978166+0000","last_undegraded":"2024-03-24T10:36:31.978166+0000","last_fullsized":"2024-03-24T10:36:31.978166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979045+0000","last_change":"2024-03-24T10:36:26.226685+0000","last_active":"2024-03-24T10:36:31.979045+0000","last_peered":"2024-03-24T10:36:31.979045+0000","last_clean":"2024-03-24T10:36:31.979045+0000","last_became_active":"2024-03-24T10:36:26.226405+0000","last_became_peered":"2024-03-24T10:36:26.226405+0000","last_unstale":"2024-03-24T10:36:31.979045+0000","last_undegraded":"2024-03-24T10:36:31.979045+0000","last_fullsized":"2024-03-24T10:36:31.979045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978516+0000","last_change":"2024-03-24T10:36:26.234917+0000","last_active":"2024-03-24T10:36:31.978516+0000","last_peered":"2024-03-24T10:36:31.978516+0000","last_clean":"2024-03-24T10:36:31.978516+0000","last_became_active":"2024-03-24T10:36:26.234583+0000","last_became_peered":"2024-03-24T10:36:26.234583+0000","last_unstale":"2024-03-24T10:36:31.978516+0000","last_undegraded":"2024-03-24T10:36:31.978516+0000","last_fullsized":"2024-03-24T10:36:31.978516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:36:49.594 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-24T10:36:49.594 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-24T10:36:49.594 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-24T10:36:49.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-24T10:36:49.595 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-24T10:36:49.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.729+0000 7fc244e0e640 1 Processor -- start 2024-03-24T10:36:49.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 -- start start 2024-03-24T10:36:49.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc24015e170 0x7fc24015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2400d4930 0x7fc2400d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 0x7fc2400d2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400d4e50 con 0x7fc2400d2280 2024-03-24T10:36:49.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc2400cf790 con 0x7fc2400d4930 2024-03-24T10:36:49.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.730+0000 7fc244e0e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400cfa70 con 0x7fc24015e170 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2400d4930 0x7fc2400d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 0x7fc2400d2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23e59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc24015e170 0x7fc24015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc2400d4930 0x7fc2400d1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49056/0 (socket says 172.21.15.72:49056) 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 0x7fc2400d2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33270/0 (socket says 172.21.15.72:33270) 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 -- 172.21.15.72:0/4262577307 learned_addr learned my addr 172.21.15.72:0/4262577307 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 -- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc24015e170 msgr2=0x7fc24015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 --2- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc24015e170 0x7fc24015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 -- 172.21.15.72:0/4262577307 >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 msgr2=0x7fc2400d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 --2- 172.21.15.72:0/4262577307 >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 0x7fc2400d2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23dd9b640 1 -- 172.21.15.72:0/4262577307 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400cfd50 con 0x7fc2400d4930 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.731+0000 7fc23ed9d640 1 --2- 172.21.15.72:0/4262577307 >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 0x7fc2400d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc23dd9b640 1 --2- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2400d4930 0x7fc2400d1d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc24008dc90 tx=0x7fc22802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd20e0307e707d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc23d59a640 1 -- 172.21.15.72:0/4262577307 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2280317e0 con 0x7fc2400d4930 2024-03-24T10:36:49.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc23d59a640 1 -- 172.21.15.72:0/4262577307 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc228031940 con 0x7fc2400d4930 2024-03-24T10:36:49.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc23d59a640 1 -- 172.21.15.72:0/4262577307 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228031cd0 con 0x7fc2400d4930 2024-03-24T10:36:49.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 -- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2400d4930 msgr2=0x7fc2400d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 --2- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2400d4930 0x7fc2400d1d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc24008dc90 tx=0x7fc22802b880 comp rx=0 tx=0).stop 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 -- 172.21.15.72:0/4262577307 shutdown_connections 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 --2- 172.21.15.72:0/4262577307 >> v2:172.21.15.72:3300/0 conn(0x7fc2400d2280 0x7fc2400d2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 --2- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc2400d4930 0x7fc2400d1d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 --2- 172.21.15.72:0/4262577307 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc24015e170 0x7fc24015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.732+0000 7fc244e0e640 1 -- 172.21.15.72:0/4262577307 >> 172.21.15.72:0/4262577307 conn(0x7fc24009d310 msgr2=0x7fc2400d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.733+0000 7fc244e0e640 1 -- 172.21.15.72:0/4262577307 shutdown_connections 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.733+0000 7fc244e0e640 1 -- 172.21.15.72:0/4262577307 wait complete. 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.734+0000 7fc244e0e640 1 Processor -- start 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.734+0000 7fc244e0e640 1 -- start start 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.734+0000 7fc244e0e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2400d2280 0x7fc2400cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.734+0000 7fc244e0e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 0x7fc240151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc244e0e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc24015e170 0x7fc2401521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc244e0e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc24014fc60 con 0x7fc2400d4930 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc244e0e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400cbf40 con 0x7fc24015e170 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc244e0e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400cc220 con 0x7fc2400d2280 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 0x7fc240151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 0x7fc240151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33272/0 (socket says 172.21.15.72:33272) 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23ed9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc24015e170 0x7fc2401521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23e59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2400d2280 0x7fc2400cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 -- 172.21.15.72:0/842091658 learned_addr learned my addr 172.21.15.72:0/842091658 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 -- 172.21.15.72:0/842091658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2400d2280 msgr2=0x7fc2400cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2400d2280 0x7fc2400cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 -- 172.21.15.72:0/842091658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc24015e170 msgr2=0x7fc2401521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc24015e170 0x7fc2401521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 -- 172.21.15.72:0/842091658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc230009400 con 0x7fc2400d4930 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc23dd9b640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 0x7fc240151c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc22802b8c0 tx=0x7fc2280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228032880 con 0x7fc2400d4930 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2280329e0 con 0x7fc2400d4930 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2280094d0 con 0x7fc2400d4930 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc228032d90 con 0x7fc2400d4930 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.735+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2400cc7e0 con 0x7fc2400d4930 2024-03-24T10:36:49.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.736+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc24014fda0 con 0x7fc2400d4930 2024-03-24T10:36:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.737+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc22804e450 con 0x7fc2400d4930 2024-03-24T10:36:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.737+0000 7fc236ffd640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc22006b810 0x7fc22006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.737+0000 7fc23e59c640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc22006b810 0x7fc22006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.737+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2280ac2e0 con 0x7fc2400d4930 2024-03-24T10:36:49.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.738+0000 7fc23e59c640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc22006b810 0x7fc22006dcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc238011340 tx=0x7fc23800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:49.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.742+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc24014fda0 con 0x7fc2400d4930 2024-03-24T10:36:49.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.959+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc24014fda0 con 0x7fc2400d4930 2024-03-24T10:36:49.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.962+0000 7fc236ffd640 1 -- 172.21.15.72:0/842091658 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+171785 (secure 0 0 0) 0x7fc24014fda0 con 0x7fc2400d4930 2024-03-24T10:36:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc22006b810 msgr2=0x7fc22006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc22006b810 0x7fc22006dcd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc238011340 tx=0x7fc23800b040 comp rx=0 tx=0).stop 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 msgr2=0x7fc240151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 0x7fc240151c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc22802b8c0 tx=0x7fc2280046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 shutdown_connections 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc22006b810 0x7fc22006dcd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc24015e170 0x7fc2401521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2400d4930 0x7fc240151c90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 --2- 172.21.15.72:0/842091658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc2400d2280 0x7fc2400cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.964+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 >> 172.21.15.72:0/842091658 conn(0x7fc24009d310 msgr2=0x7fc2400ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.965+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 shutdown_connections 2024-03-24T10:36:49.966 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:49.965+0000 7fc244e0e640 1 -- 172.21.15.72:0/842091658 wait complete. 2024-03-24T10:36:49.977 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":4015618511},{"type":"v1","addr":"172.21.15.72:6833","nonce":4015618511}]},"active_addr":"172.21.15.72:6833/4015618511","active_change":"2024-03-24T10:36:06.130892+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1629768139}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2929224978}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1887555687}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2254828939}]}]} 2024-03-24T10:36:49.980 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-24T10:36:49.980 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-24T10:36:49.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:50.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.080+0000 7f504f655640 1 Processor -- start 2024-03-24T10:36:50.081 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.081+0000 7f504f655640 1 -- start start 2024-03-24T10:36:50.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.081+0000 7f504f655640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50480d4930 0x7f504815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.081+0000 7f504f655640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50480d2450 0x7f50480b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.081+0000 7f504f655640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50480d4e50 con 0x7f504815e170 2024-03-24T10:36:50.082 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.081+0000 7f504f655640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f50480cf790 con 0x7f50480d2450 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.081+0000 7f504f655640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f50480cfa70 con 0x7f50480d4930 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504dbf2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50480d2450 0x7f50480b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504cbf0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50480d4930 0x7f504815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504d3f1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f504815e170 0x7f50480d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41424/0 (socket says 172.21.15.72:41424) 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504d3f1640 1 -- 172.21.15.72:0/724600629 learned_addr learned my addr 172.21.15.72:0/724600629 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504dbf2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f50480d2450 0x7f50480b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49074/0 (socket says 172.21.15.72:49074) 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504cbf0640 1 -- 172.21.15.72:0/724600629 >> v2:172.21.15.79:3300/0 conn(0x7f50480d2450 msgr2=0x7f50480b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504cbf0640 1 --2- 172.21.15.72:0/724600629 >> v2:172.21.15.79:3300/0 conn(0x7f50480d2450 0x7f50480b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504cbf0640 1 -- 172.21.15.72:0/724600629 >> v1:172.21.15.79:6789/0 conn(0x7f504815e170 legacy=0x7f50480d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.083 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.082+0000 7f504cbf0640 1 -- 172.21.15.72:0/724600629 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50480cfd50 con 0x7f50480d4930 2024-03-24T10:36:50.084 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504cbf0640 1 --2- 172.21.15.72:0/724600629 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50480d4930 0x7f504815e550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50440097a0 tx=0x7f504402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44904cdc290c1885 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f503bfff640 1 -- 172.21.15.72:0/724600629 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504402e070 con 0x7f50480d4930 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f503bfff640 1 -- 172.21.15.72:0/724600629 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50440315a0 con 0x7f50480d4930 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f503bfff640 1 -- 172.21.15.72:0/724600629 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044031930 con 0x7f50480d4930 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504f655640 1 -- 172.21.15.72:0/724600629 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50480d4930 msgr2=0x7f504815e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504f655640 1 --2- 172.21.15.72:0/724600629 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50480d4930 0x7f504815e550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50440097a0 tx=0x7f504402b840 comp rx=0 tx=0).stop 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504f655640 1 -- 172.21.15.72:0/724600629 shutdown_connections 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504f655640 1 --2- 172.21.15.72:0/724600629 >> v2:172.21.15.79:3300/0 conn(0x7f50480d2450 0x7f50480b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504f655640 1 --2- 172.21.15.72:0/724600629 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f50480d4930 0x7f504815e550 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.083+0000 7f504f655640 1 -- 172.21.15.72:0/724600629 >> 172.21.15.72:0/724600629 conn(0x7f504809d310 msgr2=0x7f50480d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.084+0000 7f504f655640 1 -- 172.21.15.72:0/724600629 shutdown_connections 2024-03-24T10:36:50.085 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.084+0000 7f504f655640 1 -- 172.21.15.72:0/724600629 wait complete. 2024-03-24T10:36:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 Processor -- start 2024-03-24T10:36:50.087 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 -- start start 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 0x7f50480c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50480d4930 0x7f50480b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f504815e170 0x7f50480cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f50480b85f0 con 0x7f50480d2450 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f50480b88d0 con 0x7f50480d4930 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504f655640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f50480b8bb0 con 0x7f504815e170 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.085+0000 7f504d3f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 0x7f50480c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 0x7f50480c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33274/0 (socket says 172.21.15.72:33274) 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 -- 172.21.15.72:0/1965805563 learned_addr learned my addr 172.21.15.72:0/1965805563 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504dbf2640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f504815e170 0x7f50480cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504cbf0640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50480d4930 0x7f50480b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 -- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f504815e170 msgr2=0x7f50480cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f504815e170 0x7f50480cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.088 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 -- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50480d4930 msgr2=0x7f50480b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50480d4930 0x7f50480b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 -- 172.21.15.72:0/1965805563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5044009400 con 0x7f50480d2450 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504dbf2640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f504815e170 0x7f50480cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504d3f1640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 0x7f50480c9d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c3c0 tx=0x7f503c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c005ce0 con 0x7f50480d2450 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f503c005e40 con 0x7f50480d2450 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f503c0072d0 con 0x7f50480d2450 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50480b8e90 con 0x7f50480d2450 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.086+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50480cb1f0 con 0x7f50480d2450 2024-03-24T10:36:50.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.087+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50480a1ef0 con 0x7f50480d2450 2024-03-24T10:36:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.088+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f503c007430 con 0x7f50480d2450 2024-03-24T10:36:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.088+0000 7f5039ffb640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f502c06b840 0x7f502c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.088+0000 7f504cbf0640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f502c06b840 0x7f502c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.088+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f503c0899c0 con 0x7f50480d2450 2024-03-24T10:36:50.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.088+0000 7f504cbf0640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f502c06b840 0x7f502c06dd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5044036000 tx=0x7f504403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.092+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f503c054150 con 0x7f50480d2450 2024-03-24T10:36:50.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.270+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f504804f550 con 0x7f50480d2450 2024-03-24T10:36:50.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.271+0000 7f5039ffb640 1 -- 172.21.15.72:0/1965805563 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f503c057810 con 0x7f50480d2450 2024-03-24T10:36:50.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:50.272 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f502c06b840 msgr2=0x7f502c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f502c06b840 0x7f502c06dd00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5044036000 tx=0x7f504403d040 comp rx=0 tx=0).stop 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 msgr2=0x7f50480c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 0x7f50480c9d00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c3c0 tx=0x7f503c00c880 comp rx=0 tx=0).stop 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 shutdown_connections 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f502c06b840 0x7f502c06dd00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f504815e170 0x7f50480cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50480d4930 0x7f50480b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 --2- 172.21.15.72:0/1965805563 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50480d2450 0x7f50480c9d00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 >> 172.21.15.72:0/1965805563 conn(0x7f504809d310 msgr2=0x7f504806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 shutdown_connections 2024-03-24T10:36:50.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.273+0000 7f504f655640 1 -- 172.21.15.72:0/1965805563 wait complete. 2024-03-24T10:36:50.284 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-24T10:36:50.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:50.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.384+0000 7fc55dd43640 1 Processor -- start 2024-03-24T10:36:50.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.384+0000 7fc55dd43640 1 -- start start 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc55dd43640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc55815bd10 0x7fc558160440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc55dd43640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5580b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc55dd43640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55815fa10 con 0x7fc5580b24b0 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc55dd43640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc5580b4e70 con 0x7fc55815bd10 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc55dd43640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc5580b48b0 con 0x7fc5580afd70 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5580b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc5577fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc55815bd10 0x7fc558160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5580b4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55386/0 (socket says 172.21.15.72:55386) 2024-03-24T10:36:50.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 -- 172.21.15.72:0/1799082113 learned_addr learned my addr 172.21.15.72:0/1799082113 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 -- 172.21.15.72:0/1799082113 >> v2:172.21.15.79:3300/0 conn(0x7fc55815bd10 msgr2=0x7fc558160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 --2- 172.21.15.72:0/1799082113 >> v2:172.21.15.79:3300/0 conn(0x7fc55815bd10 0x7fc558160440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 -- 172.21.15.72:0/1799082113 >> v1:172.21.15.79:6789/0 conn(0x7fc5580b24b0 legacy=0x7fc558071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc556ffd640 1 -- 172.21.15.72:0/1799082113 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5580b4b90 con 0x7fc5580afd70 2024-03-24T10:36:50.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.385+0000 7fc5577fe640 1 --2- 172.21.15.72:0/1799082113 >> v2:172.21.15.79:3300/0 conn(0x7fc55815bd10 0x7fc558160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.386+0000 7fc556ffd640 1 --2- 172.21.15.72:0/1799082113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5580b4060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009870 tx=0x7fc54c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ba55baebbb8829a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.386+0000 7fc5567fc640 1 -- 172.21.15.72:0/1799082113 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c030840 con 0x7fc5580afd70 2024-03-24T10:36:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.386+0000 7fc5567fc640 1 -- 172.21.15.72:0/1799082113 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54c0309a0 con 0x7fc5580afd70 2024-03-24T10:36:50.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.386+0000 7fc5567fc640 1 -- 172.21.15.72:0/1799082113 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c030d30 con 0x7fc5580afd70 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 -- 172.21.15.72:0/1799082113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 msgr2=0x7fc5580b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 --2- 172.21.15.72:0/1799082113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5580b4060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009870 tx=0x7fc54c02b980 comp rx=0 tx=0).stop 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 -- 172.21.15.72:0/1799082113 shutdown_connections 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 --2- 172.21.15.72:0/1799082113 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5580b4060 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 --2- 172.21.15.72:0/1799082113 >> v2:172.21.15.79:3300/0 conn(0x7fc55815bd10 0x7fc558160440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 -- 172.21.15.72:0/1799082113 >> 172.21.15.72:0/1799082113 conn(0x7fc55806b310 msgr2=0x7fc55806b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 -- 172.21.15.72:0/1799082113 shutdown_connections 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.387+0000 7fc55dd43640 1 -- 172.21.15.72:0/1799082113 wait complete. 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.388+0000 7fc55dd43640 1 Processor -- start 2024-03-24T10:36:50.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.388+0000 7fc55dd43640 1 -- start start 2024-03-24T10:36:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc55dd43640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5581538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc55dd43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5580b24b0 0x7fc55814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc55dd43640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 0x7fc5580cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc55dd43640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc5580ae200 con 0x7fc55815bd10 2024-03-24T10:36:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc55dd43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc558151240 con 0x7fc5580b24b0 2024-03-24T10:36:50.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc55dd43640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc558151520 con 0x7fc5580afd70 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 0x7fc5580cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 0x7fc5580cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33288/0 (socket says 172.21.15.72:33288) 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc5577fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5581538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 -- 172.21.15.72:0/2298262065 learned_addr learned my addr 172.21.15.72:0/2298262065 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc556ffd640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5580b24b0 0x7fc55814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 -- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 msgr2=0x7fc5581538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5581538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 -- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5580b24b0 msgr2=0x7fc55814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5580b24b0 0x7fc55814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 -- 172.21.15.72:0/2298262065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc548009400 con 0x7fc55815bd10 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc5577fe640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5581538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc556ffd640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5580b24b0 0x7fc55814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.389+0000 7fc557fff640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 0x7fc5580cf7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c7a0 tx=0x7fc55000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.390+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550003b70 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.390+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc550003cf0 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.390+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc550003ea0 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.390+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c0094d0 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.390+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55814fdb0 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.391+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55815f3e0 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.391+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc55000aa90 con 0x7fc55815bd10 2024-03-24T10:36:50.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.391+0000 7fc53ffff640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc54406b810 0x7fc54406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.391+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc55008a290 con 0x7fc55815bd10 2024-03-24T10:36:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.391+0000 7fc5577fe640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc54406b810 0x7fc54406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.392+0000 7fc5577fe640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc54406b810 0x7fc54406dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc548009fd0 tx=0x7fc548009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.396+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc550054990 con 0x7fc55815bd10 2024-03-24T10:36:50.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.567+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5580ae340 con 0x7fc55815bd10 2024-03-24T10:36:50.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.569+0000 7fc53ffff640 1 -- 172.21.15.72:0/2298262065 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7fc550058050 con 0x7fc55815bd10 2024-03-24T10:36:50.570 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:50.570 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:50.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc54406b810 msgr2=0x7fc54406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc54406b810 0x7fc54406dcd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc548009fd0 tx=0x7fc548009190 comp rx=0 tx=0).stop 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 msgr2=0x7fc5580cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 0x7fc5580cf7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc55000c7a0 tx=0x7fc55000cc60 comp rx=0 tx=0).stop 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 shutdown_connections 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc54406b810 0x7fc54406dcd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc55815bd10 0x7fc5580cf7f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5580b24b0 0x7fc55814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 --2- 172.21.15.72:0/2298262065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc5580afd70 0x7fc5581538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 >> 172.21.15.72:0/2298262065 conn(0x7fc55806b310 msgr2=0x7fc55806e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 shutdown_connections 2024-03-24T10:36:50.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.571+0000 7fc55dd43640 1 -- 172.21.15.72:0/2298262065 wait complete. 2024-03-24T10:36:50.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-24T10:36:50.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-24T10:36:50.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-24T10:36:50.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-24T10:36:50.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-24T10:36:50.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-24T10:36:50.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-24T10:36:50.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-24T10:36:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.754+0000 7f65d0cfc640 1 Processor -- start 2024-03-24T10:36:50.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.754+0000 7f65d0cfc640 1 -- start start 2024-03-24T10:36:50.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.754+0000 7fb56020e640 1 Processor -- start 2024-03-24T10:36:50.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.754+0000 7fb56020e640 1 -- start start 2024-03-24T10:36:50.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb56020e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb55806ca30 0x7fb55806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb56020e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb55806d3d0 con 0x7fb5580cf530 2024-03-24T10:36:50.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb56020e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5580b2a10 con 0x7fb5580b3460 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb56020e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb558145680 con 0x7fb55806ca30 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65d0cfc640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65cc0cb630 0x7f65cc0ce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65d0cfc640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65cc06eeb0 0x7f65cc072150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65d0cfc640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65cc0b0150 con 0x7f65cc15af20 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65d0cfc640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0ced40 con 0x7f65cc0cb630 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65d0cfc640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65cc0cba10 con 0x7f65cc06eeb0 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65caffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f65cc15af20 0x7f65cc071a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49842/0 (socket says 172.21.15.72:49842) 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65caffd640 1 -- 172.21.15.72:0/2763307037 learned_addr learned my addr 172.21.15.72:0/2763307037 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.755+0000 7f65cb7fe640 1 --2- 172.21.15.72:0/2763307037 >> v2:172.21.15.72:3300/0 conn(0x7f65cc0cb630 0x7f65cc0ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f65cbfff640 1 --2- 172.21.15.72:0/2763307037 >> v2:172.21.15.79:3300/0 conn(0x7f65cc06eeb0 0x7f65cc072150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.754+0000 7f6500f56640 1 Processor -- start 2024-03-24T10:36:50.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.754+0000 7f6500f56640 1 -- start start 2024-03-24T10:36:50.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f6500f56640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64f4053e50 0x7f64f40542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f6500f56640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f4006ae0 con 0x7f64f4048100 2024-03-24T10:36:50.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f6500f56640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f4005f10 con 0x7f64f404f930 2024-03-24T10:36:50.758 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f6500f56640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f64f40484e0 con 0x7f64f4053e50 2024-03-24T10:36:50.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f65cbfff640 1 -- 172.21.15.72:0/2763307037 >> v2:172.21.15.72:3300/0 conn(0x7f65cc0cb630 msgr2=0x7f65cc0ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f65ca7fc640 1 -- 172.21.15.72:0/2763307037 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688427789 0 0) 0x7f65cc0b0150 con 0x7f65cc15af20 2024-03-24T10:36:50.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f64f9d9b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64f4053e50 0x7f64f40542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f64fa59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f64f4048100 0x7f64f4006f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49866/0 (socket says 172.21.15.72:49866) 2024-03-24T10:36:50.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f64fa59c640 1 -- 172.21.15.72:0/278091280 learned_addr learned my addr 172.21.15.72:0/278091280 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.759 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f64fad9d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f64f404f930 0x7f64f4037c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41442/0 (socket says 172.21.15.72:41442) 2024-03-24T10:36:50.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb55dfaa640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb5580cf530 0x7fb558162850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49850/0 (socket says 172.21.15.72:49850) 2024-03-24T10:36:50.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb55dfaa640 1 -- 172.21.15.72:0/2441786329 learned_addr learned my addr 172.21.15.72:0/2441786329 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fb55d7a9640 1 --2- 172.21.15.72:0/2441786329 >> v2:172.21.15.79:3300/0 conn(0x7fb55806ca30 0x7fb55806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f65cbfff640 1 --2- 172.21.15.72:0/2763307037 >> v2:172.21.15.72:3300/0 conn(0x7f65cc0cb630 0x7f65cc0ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7f607aaed640 1 Processor -- start 2024-03-24T10:36:50.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.756+0000 7fd17f1d0640 1 Processor -- start 2024-03-24T10:36:50.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2540301079 0 0) 0x7fb55806d3d0 con 0x7fb5580cf530 2024-03-24T10:36:50.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb544003520 con 0x7fb5580cf530 2024-03-24T10:36:50.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f65cbfff640 1 -- 172.21.15.72:0/2763307037 >> v1:172.21.15.72:6789/0 conn(0x7f65cc15af20 legacy=0x7f65cc071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3923802977 0 0) 0x7fb544003520 con 0x7fb5580cf530 2024-03-24T10:36:50.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 >> v2:172.21.15.79:3300/0 conn(0x7fb55806ca30 msgr2=0x7fb55806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 --2- 172.21.15.72:0/2441786329 >> v2:172.21.15.79:3300/0 conn(0x7fb55806ca30 0x7fb55806ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 >> v1:172.21.15.79:6789/0 conn(0x7fb5580b3460 legacy=0x7fb5580b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5581633a0 con 0x7fb5580cf530 2024-03-24T10:36:50.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f65cbfff640 1 -- 172.21.15.72:0/2763307037 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc0cbca0 con 0x7f65cc06eeb0 2024-03-24T10:36:50.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f65cb7fe640 1 --2- 172.21.15.72:0/2763307037 >> v2:172.21.15.72:3300/0 conn(0x7f65cc0cb630 0x7f65cc0ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fd17f1d0640 1 -- start start 2024-03-24T10:36:50.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fca49f87640 1 Processor -- start 2024-03-24T10:36:50.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7fca49f87640 1 -- start start 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7fb5500019f0 con 0x7fb5580cf530 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 >> v1:172.21.15.72:6789/0 conn(0x7fb5580cf530 legacy=0x7fb558162850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb544003970 0x7fb544003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5440047c0 0x7fb544004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544005180 0x7fb54400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb558145680 con 0x7fb5440047c0 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb54400c080 con 0x7fb544005180 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb54400c240 con 0x7fb544003970 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55dfaa640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb544003970 0x7fb544003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55e7ab640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544005180 0x7fb54400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f861347d640 1 Processor -- start 2024-03-24T10:36:50.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f861347d640 1 -- start start 2024-03-24T10:36:50.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f65cbfff640 1 --2- 172.21.15.72:0/2763307037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc06eeb0 0x7f65cc072150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f65cc072b30 tx=0x7f65c002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ff372388fd3faf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f607aaed640 1 -- start start 2024-03-24T10:36:50.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f607aaed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f607aaed640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606c0df4d0 con 0x7f606c0df0f0 2024-03-24T10:36:50.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f607aaed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f606c0535e0 con 0x7f606c053090 2024-03-24T10:36:50.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f607aaed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f606c04f830 con 0x7f606c050170 2024-03-24T10:36:50.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17f1d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17004fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17f1d0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd17004ffc0 0x7fd170037bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f60792ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17f1d0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd170054320 con 0x7fd170038100 2024-03-24T10:36:50.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17f1d0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd170053710 con 0x7fd17004ffc0 2024-03-24T10:36:50.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17f1d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd1700539f0 con 0x7fd1700eacf0 2024-03-24T10:36:50.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17d76d640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fd170038100 0x7fd170038590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41456/0 (socket says 172.21.15.72:41456) 2024-03-24T10:36:50.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f60792ea640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55442/0 (socket says 172.21.15.72:55442) 2024-03-24T10:36:50.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f60792ea640 1 -- 172.21.15.72:0/4277889968 learned_addr learned my addr 172.21.15.72:0/4277889968 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17d76d640 1 -- 172.21.15.72:0/4294389360 learned_addr learned my addr 172.21.15.72:0/4294389360 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133086140 0 0) 0x7f64f4006ae0 con 0x7f64f4048100 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64e4003520 con 0x7f64f4048100 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639649860 0 0) 0x7f64f4005f10 con 0x7f64f404f930 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64f4006ae0 con 0x7f64f404f930 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 983271878 0 0) 0x7f64e4003520 con 0x7f64f4048100 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64f4053e50 msgr2=0x7f64f40542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64f4053e50 0x7f64f40542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 >> v1:172.21.15.79:6789/0 conn(0x7f64f404f930 legacy=0x7f64f4037c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f4053280 con 0x7f64f4048100 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f64fc073b30 con 0x7f64f4048100 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 >> v1:172.21.15.72:6789/0 conn(0x7f64f4048100 legacy=0x7f64f4006f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64e4004b90 0x7f64e4004f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e4003760 0x7f64e4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004120 0x7f64e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40484e0 con 0x7f64e4003760 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64e400bec0 con 0x7f64e4004b90 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.757+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f64e400c080 con 0x7f64e4004120 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64fa59c640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64e4004b90 0x7f64e4004f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64f9d9b640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e4003760 0x7f64e4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64fa59c640 1 -- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004120 msgr2=0x7f64e400b980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-24T10:36:50.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64fa59c640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004120 0x7f64e400b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64fa59c640 1 -- 172.21.15.72:0/278091280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e4003760 msgr2=0x7f64e4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64fa59c640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64e4003760 0x7f64e4003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7f64fa59c640 1 -- 172.21.15.72:0/278091280 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e4003520 con 0x7f64e4004b90 2024-03-24T10:36:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd17cf6c640 1 --2- 172.21.15.72:0/4294389360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17004fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f65ca7fc640 1 -- 172.21.15.72:0/2763307037 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c0030610 con 0x7f65cc06eeb0 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd1777fe640 1 -- 172.21.15.72:0/4294389360 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2779694030 0 0) 0x7fd170054320 con 0x7fd170038100 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f65ca7fc640 1 -- 172.21.15.72:0/2763307037 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c0030770 con 0x7f65cc06eeb0 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca49f87640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca440afd70 0x7fca440c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca49f87640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4406f910 con 0x7fca44072150 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca49f87640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca44162a90 con 0x7fca4406f3c0 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca49f87640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca4406caf0 con 0x7fca440afd70 2024-03-24T10:36:50.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca49786640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca44072150 0x7fca4406b6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49876/0 (socket says 172.21.15.72:49876) 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca49786640 1 -- 172.21.15.72:0/783827969 learned_addr learned my addr 172.21.15.72:0/783827969 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fca48f85640 1 --2- 172.21.15.72:0/783827969 >> v2:172.21.15.72:3300/0 conn(0x7fca440afd70 0x7fca440c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fca48f85640 1 -- 172.21.15.72:0/783827969 >> v1:172.21.15.79:6789/0 conn(0x7fca4406f3c0 legacy=0x7fca44071a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fca48f85640 1 -- 172.21.15.72:0/783827969 >> v1:172.21.15.72:6789/0 conn(0x7fca44072150 legacy=0x7fca4406b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fca48f85640 1 -- 172.21.15.72:0/783827969 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4406cdd0 con 0x7fca440afd70 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f60792ea640 1 -- 172.21.15.72:0/4277889968 >> v1:172.21.15.79:6789/0 conn(0x7f606c053090 legacy=0x7f606c005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f60792ea640 1 -- 172.21.15.72:0/4277889968 >> v1:172.21.15.72:6789/0 conn(0x7f606c0df0f0 legacy=0x7f606c04fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f60792ea640 1 -- 172.21.15.72:0/4277889968 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f606c0538c0 con 0x7f606c050170 2024-03-24T10:36:50.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55dfaa640 1 -- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544005180 msgr2=0x7fb54400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f861347d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c162220 0x7f860c072e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f861347d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f860c070fa0 0x7f860c071430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55dfaa640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544005180 0x7fb54400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f8611c7a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f860c0cc910 0x7f860c165f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41488/0 (socket says 172.21.15.72:41488) 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f8611c7a640 1 -- 172.21.15.72:0/1167605372 learned_addr learned my addr 172.21.15.72:0/1167605372 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f860c0b32d0 con 0x7f860c0cc910 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f860c071970 con 0x7f860c070fa0 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f860c0b2fd0 con 0x7f860c162220 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974411269 0 0) 0x7f860c0b32d0 con 0x7f860c0cc910 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f8003520 con 0x7f860c0cc910 2024-03-24T10:36:50.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f861247b640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c162220 0x7f860c072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55dfaa640 1 -- 172.21.15.72:0/2441786329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5440047c0 msgr2=0x7fb544004c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55dfaa640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5440047c0 0x7fb544004c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f65d0cfc640 1 -- 172.21.15.72:0/2763307037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc06eeb0 msgr2=0x7f65cc072150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f65d0cfc640 1 --2- 172.21.15.72:0/2763307037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc06eeb0 0x7f65cc072150 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f65cc072b30 tx=0x7f65c002b960 comp rx=0 tx=0).stop 2024-03-24T10:36:50.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fd1777fe640 1 -- 172.21.15.72:0/4294389360 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd168003520 con 0x7fd170038100 2024-03-24T10:36:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55dfaa640 1 -- 172.21.15.72:0/2441786329 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb544003520 con 0x7fb544003970 2024-03-24T10:36:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.758+0000 7fb55e7ab640 1 -- 172.21.15.72:0/2441786329 reap_dead start 2024-03-24T10:36:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7fb55dfaa640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb544003970 0x7fb544003d50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb550002230 tx=0x7fb5440057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=629557d9eb215ebc server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55002d720 con 0x7fb544003970 2024-03-24T10:36:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fd177fff640 1 --2- 172.21.15.72:0/4294389360 >> v2:172.21.15.79:3300/0 conn(0x7fd17004ffc0 0x7fd170037bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fd17cf6c640 1 -- 172.21.15.72:0/4294389360 >> v2:172.21.15.79:3300/0 conn(0x7fd17004ffc0 msgr2=0x7fd170037bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fd17cf6c640 1 --2- 172.21.15.72:0/4294389360 >> v2:172.21.15.79:3300/0 conn(0x7fd17004ffc0 0x7fd170037bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fd17cf6c640 1 -- 172.21.15.72:0/4294389360 >> v1:172.21.15.79:6789/0 conn(0x7fd170038100 legacy=0x7fd170038590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.759+0000 7fd17cf6c640 1 -- 172.21.15.72:0/4294389360 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd170053cd0 con 0x7fd1700eacf0 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7fb55cfa8640 1 -- 172.21.15.72:0/2441786329 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb55002d880 con 0x7fb544003970 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f65d0cfc640 1 -- 172.21.15.72:0/2763307037 shutdown_connections 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f65d0cfc640 1 --2- 172.21.15.72:0/2763307037 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc06eeb0 0x7f65cc072150 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f65d0cfc640 1 --2- 172.21.15.72:0/2763307037 >> v2:172.21.15.72:3300/0 conn(0x7f65cc0cb630 0x7f65cc0ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f65d0cfc640 1 -- 172.21.15.72:0/2763307037 >> 172.21.15.72:0/2763307037 conn(0x7f65cc0cd4a0 msgr2=0x7f65cc0cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f64fa59c640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64e4004b90 0x7f64e4004f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64fc07ae10 tx=0x7f64e40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46a4b9a5369e67c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc06c050 con 0x7f64e4004b90 2024-03-24T10:36:50.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc0bb070 con 0x7f64e4004b90 2024-03-24T10:36:50.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f64f959a640 1 -- 172.21.15.72:0/278091280 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0bf680 con 0x7f64e4004b90 2024-03-24T10:36:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7fd17cf6c640 1 --2- 172.21.15.72:0/4294389360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17004fa80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0097a0 tx=0x7fd16c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a5dc60f7b90686 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f60792ea640 1 --2- 172.21.15.72:0/4277889968 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0e00f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f607407a520 tx=0x7f60740ab580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e23cf9ff19917ae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7fca48f85640 1 --2- 172.21.15.72:0/783827969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440afd70 0x7fca440c39e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca340097a0 tx=0x7fca3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64600f532b9d9632 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6078ae9640 1 -- 172.21.15.72:0/4277889968 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607406e600 con 0x7f606c050170 2024-03-24T10:36:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6078ae9640 1 -- 172.21.15.72:0/4277889968 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60740ae050 con 0x7f606c050170 2024-03-24T10:36:50.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7fd1777fe640 1 -- 172.21.15.72:0/4294389360 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c02d040 con 0x7fd1700eacf0 2024-03-24T10:36:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fd1777fe640 1 -- 172.21.15.72:0/4294389360 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c031810 con 0x7fd1700eacf0 2024-03-24T10:36:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fd1777fe640 1 -- 172.21.15.72:0/4294389360 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c031ba0 con 0x7fd1700eacf0 2024-03-24T10:36:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6078ae9640 1 -- 172.21.15.72:0/4277889968 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607406e9e0 con 0x7f606c050170 2024-03-24T10:36:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fca437fe640 1 -- 172.21.15.72:0/783827969 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34031830 con 0x7fca440afd70 2024-03-24T10:36:50.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fca437fe640 1 -- 172.21.15.72:0/783827969 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca34031990 con 0x7fca440afd70 2024-03-24T10:36:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fca437fe640 1 -- 172.21.15.72:0/783827969 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34031d20 con 0x7fca440afd70 2024-03-24T10:36:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6500f56640 1 -- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64e4004b90 msgr2=0x7f64e4004f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6500f56640 1 --2- 172.21.15.72:0/278091280 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64e4004b90 0x7f64e4004f70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64fc07ae10 tx=0x7f64e40057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f64fad9d640 1 -- 172.21.15.72:0/278091280 reap_dead start 2024-03-24T10:36:50.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb13fa15640 1 Processor -- start 2024-03-24T10:36:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb56020e640 1 -- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb544003970 msgr2=0x7fb544003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb56020e640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb544003970 0x7fb544003d50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb550002230 tx=0x7fb5440057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f65d0cfc640 1 -- 172.21.15.72:0/2763307037 shutdown_connections 2024-03-24T10:36:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8612c7c640 1 --2- 172.21.15.72:0/1167605372 >> v2:172.21.15.79:3300/0 conn(0x7f860c070fa0 0x7f860c071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 480293856 0 0) 0x7f85f8003520 con 0x7f860c0cc910 2024-03-24T10:36:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c162220 msgr2=0x7f860c072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f860c162220 0x7f860c072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 >> v2:172.21.15.79:3300/0 conn(0x7f860c070fa0 msgr2=0x7f860c071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 --2- 172.21.15.72:0/1167605372 >> v2:172.21.15.79:3300/0 conn(0x7f860c070fa0 0x7f860c071430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.760+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 --> v1:172.21.15.79:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c1667a0 con 0x7f860c0cc910 2024-03-24T10:36:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 <== mon.1 v1:172.21.15.79:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f86040019f0 con 0x7f860c0cc910 2024-03-24T10:36:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 >> v1:172.21.15.79:6789/0 conn(0x7f860c0cc910 legacy=0x7f860c165f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8003970 0x7f85f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f85f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85f8005180 0x7f85f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f860c071970 con 0x7f85f8003970 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f860c0b2fd0 con 0x7f85f8005180 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f85f801ced0 con 0x7f85f80047c0 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8612c7c640 1 --2- 172.21.15.72:0/1167605372 >> v2:172.21.15.79:3300/0 conn(0x7f860c070fa0 0x7f860c071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611c7a640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f85f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8612c7c640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85f8005180 0x7f85f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6500f56640 1 -- 172.21.15.72:0/278091280 shutdown_connections 2024-03-24T10:36:50.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f6500f56640 1 -- 172.21.15.72:0/278091280 >> 172.21.15.72:0/278091280 conn(0x7f64f4009fe0 msgr2=0x7f64f400a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb56020e640 1 -- 172.21.15.72:0/2441786329 shutdown_connections 2024-03-24T10:36:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb56020e640 1 --2- 172.21.15.72:0/2441786329 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb544003970 0x7fb544003d50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb56020e640 1 -- 172.21.15.72:0/2441786329 >> 172.21.15.72:0/2441786329 conn(0x7fb5580b1710 msgr2=0x7fb5580b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f65d0cfc640 1 -- 172.21.15.72:0/2763307037 wait complete. 2024-03-24T10:36:50.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611c7a640 1 -- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85f8005180 msgr2=0x7f85f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611c7a640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85f8005180 0x7f85f800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f607aaed640 1 -- 172.21.15.72:0/4277889968 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 msgr2=0x7f606c0e00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f607aaed640 1 --2- 172.21.15.72:0/4277889968 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0e00f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f607407a520 tx=0x7f60740ab580 comp rx=0 tx=0).stop 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f607aaed640 1 -- 172.21.15.72:0/4277889968 shutdown_connections 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f607aaed640 1 --2- 172.21.15.72:0/4277889968 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0e00f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f607aaed640 1 -- 172.21.15.72:0/4277889968 >> 172.21.15.72:0/4277889968 conn(0x7f606c009fa0 msgr2=0x7f606c00a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611c7a640 1 -- 172.21.15.72:0/1167605372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8003970 msgr2=0x7f85f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:50.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611c7a640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f8003970 0x7f85f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7f8611c7a640 1 -- 172.21.15.72:0/1167605372 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f8003520 con 0x7f85f80047c0 2024-03-24T10:36:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.761+0000 7fb13fa15640 1 -- start start 2024-03-24T10:36:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fd17f1d0640 1 -- 172.21.15.72:0/4294389360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 msgr2=0x7fd17004fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fd17f1d0640 1 --2- 172.21.15.72:0/4294389360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17004fa80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0097a0 tx=0x7fd16c02b8b0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fb56020e640 1 -- 172.21.15.72:0/2441786329 shutdown_connections 2024-03-24T10:36:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f607aaed640 1 -- 172.21.15.72:0/4277889968 shutdown_connections 2024-03-24T10:36:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f607aaed640 1 -- 172.21.15.72:0/4277889968 wait complete. 2024-03-24T10:36:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fd17f1d0640 1 -- 172.21.15.72:0/4294389360 shutdown_connections 2024-03-24T10:36:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fd17f1d0640 1 --2- 172.21.15.72:0/4294389360 >> v2:172.21.15.79:3300/0 conn(0x7fd17004ffc0 0x7fd170037bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fd17f1d0640 1 --2- 172.21.15.72:0/4294389360 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17004fa80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fd17f1d0640 1 -- 172.21.15.72:0/4294389360 >> 172.21.15.72:0/4294389360 conn(0x7fd170009fa0 msgr2=0x7fd17000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f6500f56640 1 -- 172.21.15.72:0/278091280 shutdown_connections 2024-03-24T10:36:50.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fb56020e640 1 -- 172.21.15.72:0/2441786329 wait complete. 2024-03-24T10:36:50.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f8611c7a640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f85f8004c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f860400a7b0 tx=0x7f85f80057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d33b43e3e2e2b511 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fca49f87640 1 -- 172.21.15.72:0/783827969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440afd70 msgr2=0x7fca440c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fca49f87640 1 --2- 172.21.15.72:0/783827969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440afd70 0x7fca440c39e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fca340097a0 tx=0x7fca3402b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fca49f87640 1 -- 172.21.15.72:0/783827969 shutdown_connections 2024-03-24T10:36:50.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fca49f87640 1 --2- 172.21.15.72:0/783827969 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440afd70 0x7fca440c39e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604034630 con 0x7f85f80047c0 2024-03-24T10:36:50.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f860402f070 con 0x7f85f80047c0 2024-03-24T10:36:50.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f8611479640 1 -- 172.21.15.72:0/1167605372 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604034a70 con 0x7f85f80047c0 2024-03-24T10:36:50.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fca49f87640 1 -- 172.21.15.72:0/783827969 >> 172.21.15.72:0/783827969 conn(0x7fca440cd4a0 msgr2=0x7fca440cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7fca49f87640 1 -- 172.21.15.72:0/783827969 shutdown_connections 2024-03-24T10:36:50.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fca49f87640 1 -- 172.21.15.72:0/783827969 wait complete. 2024-03-24T10:36:50.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fb13fa15640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1380b4060 0x7fb1381632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fb13fa15640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb13806ca30 0x7fb13806ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f607aaed640 1 Processor -- start 2024-03-24T10:36:50.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f607aaed640 1 -- start start 2024-03-24T10:36:50.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f65d0cfc640 1 Processor -- start 2024-03-24T10:36:50.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f65d0cfc640 1 -- start start 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.762+0000 7f6500f56640 1 -- 172.21.15.72:0/278091280 wait complete. 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f6500f56640 1 Processor -- start 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 msgr2=0x7f85f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7f861347d640 1 --2- 172.21.15.72:0/1167605372 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f85f8004c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f860400a7b0 tx=0x7f85f80057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f8612c7c640 1 -- 172.21.15.72:0/1167605372 reap_dead start 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 shutdown_connections 2024-03-24T10:36:50.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 >> 172.21.15.72:0/1167605372 conn(0x7f860c06d1e0 msgr2=0x7f860c06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fb13cfb0640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fb13806eb00 0x7fb138071fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41498/0 (socket says 172.21.15.72:41498) 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fb13d7b1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1380b4060 0x7fb1381632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fb13d7b1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb1380b4060 0x7fb1381632b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49148/0 (socket says 172.21.15.72:49148) 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13cfb0640 1 -- 172.21.15.72:0/745166152 learned_addr learned my addr 172.21.15.72:0/745166152 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb13806d3c0 con 0x7fb13806eb00 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb1381637f0 con 0x7fb13806ca30 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb138070f40 con 0x7fb1380b4060 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb12ffff640 1 -- 172.21.15.72:0/745166152 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364419526 0 0) 0x7fb128001110 con 0x7fb13806eb00 2024-03-24T10:36:50.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fd17f1d0640 1 -- 172.21.15.72:0/4294389360 shutdown_connections 2024-03-24T10:36:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb12ffff640 1 -- 172.21.15.72:0/745166152 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb124003520 con 0x7fb13806eb00 2024-03-24T10:36:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fca49f87640 1 Processor -- start 2024-03-24T10:36:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13d7b1640 1 -- 172.21.15.72:0/745166152 >> v2:172.21.15.72:3300/0 conn(0x7fb13806ca30 msgr2=0x7fb13806ce80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13d7b1640 1 --2- 172.21.15.72:0/745166152 >> v2:172.21.15.72:3300/0 conn(0x7fb13806ca30 0x7fb13806ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13d7b1640 1 -- 172.21.15.72:0/745166152 >> v1:172.21.15.79:6789/0 conn(0x7fb13806eb00 legacy=0x7fb138071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb13d7b1640 1 -- 172.21.15.72:0/745166152 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb138071220 con 0x7fb1380b4060 2024-03-24T10:36:50.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f607aaed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f607aaed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f606c053090 0x7f606c0dbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607aaed640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f606c0df0f0 0x7f606c0dc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607aaed640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f606c04e690 con 0x7f606c0df0f0 2024-03-24T10:36:50.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607aaed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f606c048760 con 0x7f606c053090 2024-03-24T10:36:50.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607aaed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f606c048a40 con 0x7f606c050170 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65d0cfc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65cc06eeb0 0x7f65cc14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65d0cfc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0cb630 0x7f65cc15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65d0cfc640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65cc15af20 0x7f65cc0b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65caffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0cb630 0x7f65cc15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f6079aeb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607a2ec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f606c0df0f0 0x7f606c0dc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65caffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0cb630 0x7f65cc15cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49162/0 (socket says 172.21.15.72:49162) 2024-03-24T10:36:50.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f6079aeb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55466/0 (socket says 172.21.15.72:55466) 2024-03-24T10:36:50.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f6079aeb640 1 -- 172.21.15.72:0/1209289047 learned_addr learned my addr 172.21.15.72:0/1209289047 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f60792ea640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f606c053090 0x7f606c0dbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65caffd640 1 -- 172.21.15.72:0/3756746985 learned_addr learned my addr 172.21.15.72:0/3756746985 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fca49f87640 1 -- start start 2024-03-24T10:36:50.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc14a7b0 con 0x7f65cc06eeb0 2024-03-24T10:36:50.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc14b030 con 0x7f65cc0cb630 2024-03-24T10:36:50.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc15d240 con 0x7f65cc15af20 2024-03-24T10:36:50.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7f6500f56640 1 -- start start 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb56020e640 1 Processor -- start 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.764+0000 7fb56020e640 1 -- start start 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb56020e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544003970 0x7fb558140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb56020e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb558142c60 0x7fb5580a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb56020e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5580a9970 0x7fb558148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb56020e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb5580a9df0 con 0x7fb558142c60 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb56020e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5581f7cb0 con 0x7fb544003970 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb56020e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb55814a070 con 0x7fb5580a9970 2024-03-24T10:36:50.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55dfaa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544003970 0x7fb558140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55dfaa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544003970 0x7fb558140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49186/0 (socket says 172.21.15.72:49186) 2024-03-24T10:36:50.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55dfaa640 1 -- 172.21.15.72:0/739296513 learned_addr learned my addr 172.21.15.72:0/739296513 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55e7ab640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5580a9970 0x7fb558148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f6500f56640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004b90 0x7f64f40e9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607a2ec640 1 -- 172.21.15.72:0/1209289047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 msgr2=0x7f606c0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607a2ec640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f606c050170 0x7f606c0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607a2ec640 1 -- 172.21.15.72:0/1209289047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f606c053090 msgr2=0x7f606c0dbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607a2ec640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f606c053090 0x7f606c0dbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f607a2ec640 1 -- 172.21.15.72:0/1209289047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6074073b30 con 0x7f606c0df0f0 2024-03-24T10:36:50.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55e7ab640 1 -- 172.21.15.72:0/739296513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544003970 msgr2=0x7fb558140f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f607a2ec640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f606c0df0f0 0x7f606c0dc110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f606400c3c0 tx=0x7f606400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f6500f56640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64f40d8230 0x7f64f4046f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fa59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004b90 0x7f64f40e9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fa59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004b90 0x7f64f40e9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55484/0 (socket says 172.21.15.72:55484) 2024-03-24T10:36:50.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb13d7b1640 1 --2- 172.21.15.72:0/745166152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1380b4060 0x7fb1381632b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1380b4770 tx=0x7fb13402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba3d51e036a2589f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f6500f56640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f40474a0 0x7f64f40d6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49f87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca4406f3c0 0x7fca440c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49f87640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca44072150 0x7fca440b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49f87640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440c4530 0x7fca44163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fa59c640 1 -- 172.21.15.72:0/3581951140 learned_addr learned my addr 172.21.15.72:0/3581951140 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55e7ab640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb544003970 0x7fb558140f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55e7ab640 1 -- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb558142c60 msgr2=0x7fb5580a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55e7ab640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb558142c60 0x7fb5580a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fb55e7ab640 1 -- 172.21.15.72:0/739296513 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb558149420 con 0x7fb5580a9970 2024-03-24T10:36:50.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49f87640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca441fc7f0 con 0x7fca440c4530 2024-03-24T10:36:50.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49f87640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca440b6570 con 0x7fca44072150 2024-03-24T10:36:50.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49f87640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fca441fbee0 con 0x7fca4406f3c0 2024-03-24T10:36:50.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb55e7ab640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5580a9970 0x7fb558148840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5580737f0 tx=0x7fb55400e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40d5190 con 0x7f64f40d8230 2024-03-24T10:36:50.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64f40d5470 con 0x7f64f40474a0 2024-03-24T10:36:50.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f64f40d5750 con 0x7f64e4004b90 2024-03-24T10:36:50.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fad9d640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f40474a0 0x7f64f40d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60640052d0 con 0x7f606c0df0f0 2024-03-24T10:36:50.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6064005430 con 0x7f606c0df0f0 2024-03-24T10:36:50.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064007260 con 0x7f606c0df0f0 2024-03-24T10:36:50.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb12ffff640 1 -- 172.21.15.72:0/745166152 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134031870 con 0x7fb1380b4060 2024-03-24T10:36:50.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f607aaed640 1 -- 172.21.15.72:0/1209289047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f606c048d20 con 0x7f606c0df0f0 2024-03-24T10:36:50.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f607aaed640 1 -- 172.21.15.72:0/1209289047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f606c04d930 con 0x7f606c0df0f0 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f65caffd640 1 -- 172.21.15.72:0/3756746985 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65cc15af20 msgr2=0x7f65cc0b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f65caffd640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65cc15af20 0x7f65cc0b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f65caffd640 1 -- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65cc06eeb0 msgr2=0x7f65cc14f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f65caffd640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65cc06eeb0 0x7f65cc14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f65caffd640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c4009a70 con 0x7f65cc0cb630 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f65caffd640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0cb630 0x7f65cc15cd00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c3f0 tx=0x7f65bc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fa59c640 1 -- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f40474a0 msgr2=0x7f64f40d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fa59c640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64f40474a0 0x7f64f40d6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7f64fa59c640 1 -- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64f40d8230 msgr2=0x7f64f4046f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64f9d9b640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64f40d8230 0x7f64f4046f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64fa59c640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64f40d8230 0x7f64f4046f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64fa59c640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f40d5a30 con 0x7f64e4004b90 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64f9d9b640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64f40d8230 0x7f64f4046f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64fa59c640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004b90 0x7f64f40e9750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64fc02d6c0 tx=0x7f64fc07ac10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0cb640 con 0x7f64e4004b90 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64fc0cb7a0 con 0x7f64e4004b90 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0cbb10 con 0x7f64e4004b90 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f40d5d10 con 0x7f64e4004b90 2024-03-24T10:36:50.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb12ffff640 1 -- 172.21.15.72:0/745166152 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1340319d0 con 0x7fb1380b4060 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb12ffff640 1 -- 172.21.15.72:0/745166152 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb134031da0 con 0x7fb1380b4060 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1380b4060 msgr2=0x7fb1381632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.763+0000 7fd17f1d0640 1 -- 172.21.15.72:0/4294389360 wait complete. 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fd17f1d0640 1 Processor -- start 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7fd17f1d0640 1 -- start start 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17f1d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd170038100 0x7fd17019e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17f1d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17004ffc0 0x7fd17003a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17f1d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17003a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17f1d0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd1701a19e0 con 0x7fd170038100 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17f1d0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1701a0d60 con 0x7fd17004ffc0 2024-03-24T10:36:50.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17f1d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd1701a1040 con 0x7fd1700eacf0 2024-03-24T10:36:50.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd177fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17004ffc0 0x7fd17003a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17cf6c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd170038100 0x7fd17019e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd177fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17004ffc0 0x7fd17003a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49206/0 (socket says 172.21.15.72:49206) 2024-03-24T10:36:50.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd17cf6c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd170038100 0x7fd17019e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33382/0 (socket says 172.21.15.72:33382) 2024-03-24T10:36:50.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fd177fff640 1 -- 172.21.15.72:0/1416571918 learned_addr learned my addr 172.21.15.72:0/1416571918 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fb13fa15640 1 --2- 172.21.15.72:0/745166152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1380b4060 0x7fb1381632b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb1380b4770 tx=0x7fb13402b910 comp rx=0 tx=0).stop 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49786640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440c4530 0x7fca44163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49786640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440c4530 0x7fca44163ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33368/0 (socket says 172.21.15.72:33368) 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca49786640 1 -- 172.21.15.72:0/3281551692 learned_addr learned my addr 172.21.15.72:0/3281551692 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fca43fff640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca44072150 0x7fca440b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca43fff640 1 -- 172.21.15.72:0/3281551692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca4406f3c0 msgr2=0x7fca440c70f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca43fff640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca4406f3c0 0x7fca440c70f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fd17cf6c640 1 -- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 msgr2=0x7fd17003a850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-24T10:36:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fd17cf6c640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1700eacf0 0x7fd17003a850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0074e0 con 0x7f65cc0cb630 2024-03-24T10:36:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fd17cf6c640 1 -- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17004ffc0 msgr2=0x7fd17003a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fd17cf6c640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd17004ffc0 0x7fd17003a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fd17cf6c640 1 -- 172.21.15.72:0/1416571918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd16c009400 con 0x7fd170038100 2024-03-24T10:36:50.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca43fff640 1 -- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440c4530 msgr2=0x7fca44163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca43fff640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440c4530 0x7fca44163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca43fff640 1 -- 172.21.15.72:0/3281551692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca34009400 con 0x7fca44072150 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca49786640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca440c4530 0x7fca44163ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7fca43fff640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca44072150 0x7fca440b6030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c410 tx=0x7fca3800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380035f0 con 0x7fca44072150 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca440c77d0 con 0x7fca44072150 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca441fc480 con 0x7fca44072150 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55400ee90 con 0x7fb5580a9970 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb558149780 con 0x7fb5580a9970 2024-03-24T10:36:50.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.766+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb558149a20 con 0x7fb5580a9970 2024-03-24T10:36:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f40e9e70 con 0x7f64e4004b90 2024-03-24T10:36:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f64f4006490 con 0x7f64e4004b90 2024-03-24T10:36:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb5580b2f40 con 0x7fb5580a9970 2024-03-24T10:36:50.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f607aaed640 1 -- 172.21.15.72:0/1209289047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f606c0488d0 con 0x7f606c0df0f0 2024-03-24T10:36:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 shutdown_connections 2024-03-24T10:36:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb13fa15640 1 --2- 172.21.15.72:0/745166152 >> v2:172.21.15.72:3300/0 conn(0x7fb13806ca30 0x7fb13806ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb13fa15640 1 --2- 172.21.15.72:0/745166152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb1380b4060 0x7fb1381632b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca38003750 con 0x7fca44072150 2024-03-24T10:36:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380035f0 con 0x7fca44072150 2024-03-24T10:36:50.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 shutdown_connections 2024-03-24T10:36:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.765+0000 7f861347d640 1 -- 172.21.15.72:0/1167605372 wait complete. 2024-03-24T10:36:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 >> 172.21.15.72:0/745166152 conn(0x7fb1380b1710 msgr2=0x7fb1380b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c0009400 con 0x7f65cc0cb630 2024-03-24T10:36:50.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc14a9e0 con 0x7f65cc0cb630 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f861347d640 1 Processor -- start 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.767+0000 7f861347d640 1 -- start start 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7f861347d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f860c0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.768+0000 7f861347d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f860c0b2170 0x7f860c164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f861347d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c164940 0x7f860c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f861347d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f860c2047b0 con 0x7f860c0b2170 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f861347d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f860c164df0 con 0x7f860c164940 2024-03-24T10:36:50.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f861347d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f860c203b30 con 0x7f85f80047c0 2024-03-24T10:36:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fd17cf6c640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd170038100 0x7fd17019e3a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd16c033000 tx=0x7fd16c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc007640 con 0x7f65cc0cb630 2024-03-24T10:36:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc004a00 con 0x7f65cc0cb630 2024-03-24T10:36:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c164940 0x7f860c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8611c7a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f860c0b2170 0x7f860c164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c164940 0x7f860c0afba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49222/0 (socket says 172.21.15.72:49222) 2024-03-24T10:36:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 -- 172.21.15.72:0/2081570590 learned_addr learned my addr 172.21.15.72:0/2081570590 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f861247b640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f860c0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5540052e0 con 0x7fb5580a9970 2024-03-24T10:36:50.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb554003830 con 0x7fb5580a9970 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f60640073c0 con 0x7f606c0df0f0 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f606a7fc640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f605806b8e0 0x7f605806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65cc0cc540 con 0x7f65cc0cb630 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 -- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 msgr2=0x7f860c0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f85f80047c0 0x7f860c0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 -- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f860c0b2170 msgr2=0x7f860c164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f860c0b2170 0x7f860c164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7f8612c7c640 1 -- 172.21.15.72:0/2081570590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f860c203e10 con 0x7f860c164940 2024-03-24T10:36:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f8612c7c640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c164940 0x7f860c0afba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f860c050500 tx=0x7f8608010c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 shutdown_connections 2024-03-24T10:36:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f64fc0bd070 con 0x7f64e4004b90 2024-03-24T10:36:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f64eaffd640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f64dc06b8e0 0x7f64dc06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f64fc1381f0 con 0x7f64e4004b90 2024-03-24T10:36:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f64eaffd640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] conn(0x7f64dc074fe0 0x7f64dc077420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64dc077af0 con 0x7f64dc074fe0 2024-03-24T10:36:50.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6064089720 con 0x7f606c0df0f0 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f606a7fc640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] conn(0x7f6058074fd0 0x7f6058077410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 --> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6058077ae0 con 0x7f6058074fd0 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.770+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6064053e90 con 0x7f606c0df0f0 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c03ace0 con 0x7fd170038100 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd16c03ae80 con 0x7fd170038100 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd16c044630 con 0x7fd170038100 2024-03-24T10:36:50.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1701a1320 con 0x7fd170038100 2024-03-24T10:36:50.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f6079aeb640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f605806b8e0 0x7f605806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.769+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1701a1e00 con 0x7fd170038100 2024-03-24T10:36:50.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fca380038c0 con 0x7fca44072150 2024-03-24T10:36:50.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f64f9d9b640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f64dc06b8e0 0x7f64dc06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f64fad9d640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] conn(0x7f64dc074fe0 0x7f64dc077420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64fc06c020 con 0x7f64e4004b90 2024-03-24T10:36:50.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd158001030 con 0x7fd170038100 2024-03-24T10:36:50.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f6079aeb640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f605806b8e0 0x7f605806dda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6070001770 tx=0x7f6070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7fca417fa640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3006b8a0 0x7fca3006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608004440 con 0x7f860c164940 2024-03-24T10:36:50.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8608010e70 con 0x7f860c164940 2024-03-24T10:36:50.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8608003810 con 0x7f860c164940 2024-03-24T10:36:50.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca440c4150 con 0x7fca44072150 2024-03-24T10:36:50.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f64f9d9b640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f64dc06b8e0 0x7f64dc06dda0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64f4039900 tx=0x7f64f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7fca48f85640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3006b8a0 0x7fca3006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.771+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f65bc004b60 con 0x7f65cc0cb630 2024-03-24T10:36:50.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd16c04d450 con 0x7fd170038100 2024-03-24T10:36:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f60792ea640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] conn(0x7f6058074fd0 0x7f6058077410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f65b3fff640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65b806b8e0 0x7f65b806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65bc08ab20 con 0x7f65cc0cb630 2024-03-24T10:36:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f65b3fff640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] conn(0x7f65b8075060 0x7f65b80774a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65b8077b70 con 0x7f65b8075060 2024-03-24T10:36:50.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65bc08aed0 con 0x7f65cc0cb630 2024-03-24T10:36:50.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fb13fa15640 1 -- 172.21.15.72:0/745166152 wait complete. 2024-03-24T10:36:50.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f65cb7fe640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65b806b8e0 0x7f65b806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f64fad9d640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] conn(0x7f64dc074fe0 0x7f64dc077420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fd1757fa640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd15c06b8e0 0x7fd15c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca38057a90 con 0x7fca44072150 2024-03-24T10:36:50.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fca48f85640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3006b8a0 0x7fca3006dd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca34036000 tx=0x7fca34008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f861347d640 1 -- 172.21.15.72:0/2081570590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860c2040f0 con 0x7f860c164940 2024-03-24T10:36:50.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7f861347d640 1 -- 172.21.15.72:0/2081570590 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860c0b00e0 con 0x7f860c164940 2024-03-24T10:36:50.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fca417fa640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] conn(0x7fca30075be0 0x7fca30078080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.772+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 --> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca30078750 con 0x7fca30075be0 2024-03-24T10:36:50.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd16c0ac730 con 0x7fd170038100 2024-03-24T10:36:50.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7f60792ea640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] conn(0x7f6058074fd0 0x7f6058077410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fca49786640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] conn(0x7fca30075be0 0x7fca30078080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7f65cbfff640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] conn(0x7f65b8075060 0x7f65b80774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fca38057860 con 0x7fca44072150 2024-03-24T10:36:50.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb554003990 con 0x7fb5580a9970 2024-03-24T10:36:50.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fd1757fa640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] conn(0x7fd15c075060 0x7fd15c0774a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fd177fff640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd15c06b8e0 0x7fd15c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 --> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd15c077b70 con 0x7fd15c075060 2024-03-24T10:36:50.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd16c0aed50 con 0x7fd170038100 2024-03-24T10:36:50.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fb54e7fc640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb53c06b910 0x7fb53c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7f65cbfff640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] conn(0x7f65b8075060 0x7f65b80774a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fd17d76d640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] conn(0x7fd15c075060 0x7fd15c0774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb55408a0a0 con 0x7fb5580a9970 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.773+0000 7fb55dfaa640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb53c06b910 0x7fb53c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fb54e7fc640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] conn(0x7fb53c075090 0x7fb53c0774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 --> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb53c077ba0 con 0x7fb53c075090 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb55408a450 con 0x7fb5580a9970 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fca49786640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] conn(0x7fca30075be0 0x7fca30078080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fb55d7a9640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] conn(0x7fb53c075090 0x7fb53c0774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== osd.1 v2:172.21.15.72:6800/1209031598 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6058077ae0 con 0x7f6058074fd0 2024-03-24T10:36:50.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fb13fa15640 1 Processor -- start 2024-03-24T10:36:50.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7f65cb7fe640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65b806b8e0 0x7f65b806dda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65c400e2b0 tx=0x7f65c400d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fb13fa15640 1 -- start start 2024-03-24T10:36:50.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8608003970 con 0x7f860c164940 2024-03-24T10:36:50.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== osd.4 v2:172.21.15.79:6800/4199586883 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f64dc077af0 con 0x7f64dc074fe0 2024-03-24T10:36:50.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7f8602ffd640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f85f006b860 0x7f85f006dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.774+0000 7fd177fff640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd15c06b8e0 0x7fd15c06dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd178069830 tx=0x7fd17806af90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7fb55dfaa640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb53c06b910 0x7fb53c06ddd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb550004bf0 tx=0x7fb55003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8608089ca0 con 0x7f860c164940 2024-03-24T10:36:50.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7fb55d7a9640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] conn(0x7fb53c075090 0x7fb53c0774d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== osd.3 v2:172.21.15.72:6808/3747177009 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca30078750 con 0x7fca30075be0 2024-03-24T10:36:50.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7fd17d76d640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] conn(0x7fd15c075060 0x7fd15c0774a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== osd.2 v2:172.21.15.72:6824/3225387403 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65b8077b70 con 0x7f65b8075060 2024-03-24T10:36:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7f861247b640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f85f006b860 0x7f85f006dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7fb13fa15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb13806ca30 0x7fb138146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.775+0000 7fb13fa15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13806eb00 0x7fb1381fc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13d7b1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb13806ca30 0x7fb138146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13fa15640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1380b4060 0x7fb1381f86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13d7b1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb13806ca30 0x7fb138146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33400/0 (socket says 172.21.15.72:33400) 2024-03-24T10:36:50.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7f861347d640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] conn(0x7f860c0b0330 0x7f860c061b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13d7b1640 1 -- 172.21.15.72:0/1903581485 learned_addr learned my addr 172.21.15.72:0/1903581485 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:50.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== osd.7 v2:172.21.15.79:6816/1471205760 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd15c077b70 con 0x7fd15c075060 2024-03-24T10:36:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb1381f9250 con 0x7fb13806ca30 2024-03-24T10:36:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb1381f9530 con 0x7fb13806eb00 2024-03-24T10:36:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb1381fbc90 con 0x7fb1380b4060 2024-03-24T10:36:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13cfb0640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13806eb00 0x7fb1381fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13dfb2640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1380b4060 0x7fb1381f86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7f861347d640 1 -- 172.21.15.72:0/2081570590 --> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f860c2048f0 con 0x7f860c0b0330 2024-03-24T10:36:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7f861247b640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f85f006b860 0x7f85f006dd20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f860c073450 tx=0x7f85fc009590 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7f8611c7a640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] conn(0x7f860c0b0330 0x7f860c061b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== osd.0 v2:172.21.15.72:6810/1231953304 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb53c077ba0 con 0x7fb53c075090 2024-03-24T10:36:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13cfb0640 1 -- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1380b4060 msgr2=0x7fb1381f86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13cfb0640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb1380b4060 0x7fb1381f86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.852 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13cfb0640 1 -- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb13806ca30 msgr2=0x7fb138146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13cfb0640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb13806ca30 0x7fb138146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13cfb0640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb134009400 con 0x7fb13806eb00 2024-03-24T10:36:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7fb13d7b1640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb13806ca30 0x7fb138146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.776+0000 7f8611c7a640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] conn(0x7f860c0b0330 0x7f860c061b50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.777+0000 7fb13cfb0640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13806eb00 0x7fb1381fc770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c390 tx=0x7fb12800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.777+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb128005ce0 con 0x7fb13806eb00 2024-03-24T10:36:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.777+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb128005e40 con 0x7fb13806eb00 2024-03-24T10:36:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.777+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1280072f0 con 0x7fb13806eb00 2024-03-24T10:36:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.777+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1381fbf70 con 0x7fb13806eb00 2024-03-24T10:36:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.777+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb13815d130 con 0x7fb13806eb00 2024-03-24T10:36:50.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.778+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== osd.5 v2:172.21.15.79:6808/2108585497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f860c2048f0 con 0x7f860c0b0330 2024-03-24T10:36:50.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.780+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb138071ac0 con 0x7fb13806eb00 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.780+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb128007450 con 0x7fb13806eb00 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.781+0000 7fb12dffb640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb11c06b810 0x7fb11c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.781+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb1280898f0 con 0x7fb13806eb00 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.781+0000 7fb13d7b1640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb11c06b810 0x7fb11c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.781+0000 7fb12dffb640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] conn(0x7fb11c074f10 0x7fb11c077350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.781+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb11c077a20 con 0x7fb11c074f10 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.781+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb128053fe0 con 0x7fb13806eb00 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.782+0000 7fb13dfb2640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] conn(0x7fb11c074f10 0x7fb11c077350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.782+0000 7fb13dfb2640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] conn(0x7fb11c074f10 0x7fb11c077350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.783+0000 7fb13d7b1640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb11c06b810 0x7fb11c06dcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb134000c00 tx=0x7fb13403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:50.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.783+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== osd.6 v2:172.21.15.79:6824/1786021323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb11c077a20 con 0x7fb11c074f10 2024-03-24T10:36:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.805+0000 7f607aaed640 1 -- 172.21.15.72:0/1209289047 --> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f606c0075f0 con 0x7f6058074fd0 2024-03-24T10:36:50.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.805+0000 7f606a7fc640 1 -- 172.21.15.72:0/1209289047 <== osd.1 v2:172.21.15.72:6800/1209031598 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f606c0075f0 con 0x7f6058074fd0 2024-03-24T10:36:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.806+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] conn(0x7f6058074fd0 msgr2=0x7f6058077410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.806+0000 7f6057fff640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6800/1209031598,v1:172.21.15.72:6801/1209031598] conn(0x7f6058074fd0 0x7f6058077410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f605806b8e0 msgr2=0x7f605806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6057fff640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f605806b8e0 0x7f605806dda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6070001770 tx=0x7f6070009040 comp rx=0 tx=0).stop 2024-03-24T10:36:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f606c0df0f0 msgr2=0x7f606c0dc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6057fff640 1 --2- 172.21.15.72:0/1209289047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f606c0df0f0 0x7f606c0dc110 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f606400c3c0 tx=0x7f606400c880 comp rx=0 tx=0).stop 2024-03-24T10:36:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f607a2ec640 1 -- 172.21.15.72:0/1209289047 reap_dead start 2024-03-24T10:36:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 shutdown_connections 2024-03-24T10:36:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 >> 172.21.15.72:0/1209289047 conn(0x7f606c009fa0 msgr2=0x7f606c0048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f6500f56640 1 -- 172.21.15.72:0/3581951140 --> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64f40e7b90 con 0x7f64dc074fe0 2024-03-24T10:36:50.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 --> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca4406b1d0 con 0x7fca30075be0 2024-03-24T10:36:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.808+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 shutdown_connections 2024-03-24T10:36:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.807+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 --> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65cc0cc260 con 0x7f65b8075060 2024-03-24T10:36:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.808+0000 7f6057fff640 1 -- 172.21.15.72:0/1209289047 wait complete. 2024-03-24T10:36:50.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.808+0000 7f65b3fff640 1 -- 172.21.15.72:0/3756746985 <== osd.2 v2:172.21.15.72:6824/3225387403 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f65c0030e00 con 0x7f65b8075060 2024-03-24T10:36:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.808+0000 7fca417fa640 1 -- 172.21.15.72:0/3281551692 <== osd.3 v2:172.21.15.72:6808/3747177009 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca3c0020e0 con 0x7fca30075be0 2024-03-24T10:36:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.808+0000 7f64eaffd640 1 -- 172.21.15.72:0/3581951140 <== osd.4 v2:172.21.15.79:6800/4199586883 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f64ec007480 con 0x7f64dc074fe0 2024-03-24T10:36:50.861 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.808+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] conn(0x7f64dc074fe0 msgr2=0x7f64dc077420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:6800/4199586883,v1:172.21.15.79:6801/4199586883] conn(0x7f64dc074fe0 0x7f64dc077420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] conn(0x7f65b8075060 msgr2=0x7f65b80774a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65d0cfc640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6824/3225387403,v1:172.21.15.72:6825/3225387403] conn(0x7f65b8075060 0x7f65b80774a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.862 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 --> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb5580b2c60 con 0x7fb53c075090 2024-03-24T10:36:50.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f64dc06b8e0 msgr2=0x7f64dc06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f64dc06b8e0 0x7f64dc06dda0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f64f4039900 tx=0x7f64f0008040 comp rx=0 tx=0).stop 2024-03-24T10:36:50.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004b90 msgr2=0x7f64f40e9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 --2- 172.21.15.72:0/3581951140 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64e4004b90 0x7f64f40e9750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f64fc02d6c0 tx=0x7f64fc07ac10 comp rx=0 tx=0).stop 2024-03-24T10:36:50.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64fad9d640 1 -- 172.21.15.72:0/3581951140 reap_dead start 2024-03-24T10:36:50.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 shutdown_connections 2024-03-24T10:36:50.865 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 >> 172.21.15.72:0/3581951140 conn(0x7f64f4009fe0 msgr2=0x7f64f4039f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65b806b8e0 msgr2=0x7f65b806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65d0cfc640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65b806b8e0 0x7f65b806dda0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65c400e2b0 tx=0x7f65c400d040 comp rx=0 tx=0).stop 2024-03-24T10:36:50.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 --> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd158002d30 con 0x7fd15c075060 2024-03-24T10:36:50.866 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7fb54e7fc640 1 -- 172.21.15.72:0/739296513 <== osd.0 v2:172.21.15.72:6810/1231953304 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb5480095e0 con 0x7fb53c075090 2024-03-24T10:36:50.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0cb630 msgr2=0x7f65cc15cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65d0cfc640 1 --2- 172.21.15.72:0/3756746985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65cc0cb630 0x7f65cc15cd00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00c3f0 tx=0x7f65bc00c8b0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f65cbfff640 1 -- 172.21.15.72:0/3756746985 reap_dead start 2024-03-24T10:36:50.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 shutdown_connections 2024-03-24T10:36:50.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] conn(0x7fca30075be0 msgr2=0x7fca30078080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7fca49f87640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6808/3747177009,v1:172.21.15.72:6809/3747177009] conn(0x7fca30075be0 0x7fca30078080 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.809+0000 7f64e8ff9640 1 -- 172.21.15.72:0/3581951140 wait complete. 2024-03-24T10:36:50.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3006b8a0 msgr2=0x7fca3006dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3006b8a0 0x7fca3006dd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fca34036000 tx=0x7fca34008030 comp rx=0 tx=0).stop 2024-03-24T10:36:50.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca44072150 msgr2=0x7fca440b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 --2- 172.21.15.72:0/3281551692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca44072150 0x7fca440b6030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c410 tx=0x7fca3800c810 comp rx=0 tx=0).stop 2024-03-24T10:36:50.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49786640 1 -- 172.21.15.72:0/3281551692 reap_dead start 2024-03-24T10:36:50.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd1757fa640 1 -- 172.21.15.72:0/1416571918 <== osd.7 v2:172.21.15.79:6816/1471205760 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd158002d30 con 0x7fd15c075060 2024-03-24T10:36:50.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 shutdown_connections 2024-03-24T10:36:50.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 >> 172.21.15.72:0/3281551692 conn(0x7fca440cd4a0 msgr2=0x7fca440b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] conn(0x7fb53c075090 msgr2=0x7fb53c0774d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb56020e640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6810/1231953304,v1:172.21.15.72:6812/1231953304] conn(0x7fb53c075090 0x7fb53c0774d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 shutdown_connections 2024-03-24T10:36:50.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 >> 172.21.15.72:0/3756746985 conn(0x7f65cc0cd4a0 msgr2=0x7f65cc0cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb53c06b910 msgr2=0x7fb53c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb56020e640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb53c06b910 0x7fb53c06ddd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb550004bf0 tx=0x7fb55003b040 comp rx=0 tx=0).stop 2024-03-24T10:36:50.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5580a9970 msgr2=0x7fb558148840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb56020e640 1 --2- 172.21.15.72:0/739296513 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb5580a9970 0x7fb558148840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5580737f0 tx=0x7fb55400e690 comp rx=0 tx=0).stop 2024-03-24T10:36:50.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fb55e7ab640 1 -- 172.21.15.72:0/739296513 reap_dead start 2024-03-24T10:36:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 shutdown_connections 2024-03-24T10:36:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7f65d0cfc640 1 -- 172.21.15.72:0/3756746985 wait complete. 2024-03-24T10:36:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 shutdown_connections 2024-03-24T10:36:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fca49f87640 1 -- 172.21.15.72:0/3281551692 wait complete. 2024-03-24T10:36:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] conn(0x7fd15c075060 msgr2=0x7fd15c0774a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17f1d0640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.79:6816/1471205760,v1:172.21.15.79:6817/1471205760] conn(0x7fd15c075060 0x7fd15c0774a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd15c06b8e0 msgr2=0x7fd15c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17f1d0640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd15c06b8e0 0x7fd15c06dda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd178069830 tx=0x7fd17806af90 comp rx=0 tx=0).stop 2024-03-24T10:36:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd170038100 msgr2=0x7fd17019e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17f1d0640 1 --2- 172.21.15.72:0/1416571918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd170038100 0x7fd17019e3a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd16c033000 tx=0x7fd16c0046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.810+0000 7fd17d76d640 1 -- 172.21.15.72:0/1416571918 reap_dead start 2024-03-24T10:36:50.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7f861347d640 1 -- 172.21.15.72:0/2081570590 --> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f860c04f470 con 0x7f860c0b0330 2024-03-24T10:36:50.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 shutdown_connections 2024-03-24T10:36:50.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 >> 172.21.15.72:0/739296513 conn(0x7fb5580b1710 msgr2=0x7fb5581626a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 shutdown_connections 2024-03-24T10:36:50.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fb56020e640 1 -- 172.21.15.72:0/739296513 wait complete. 2024-03-24T10:36:50.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 shutdown_connections 2024-03-24T10:36:50.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 >> 172.21.15.72:0/1416571918 conn(0x7fd170009fa0 msgr2=0x7fd17004f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 shutdown_connections 2024-03-24T10:36:50.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7fd17f1d0640 1 -- 172.21.15.72:0/1416571918 wait complete. 2024-03-24T10:36:50.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.811+0000 7f8602ffd640 1 -- 172.21.15.72:0/2081570590 <== osd.5 v2:172.21.15.79:6808/2108585497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f860c04f470 con 0x7f860c0b0330 2024-03-24T10:36:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.813+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] conn(0x7f860c0b0330 msgr2=0x7f860c061b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.813+0000 7f8600ff9640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:6808/2108585497,v1:172.21.15.79:6809/2108585497] conn(0x7f860c0b0330 0x7f860c061b50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f85f006b860 msgr2=0x7f85f006dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8600ff9640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f85f006b860 0x7f85f006dd20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f860c073450 tx=0x7f85fc009590 comp rx=0 tx=0).stop 2024-03-24T10:36:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c164940 msgr2=0x7f860c0afba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7fb13fa15640 1 -- 172.21.15.72:0/1903581485 --> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1380717e0 con 0x7fb11c074f10 2024-03-24T10:36:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8600ff9640 1 --2- 172.21.15.72:0/2081570590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f860c164940 0x7f860c0afba0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f860c050500 tx=0x7f8608010c20 comp rx=0 tx=0).stop 2024-03-24T10:36:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8612c7c640 1 -- 172.21.15.72:0/2081570590 reap_dead start 2024-03-24T10:36:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 shutdown_connections 2024-03-24T10:36:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 >> 172.21.15.72:0/2081570590 conn(0x7f860c06d1e0 msgr2=0x7f860c0cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.814+0000 7fb12dffb640 1 -- 172.21.15.72:0/1903581485 <== osd.6 v2:172.21.15.79:6824/1786021323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb130009c40 con 0x7fb11c074f10 2024-03-24T10:36:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 shutdown_connections 2024-03-24T10:36:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] conn(0x7fb11c074f10 msgr2=0x7fb11c077350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7fb11b7fe640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:6824/1786021323,v1:172.21.15.79:6825/1786021323] conn(0x7fb11c074f10 0x7fb11c077350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:50.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7f8600ff9640 1 -- 172.21.15.72:0/2081570590 wait complete. 2024-03-24T10:36:50.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb11c06b810 msgr2=0x7fb11c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7fb11b7fe640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb11c06b810 0x7fb11c06dcd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb134000c00 tx=0x7fb13403c040 comp rx=0 tx=0).stop 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13806eb00 msgr2=0x7fb1381fc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.815+0000 7fb11b7fe640 1 --2- 172.21.15.72:0/1903581485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb13806eb00 0x7fb1381fc770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c390 tx=0x7fb12800c790 comp rx=0 tx=0).stop 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.816+0000 7fb13dfb2640 1 -- 172.21.15.72:0/1903581485 reap_dead start 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.816+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 shutdown_connections 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.816+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 >> 172.21.15.72:0/1903581485 conn(0x7fb1380b1710 msgr2=0x7fb138071fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.816+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 shutdown_connections 2024-03-24T10:36:50.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:50.816+0000 7fb11b7fe640 1 -- 172.21.15.72:0/1903581485 wait complete. 2024-03-24T10:36:50.881 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:50.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-24T10:36:50.882 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:50.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-24T10:36:50.883 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:50.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-24T10:36:50.884 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:50.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-24T10:36:50.885 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2024-03-24T10:36:50.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-24T10:36:50.886 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:50.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-24T10:36:50.887 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:50.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-24T10:36:50.888 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:50.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-24T10:36:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.091+0000 7f6c074df640 1 Processor -- start 2024-03-24T10:36:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.091+0000 7f6c074df640 1 -- start start 2024-03-24T10:36:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f7d27fff640 1 Processor -- start 2024-03-24T10:36:51.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f7d27fff640 1 -- start start 2024-03-24T10:36:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f6c074df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c000cf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f6c074df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c000c54a0 0x7f6c0006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f6c074df640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c000cc4b0 con 0x7f6c0006c240 2024-03-24T10:36:51.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f5568d6b640 1 Processor -- start 2024-03-24T10:36:51.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f6c074df640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6c000cc790 con 0x7f6c000c54a0 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f6c074df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6c000cca70 con 0x7f6c000b2130 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f6c04a7a640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f6c0006c240 0x7f6c000c4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41506/0 (socket says 172.21.15.72:41506) 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c04a7a640 1 -- 172.21.15.72:0/2246152813 learned_addr learned my addr 172.21.15.72:0/2246152813 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/2246152813 >> v2:172.21.15.79:3300/0 conn(0x7f6c000c54a0 0x7f6c0006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c0527b640 1 --2- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c000cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.092+0000 7f5568d6b640 1 -- start start 2024-03-24T10:36:51.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6bf7fff640 1 -- 172.21.15.72:0/2246152813 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690097452 0 0) 0x7f6c000cc4b0 con 0x7f6c0006c240 2024-03-24T10:36:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f7d27fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f7d20053370 0x7f7d20038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7fde2a0fb640 1 Processor -- start 2024-03-24T10:36:51.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6bf7fff640 1 -- 172.21.15.72:0/2246152813 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bec003520 con 0x7f6c0006c240 2024-03-24T10:36:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7fbe265f4640 1 Processor -- start 2024-03-24T10:36:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7fadabf3a640 1 Processor -- start 2024-03-24T10:36:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c05a7c640 1 -- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 msgr2=0x7f6c000cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c000cf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c05a7c640 1 -- 172.21.15.72:0/2246152813 >> v1:172.21.15.79:6789/0 conn(0x7f6c0006c240 legacy=0x7f6c000c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f7d267fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f7d2004ff70 0x7f7d20052c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41518/0 (socket says 172.21.15.72:41518) 2024-03-24T10:36:51.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7fbe265f4640 1 -- start start 2024-03-24T10:36:51.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f7d267fc640 1 -- 172.21.15.72:0/2303446297 learned_addr learned my addr 172.21.15.72:0/2303446297 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:51.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d200e3630 con 0x7f7d200e3250 2024-03-24T10:36:51.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d277fe640 1 --2- 172.21.15.72:0/2303446297 >> v2:172.21.15.79:3300/0 conn(0x7f7d20053370 0x7f7d20038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d20053920 con 0x7f7d2004ff70 2024-03-24T10:36:51.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f5568d6b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f55641405b0 0x7f55640b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f7d20053c00 con 0x7f7d20053370 2024-03-24T10:36:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d25ffb640 1 -- 172.21.15.72:0/2303446297 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 582697780 0 0) 0x7f7d20053920 con 0x7f7d2004ff70 2024-03-24T10:36:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d25ffb640 1 -- 172.21.15.72:0/2303446297 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d10003520 con 0x7f7d2004ff70 2024-03-24T10:36:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f5568d6b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55640b2b10 con 0x7f556406dc20 2024-03-24T10:36:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f5568d6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55640b2df0 con 0x7f5564072520 2024-03-24T10:36:51.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f5568d6b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f55640b30d0 con 0x7f55641405b0 2024-03-24T10:36:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f5562d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f556406dc20 0x7f5564164f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49906/0 (socket says 172.21.15.72:49906) 2024-03-24T10:36:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f5562d9d640 1 -- 172.21.15.72:0/56739156 learned_addr learned my addr 172.21.15.72:0/56739156 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:51.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7f6c05a7c640 1 -- 172.21.15.72:0/2246152813 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c000ccd50 con 0x7f6c000c54a0 2024-03-24T10:36:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.093+0000 7fde2a0fb640 1 -- start start 2024-03-24T10:36:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7fde2a0fb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde2415beb0 0x7fde240b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296349794 0 0) 0x7f55640b2b10 con 0x7f556406dc20 2024-03-24T10:36:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554c003520 con 0x7f556406dc20 2024-03-24T10:36:51.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe265f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe180516c0 0x7fbe180e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe265f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe180e34c0 0x7fbe180e3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe265f4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe18051eb0 con 0x7fbe18009dd0 2024-03-24T10:36:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe265f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbe180e2770 con 0x7fbe180e34c0 2024-03-24T10:36:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe265f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbe18052190 con 0x7fbe180516c0 2024-03-24T10:36:51.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7fadabf3a640 1 -- start start 2024-03-24T10:36:51.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fadabf3a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fada415cb40 0x7fada4071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c0006c6a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009d90 tx=0x7f6bf802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecbaf7899abaaf35 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbe18009dd0 0x7fbe1800a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49910/0 (socket says 172.21.15.72:49910) 2024-03-24T10:36:51.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1ffff640 1 -- 172.21.15.72:0/1989786326 learned_addr learned my addr 172.21.15.72:0/1989786326 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:51.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/1989786326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe180516c0 0x7fbe180e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe24b91640 1 --2- 172.21.15.72:0/1989786326 >> v2:172.21.15.79:3300/0 conn(0x7fbe180e34c0 0x7fbe180e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7f6bf7fff640 1 -- 172.21.15.72:0/2246152813 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf802cc50 con 0x7f6c000c54a0 2024-03-24T10:36:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7f6bf7fff640 1 -- 172.21.15.72:0/2246152813 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf802cdb0 con 0x7f6c000c54a0 2024-03-24T10:36:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d277fe640 1 -- 172.21.15.72:0/2303446297 >> v1:172.21.15.79:6789/0 conn(0x7f7d2004ff70 legacy=0x7f7d20052c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d277fe640 1 -- 172.21.15.72:0/2303446297 >> v1:172.21.15.72:6789/0 conn(0x7f7d200e3250 legacy=0x7f7d2004f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.094+0000 7f7d277fe640 1 -- 172.21.15.72:0/2303446297 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d20053ee0 con 0x7f7d20053370 2024-03-24T10:36:51.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fadabf3a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fada40b2b10 con 0x7fada406d1a0 2024-03-24T10:36:51.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7f6bf7fff640 1 -- 172.21.15.72:0/2246152813 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8034660 con 0x7f6c000c54a0 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde237fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde2415beb0 0x7fde240b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde237fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde2415beb0 0x7fde240b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33406/0 (socket says 172.21.15.72:33406) 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde2a0fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde240cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde2a0fb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde240cd190 con 0x7fde2415c290 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde2a0fb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fde240b33d0 con 0x7fde2415beb0 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde2a0fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fde240ccb40 con 0x7fde240d0900 2024-03-24T10:36:51.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fde237fe640 1 -- 172.21.15.72:0/2143440814 learned_addr learned my addr 172.21.15.72:0/2143440814 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 --2- 172.21.15.72:0/56739156 >> v2:172.21.15.79:3300/0 conn(0x7f55641405b0 0x7f55640b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fada94d5640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fada406ee30 0x7fada406ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41528/0 (socket says 172.21.15.72:41528) 2024-03-24T10:36:51.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fada94d5640 1 -- 172.21.15.72:0/3363268708 learned_addr learned my addr 172.21.15.72:0/3363268708 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:51.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f2fc3cfa640 1 Processor -- start 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fada9cd6640 1 --2- 172.21.15.72:0/3363268708 >> v2:172.21.15.79:3300/0 conn(0x7fada415cb40 0x7fada4071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fada4071b90 con 0x7fada406ee30 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fada415cf20 con 0x7fada415cb40 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586430362 0 0) 0x7fada40b2b10 con 0x7fada406d1a0 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad90003520 con 0x7fada406d1a0 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763651163 0 0) 0x7fada4071b90 con 0x7fada406ee30 2024-03-24T10:36:51.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada40b2b10 con 0x7fada406ee30 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 718156353 0 0) 0x7fad90003520 con 0x7fada406d1a0 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 >> v2:172.21.15.79:3300/0 conn(0x7fada415cb40 msgr2=0x7fada4071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 --2- 172.21.15.72:0/3363268708 >> v2:172.21.15.79:3300/0 conn(0x7fada415cb40 0x7fada4071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 >> v1:172.21.15.79:6789/0 conn(0x7fada406ee30 legacy=0x7fada406ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4071e70 con 0x7fada406d1a0 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7fad94001670 con 0x7fada406d1a0 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 >> v1:172.21.15.72:6789/0 conn(0x7fada406d1a0 legacy=0x7fada40b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad90003b00 0x7fad90003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad900047c0 0x7fad90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad90005180 0x7fad9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fada415cf20 con 0x7fad900047c0 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad9000c0b0 con 0x7fad90003b00 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fad9000c270 con 0x7fad90005180 2024-03-24T10:36:51.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada94d5640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad900047c0 0x7fad90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fde237fe640 1 -- 172.21.15.72:0/2143440814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 msgr2=0x7fde240cd620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fde237fe640 1 --2- 172.21.15.72:0/2143440814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde240cd620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fde237fe640 1 -- 172.21.15.72:0/2143440814 >> v1:172.21.15.72:6789/0 conn(0x7fde2415c290 legacy=0x7fde240d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7fde237fe640 1 -- 172.21.15.72:0/2143440814 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde240cce20 con 0x7fde2415beb0 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 -- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 msgr2=0x7f6c0006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 --2- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c0006c6a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009d90 tx=0x7f6bf802bea0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 -- 172.21.15.72:0/2246152813 shutdown_connections 2024-03-24T10:36:51.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 --2- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c0006c6a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 --2- 172.21.15.72:0/2246152813 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c000cf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 -- 172.21.15.72:0/2246152813 >> 172.21.15.72:0/2246152813 conn(0x7f6c0009a9d0 msgr2=0x7f6c0009ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f6c074df640 1 -- 172.21.15.72:0/2246152813 shutdown_connections 2024-03-24T10:36:51.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f6c074df640 1 -- 172.21.15.72:0/2246152813 wait complete. 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 680313256 0 0) 0x7f554c003520 con 0x7f556406dc20 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 >> v2:172.21.15.79:3300/0 conn(0x7f55641405b0 msgr2=0x7f55640b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 --2- 172.21.15.72:0/56739156 >> v2:172.21.15.79:3300/0 conn(0x7f55641405b0 0x7f55640b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 >> v1:172.21.15.79:6789/0 conn(0x7f5564072520 legacy=0x7f556406d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640b33b0 con 0x7f556406dc20 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f5554001650 con 0x7f556406dc20 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 >> v1:172.21.15.72:6789/0 conn(0x7f556406dc20 legacy=0x7f5564164f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f554c003970 0x7f554c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c0047c0 0x7f554c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c005180 0x7f554c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55640b30d0 con 0x7f554c0047c0 2024-03-24T10:36:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f554c00c160 con 0x7f554c005180 2024-03-24T10:36:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f554c00c320 con 0x7f554c003970 2024-03-24T10:36:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f554c003970 0x7f554c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f5562d9d640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c005180 0x7f554c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f5561d9b640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c0047c0 0x7f554c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 -- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c005180 msgr2=0x7f554c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f554c005180 0x7f554c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 -- 172.21.15.72:0/56739156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c0047c0 msgr2=0x7f554c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c0047c0 0x7f554c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f556259c640 1 -- 172.21.15.72:0/56739156 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55640b33b0 con 0x7f554c003970 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f2fc3cfa640 1 -- start start 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc3cfa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc0c3000 0x7f2fbc0c3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc3cfa640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fbc071ce0 0x7f2fbc072170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc3cfa640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fbc0c39a0 con 0x7f2fbc162330 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc3cfa640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2fbc071850 con 0x7f2fbc071ce0 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc3cfa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc071240 con 0x7f2fbc0c3000 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc1a96640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f2fbc162330 0x7f2fbc06e2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:41538/0 (socket says 172.21.15.72:41538) 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc1a96640 1 -- 172.21.15.72:0/633386326 learned_addr learned my addr 172.21.15.72:0/633386326 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:51.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc1295640 1 --2- 172.21.15.72:0/633386326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc0c3000 0x7f2fbc0c3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f2fc2297640 1 --2- 172.21.15.72:0/633386326 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc071ce0 0x7f2fbc072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/1989786326 >> v2:172.21.15.79:3300/0 conn(0x7fbe180e34c0 msgr2=0x7fbe180e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/1989786326 >> v2:172.21.15.79:3300/0 conn(0x7fbe180e34c0 0x7fbe180e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/1989786326 >> v1:172.21.15.72:6789/0 conn(0x7fbe18009dd0 legacy=0x7fbe1800a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.095+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/1989786326 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe180e2cc0 con 0x7fbe180516c0 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/1989786326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe180516c0 0x7fbe180e2230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe140097a0 tx=0x7fbe1402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0a2004e54feb281 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fbe1effd640 1 -- 172.21.15.72:0/1989786326 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14031830 con 0x7fbe180516c0 2024-03-24T10:36:51.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fbe1effd640 1 -- 172.21.15.72:0/1989786326 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe14031990 con 0x7fbe180516c0 2024-03-24T10:36:51.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7fbe1effd640 1 -- 172.21.15.72:0/1989786326 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe14031d60 con 0x7fbe180516c0 2024-03-24T10:36:51.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada9cd6640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad90003b00 0x7fad90003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fadaa4d7640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad90005180 0x7fad9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada94d5640 1 -- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad90005180 msgr2=0x7fad9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada94d5640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad90005180 0x7fad9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada94d5640 1 -- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad90003b00 msgr2=0x7fad90003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada94d5640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad90003b00 0x7fad90003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada94d5640 1 -- 172.21.15.72:0/3363268708 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada4071e70 con 0x7fad900047c0 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fada9cd6640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad90003b00 0x7fad90003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f2fc0a94640 1 -- 172.21.15.72:0/633386326 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652402968 0 0) 0x7f2fb8001110 con 0x7f2fbc162330 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f2fc1295640 1 -- 172.21.15.72:0/633386326 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc071ce0 msgr2=0x7f2fbc072170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f2fc1295640 1 --2- 172.21.15.72:0/633386326 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc071ce0 0x7f2fbc072170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f2fc1295640 1 -- 172.21.15.72:0/633386326 >> v1:172.21.15.79:6789/0 conn(0x7f2fbc162330 legacy=0x7f2fbc06e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f2fc1295640 1 -- 172.21.15.72:0/633386326 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fbc06ed00 con 0x7f2fbc0c3000 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 -- 172.21.15.72:0/1989786326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe180516c0 msgr2=0x7fbe180e2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.123 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 --2- 172.21.15.72:0/1989786326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe180516c0 0x7fbe180e2230 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbe140097a0 tx=0x7fbe1402b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fadaa4d7640 1 -- 172.21.15.72:0/3363268708 reap_dead start 2024-03-24T10:36:51.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f40ab4eb640 1 Processor -- start 2024-03-24T10:36:51.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.096+0000 7f40ab4eb640 1 -- start start 2024-03-24T10:36:51.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40ab4eb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40a4168660 0x7f40a416b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40ab4eb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40a406d830 0x7f40a40b3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40ab4eb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a40b2a10 con 0x7f40a416b6b0 2024-03-24T10:36:51.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 -- 172.21.15.72:0/1989786326 shutdown_connections 2024-03-24T10:36:51.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 --2- 172.21.15.72:0/1989786326 >> v2:172.21.15.79:3300/0 conn(0x7fbe180e34c0 0x7fbe180e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40ab4eb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f40a40b3040 con 0x7f40a406d830 2024-03-24T10:36:51.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40ab4eb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f40a4071190 con 0x7f40a4168660 2024-03-24T10:36:51.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 --2- 172.21.15.72:0/1989786326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe180516c0 0x7fbe180e2230 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 -- 172.21.15.72:0/1989786326 >> 172.21.15.72:0/1989786326 conn(0x7fbe180537e0 msgr2=0x7fbe18053bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fde237fe640 1 --2- 172.21.15.72:0/2143440814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240b28c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde18009870 tx=0x7fde1802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c329dee8d72ec162 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f7d277fe640 1 --2- 172.21.15.72:0/2303446297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d20053370 0x7f7d20038bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d180097a0 tx=0x7f7d1802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5350057f07f2efc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.097+0000 7f5561d9b640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c0047c0 0x7f554c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:51.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f556259c640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f554c003970 0x7f554c003d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f555c0099c0 tx=0x7f554c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3757f2e580b862e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c02cd00 con 0x7f554c003970 2024-03-24T10:36:51.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c02ce60 con 0x7f554c003970 2024-03-24T10:36:51.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f556159a640 1 -- 172.21.15.72:0/56739156 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c012a90 con 0x7f554c003970 2024-03-24T10:36:51.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f5562d9d640 1 -- 172.21.15.72:0/56739156 reap_dead start 2024-03-24T10:36:51.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 -- 172.21.15.72:0/1989786326 shutdown_connections 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7fbe265f4640 1 -- 172.21.15.72:0/1989786326 wait complete. 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40a9a88640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40a406d830 0x7f40a40b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40a9a88640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40a406d830 0x7f40a40b3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33444/0 (socket says 172.21.15.72:33444) 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40a9a88640 1 -- 172.21.15.72:0/289383213 learned_addr learned my addr 172.21.15.72:0/289383213 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.098+0000 7f40a9287640 1 --2- 172.21.15.72:0/289383213 >> v2:172.21.15.79:3300/0 conn(0x7f40a4168660 0x7f40a416b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f40a9a88640 1 -- 172.21.15.72:0/289383213 >> v2:172.21.15.79:3300/0 conn(0x7f40a4168660 msgr2=0x7f40a416b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f40a9a88640 1 --2- 172.21.15.72:0/289383213 >> v2:172.21.15.79:3300/0 conn(0x7f40a4168660 0x7f40a416b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f40a9a88640 1 -- 172.21.15.72:0/289383213 >> v1:172.21.15.72:6789/0 conn(0x7f40a416b6b0 legacy=0x7f40a406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:51.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f40a9a88640 1 -- 172.21.15.72:0/289383213 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a416bcd0 con 0x7f40a406d830 2024-03-24T10:36:51.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7fde227fc640 1 -- 172.21.15.72:0/2143440814 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18030860 con 0x7fde2415beb0 2024-03-24T10:36:51.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7fde227fc640 1 -- 172.21.15.72:0/2143440814 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde180309c0 con 0x7fde2415beb0 2024-03-24T10:36:51.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7fde227fc640 1 -- 172.21.15.72:0/2143440814 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18030d50 con 0x7fde2415beb0 2024-03-24T10:36:51.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f7d25ffb640 1 -- 172.21.15.72:0/2303446297 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d18030840 con 0x7f7d20053370 2024-03-24T10:36:51.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f7d25ffb640 1 -- 172.21.15.72:0/2303446297 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d180309a0 con 0x7f7d20053370 2024-03-24T10:36:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f7d25ffb640 1 -- 172.21.15.72:0/2303446297 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d18030d70 con 0x7f7d20053370 2024-03-24T10:36:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f2fc1295640 1 --2- 172.21.15.72:0/633386326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc0c3000 0x7f2fbc0c3460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0097a0 tx=0x7f2fac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d20122db494211 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f5568d6b640 1 -- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f554c003970 msgr2=0x7f554c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f5568d6b640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f554c003970 0x7f554c003d90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f555c0099c0 tx=0x7f554c0057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f40a9a88640 1 --2- 172.21.15.72:0/289383213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40b3460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f40a40d0a40 tx=0x7f409c00b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3024567e8428a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f2fc0a94640 1 -- 172.21.15.72:0/633386326 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac031640 con 0x7f2fbc0c3000 2024-03-24T10:36:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.099+0000 7f2fc0a94640 1 -- 172.21.15.72:0/633386326 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fac0317a0 con 0x7f2fbc0c3000 2024-03-24T10:36:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f6c074df640 1 Processor -- start 2024-03-24T10:36:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fde2a0fb640 1 -- 172.21.15.72:0/2143440814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 msgr2=0x7fde240b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/2143440814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240b28c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fde18009870 tx=0x7fde1802b9a0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fbe265f4640 1 Processor -- start 2024-03-24T10:36:51.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d20053370 msgr2=0x7f7d20038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 --2- 172.21.15.72:0/2303446297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d20053370 0x7f7d20038bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d180097a0 tx=0x7f7d1802b980 comp rx=0 tx=0).stop 2024-03-24T10:36:51.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f409bfff640 1 -- 172.21.15.72:0/289383213 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c02cc60 con 0x7f40a406d830 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f409bfff640 1 -- 172.21.15.72:0/289383213 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f409c030070 con 0x7f40a406d830 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f409bfff640 1 -- 172.21.15.72:0/289383213 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409c036400 con 0x7f40a406d830 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 shutdown_connections 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fde2a0fb640 1 -- 172.21.15.72:0/2143440814 shutdown_connections 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/2143440814 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde240cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/2143440814 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240b28c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fde2a0fb640 1 -- 172.21.15.72:0/2143440814 >> 172.21.15.72:0/2143440814 conn(0x7fde2409a9d0 msgr2=0x7fde2409ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 --2- 172.21.15.72:0/2303446297 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d20053370 0x7f7d20038bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f6c074df640 1 -- start start 2024-03-24T10:36:51.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 >> 172.21.15.72:0/2303446297 conn(0x7f7d20009fa0 msgr2=0x7f7d2000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fada94d5640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad900047c0 0x7fad90004c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c320 tx=0x7fad900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64b8249f58366a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 shutdown_connections 2024-03-24T10:36:51.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f7d27fff640 1 -- 172.21.15.72:0/2303446297 wait complete. 2024-03-24T10:36:51.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f5568d6b640 1 -- 172.21.15.72:0/56739156 shutdown_connections 2024-03-24T10:36:51.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f5568d6b640 1 --2- 172.21.15.72:0/56739156 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f554c003970 0x7f554c003d90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f5568d6b640 1 -- 172.21.15.72:0/56739156 >> 172.21.15.72:0/56739156 conn(0x7f55640b1810 msgr2=0x7f55640b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c02cb70 con 0x7fad900047c0 2024-03-24T10:36:51.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f5568d6b640 1 -- 172.21.15.72:0/56739156 shutdown_connections 2024-03-24T10:36:51.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad9c02ccd0 con 0x7fad900047c0 2024-03-24T10:36:51.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fada8cd4640 1 -- 172.21.15.72:0/3363268708 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9c0356b0 con 0x7fad900047c0 2024-03-24T10:36:51.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/633386326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc0c3000 msgr2=0x7f2fbc0c3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7f2fc3cfa640 1 --2- 172.21.15.72:0/633386326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc0c3000 0x7f2fbc0c3460 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2fac0097a0 tx=0x7f2fac02b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.100+0000 7fbe265f4640 1 -- start start 2024-03-24T10:36:51.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/633386326 shutdown_connections 2024-03-24T10:36:51.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f2fc3cfa640 1 --2- 172.21.15.72:0/633386326 >> v2:172.21.15.72:3300/0 conn(0x7f2fbc071ce0 0x7f2fbc072170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f2fc3cfa640 1 --2- 172.21.15.72:0/633386326 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc0c3000 0x7f2fbc0c3460 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/633386326 >> 172.21.15.72:0/633386326 conn(0x7f2fbc06b130 msgr2=0x7f2fbc06b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/633386326 shutdown_connections 2024-03-24T10:36:51.139 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/633386326 wait complete. 2024-03-24T10:36:51.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f6c074df640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 0x7f6c001f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fbe265f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe18009dd0 0x7fbe180e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f6c074df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c00160c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.140 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f6c0527b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 0x7f6c001f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fbe265f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 0x7fbe180cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f40ab4eb640 1 -- 172.21.15.72:0/289383213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 msgr2=0x7f40a40b3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fbe265f4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe180e34c0 0x7fbe18050d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fde2a0fb640 1 -- 172.21.15.72:0/2143440814 shutdown_connections 2024-03-24T10:36:51.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/289383213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40b3460 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f40a40d0a40 tx=0x7f409c00b410 comp rx=0 tx=0).stop 2024-03-24T10:36:51.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f6c0527b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 0x7f6c001f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33452/0 (socket says 172.21.15.72:33452) 2024-03-24T10:36:51.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fbe1ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe18009dd0 0x7fbe180e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fbe1ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe18009dd0 0x7fbe180e09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55568/0 (socket says 172.21.15.72:55568) 2024-03-24T10:36:51.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7f5568d6b640 1 -- 172.21.15.72:0/56739156 wait complete. 2024-03-24T10:36:51.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fbe1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 0x7fbe180cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 0x7fbe180cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49316/0 (socket says 172.21.15.72:49316) 2024-03-24T10:36:51.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad900047c0 msgr2=0x7fad90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fadabf3a640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad900047c0 0x7fad90004c40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c320 tx=0x7fad900057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 shutdown_connections 2024-03-24T10:36:51.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fadabf3a640 1 --2- 172.21.15.72:0/3363268708 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad900047c0 0x7fad90004c40 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fad9c00c320 tx=0x7fad900057f0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 >> 172.21.15.72:0/3363268708 conn(0x7fada40b1810 msgr2=0x7fada40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1ffff640 1 -- 172.21.15.72:0/811806609 learned_addr learned my addr 172.21.15.72:0/811806609 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe180e05b0 con 0x7fbe180e34c0 2024-03-24T10:36:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe24b91640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe180e34c0 0x7fbe18050d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe180df930 con 0x7fbe180516c0 2024-03-24T10:36:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbe180dfc10 con 0x7fbe18009dd0 2024-03-24T10:36:51.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c074df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c000ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c074df640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c000cafe0 con 0x7f6c0006c240 2024-03-24T10:36:51.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c074df640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001fb670 con 0x7f6c000c54a0 2024-03-24T10:36:51.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c074df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6c000cad40 con 0x7f6c000b2130 2024-03-24T10:36:51.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c0527b640 1 -- 172.21.15.72:0/3552983082 learned_addr learned my addr 172.21.15.72:0/3552983082 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.101+0000 7fde2a0fb640 1 -- 172.21.15.72:0/2143440814 wait complete. 2024-03-24T10:36:51.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 shutdown_connections 2024-03-24T10:36:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe18009dd0 msgr2=0x7fbe180e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c04a7a640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c00160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c000ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c05a7c640 1 -- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 msgr2=0x7f6c00160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c00160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7f6c05a7c640 1 -- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 msgr2=0x7f6c001f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 0x7f6c001f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe18009dd0 0x7fbe180e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe180e34c0 msgr2=0x7fbe18050d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe180e34c0 0x7fbe18050d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fbe1f7fe640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe14009400 con 0x7fbe180516c0 2024-03-24T10:36:51.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.102+0000 7fadabf3a640 1 -- 172.21.15.72:0/3363268708 wait complete. 2024-03-24T10:36:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f7d27fff640 1 Processor -- start 2024-03-24T10:36:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f6c05a7c640 1 -- 172.21.15.72:0/3552983082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8009a70 con 0x7f6c000c54a0 2024-03-24T10:36:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f7d27fff640 1 -- start start 2024-03-24T10:36:51.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f6c0527b640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 0x7f6c001f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:51.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7fbe1f7fe640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 0x7fbe180cc370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe14033000 tx=0x7fbe140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f2fc3cfa640 1 Processor -- start 2024-03-24T10:36:51.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f6c05a7c640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c000ca800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8033000 tx=0x7f6bf8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1403a630 con 0x7fbe180516c0 2024-03-24T10:36:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1403a790 con 0x7fbe180516c0 2024-03-24T10:36:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1403ab40 con 0x7fbe180516c0 2024-03-24T10:36:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7fde2a0fb640 1 Processor -- start 2024-03-24T10:36:51.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe180dfef0 con 0x7fbe180516c0 2024-03-24T10:36:51.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f5568d6b640 1 Processor -- start 2024-03-24T10:36:51.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf803e610 con 0x7f6c000c54a0 2024-03-24T10:36:51.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7fde2a0fb640 1 -- start start 2024-03-24T10:36:51.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe180df550 con 0x7fbe180516c0 2024-03-24T10:36:51.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7fadabf3a640 1 Processor -- start 2024-03-24T10:36:51.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f6c074df640 1 -- 172.21.15.72:0/3552983082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c001fc3f0 con 0x7f6c000c54a0 2024-03-24T10:36:51.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f6c074df640 1 -- 172.21.15.72:0/3552983082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c001fbbf0 con 0x7f6c000c54a0 2024-03-24T10:36:51.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f2fc3cfa640 1 -- start start 2024-03-24T10:36:51.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f7d27fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d2004ff70 0x7f7d200d3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f7d27fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d20053370 0x7f7d200d8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f40ab4eb640 1 -- 172.21.15.72:0/289383213 shutdown_connections 2024-03-24T10:36:51.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/289383213 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40b3460 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/289383213 >> v2:172.21.15.79:3300/0 conn(0x7f40a4168660 0x7f40a416b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f40ab4eb640 1 -- 172.21.15.72:0/289383213 >> 172.21.15.72:0/289383213 conn(0x7f40a40b1710 msgr2=0x7f40a40b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.103+0000 7f5568d6b640 1 -- start start 2024-03-24T10:36:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f5568d6b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 0x7f55640a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf803e7b0 con 0x7f6c000c54a0 2024-03-24T10:36:51.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7fde2a0fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde241532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d26ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d2004ff70 0x7f7d200d3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d26ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d2004ff70 0x7f7d200d3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49334/0 (socket says 172.21.15.72:49334) 2024-03-24T10:36:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d27fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 0x7f7d200cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc3cfa640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 0x7f2fbc1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc3cfa640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fbc0c3000 0x7f2fbc0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.157 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc3cfa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc162330 0x7f2fbc0c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc3cfa640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc158ae0 con 0x7f2fbc162330 2024-03-24T10:36:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc3cfa640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2fbc0b3ff0 con 0x7f2fbc0c3000 2024-03-24T10:36:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc3cfa640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2fbc0c5280 con 0x7f2fbc071ce0 2024-03-24T10:36:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d27fff640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f7d200d94b0 con 0x7f7d200e3250 2024-03-24T10:36:51.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f40ab4eb640 1 -- 172.21.15.72:0/289383213 shutdown_connections 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d277fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 0x7f7d200cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d277fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 0x7f7d200cfe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33496/0 (socket says 172.21.15.72:33496) 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d277fe640 1 -- 172.21.15.72:0/245680604 learned_addr learned my addr 172.21.15.72:0/245680604 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7d200dc8d0 con 0x7f7d2004ff70 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f556259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 0x7f55640a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f556259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 0x7f55640a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:33482/0 (socket says 172.21.15.72:33482) 2024-03-24T10:36:51.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f556259c640 1 -- 172.21.15.72:0/1014530642 learned_addr learned my addr 172.21.15.72:0/1014530642 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc1a96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 0x7f2fbc1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc1a96640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 0x7f2fbc1585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55614/0 (socket says 172.21.15.72:55614) 2024-03-24T10:36:51.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc1a96640 1 -- 172.21.15.72:0/2904866431 learned_addr learned my addr 172.21.15.72:0/2904866431 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f40ab4eb640 1 -- 172.21.15.72:0/289383213 wait complete. 2024-03-24T10:36:51.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f7d200d8f70 con 0x7f7d20053370 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.104+0000 7fadabf3a640 1 -- start start 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7fadabf3a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fada415e9d0 0x7fada4147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7fadabf3a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada415b840 0x7fada40af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fada9cd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fada415e9d0 0x7fada4147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fada9cd6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fada415e9d0 0x7fada4147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55628/0 (socket says 172.21.15.72:55628) 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf803eb60 con 0x7f6c000c54a0 2024-03-24T10:36:51.161 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f6c074df640 1 -- 172.21.15.72:0/3552983082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be0005290 con 0x7f6c000c54a0 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f7d267fc640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d20053370 0x7f7d200d8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f556414d970 0x7f5564143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55641f2cf0 0x7f55641f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f55641f36e0 con 0x7f554c003970 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5564139ea0 con 0x7f556414d970 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f55640a9b10 con 0x7f55641f2cf0 2024-03-24T10:36:51.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc2297640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc162330 0x7f2fbc0c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc1a96640 1 -- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fbc0c3000 msgr2=0x7f2fbc0c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7f2fc1295640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fbc0c3000 0x7f2fbc0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f2fc1a96640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fbc0c3000 0x7f2fbc0c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f2fc1a96640 1 -- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc162330 msgr2=0x7f2fbc0c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f2fc1a96640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc162330 0x7f2fbc0c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f2fc1a96640 1 -- 172.21.15.72:0/2904866431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fac009400 con 0x7f2fbc071ce0 2024-03-24T10:36:51.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7fbe0a7fc640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf8005290 con 0x7fbe180516c0 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fadabf3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40afe20 0x7fada41587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fadabf3a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fada4144900 con 0x7fada415b840 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fadabf3a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fada40b02a0 con 0x7fada40afe20 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fadabf3a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fada415a7a0 con 0x7fada415e9d0 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fada9cd6640 1 -- 172.21.15.72:0/84508248 learned_addr learned my addr 172.21.15.72:0/84508248 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fada94d5640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada415b840 0x7fada40af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.105+0000 7fde2a0fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde2a0fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde2415c290 0x7fde240cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde2a0fb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fde240af460 con 0x7fde2415beb0 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde2a0fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde240c9bc0 con 0x7fde2415c290 2024-03-24T10:36:51.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde2a0fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fde240c9ea0 con 0x7fde240d0900 2024-03-24T10:36:51.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f2fc1a96640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 0x7f2fbc1585a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c420 tx=0x7f2fb800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde237fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde241532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f5561d9b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f556414d970 0x7f5564143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f5562d9d640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55641f2cf0 0x7f55641f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f556259c640 1 -- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55641f2cf0 msgr2=0x7f55641f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f556259c640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55641f2cf0 0x7f55641f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f556259c640 1 -- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f556414d970 msgr2=0x7f5564143670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f556259c640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f556414d970 0x7f5564143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f556259c640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f556415b4f0 con 0x7f554c003970 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f7d277fe640 1 -- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d20053370 msgr2=0x7f7d200d8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f7d277fe640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d20053370 0x7f7d200d8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f7d277fe640 1 -- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d2004ff70 msgr2=0x7f7d200d3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f7d277fe640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d2004ff70 0x7f7d200d3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.166 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde237fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde241532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55592/0 (socket says 172.21.15.72:55592) 2024-03-24T10:36:51.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde237fe640 1 -- 172.21.15.72:0/1229498659 learned_addr learned my addr 172.21.15.72:0/1229498659 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f7d277fe640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d18009400 con 0x7f7d200e3250 2024-03-24T10:36:51.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7f556259c640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 0x7f55640a9430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f555c036040 tx=0x7f555c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.167 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde23fff640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde2415c290 0x7fde240cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fde22ffd640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.106+0000 7fadaa4d7640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40afe20 0x7fada41587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f7d277fe640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 0x7f7d200cfe70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d180098c0 tx=0x7f7d18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fde22ffd640 1 -- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 msgr2=0x7fde241532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fde22ffd640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde241532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fde22ffd640 1 -- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde2415c290 msgr2=0x7fde240cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fde22ffd640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde2415c290 0x7fde240cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fde22ffd640 1 -- 172.21.15.72:0/1229498659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde180094d0 con 0x7fde2415beb0 2024-03-24T10:36:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c03f440 con 0x7f554c003970 2024-03-24T10:36:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f555c03f5a0 con 0x7f554c003970 2024-03-24T10:36:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fadaa4d7640 1 -- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fada415e9d0 msgr2=0x7fada4147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6bf803b050 con 0x7f6c000c54a0 2024-03-24T10:36:51.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1803e040 con 0x7f7d200e3250 2024-03-24T10:36:51.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d18039d20 con 0x7f7d200e3250 2024-03-24T10:36:51.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fde22ffd640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240ca7f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c390 tx=0x7fde1400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1803e040 con 0x7f7d200e3250 2024-03-24T10:36:51.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fadaa4d7640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fada415e9d0 0x7fada4147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d200d91d0 con 0x7f7d200e3250 2024-03-24T10:36:51.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f40ab4eb640 1 Processor -- start 2024-03-24T10:36:51.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f40ab4eb640 1 -- start start 2024-03-24T10:36:51.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fadaa4d7640 1 -- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada415b840 msgr2=0x7fada40af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fadaa4d7640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada415b840 0x7fada40af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d200dc0d0 con 0x7f7d200e3250 2024-03-24T10:36:51.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7f6bf5ffb640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6be406b8e0 0x7f6be406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fadaa4d7640 1 -- 172.21.15.72:0/84508248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada415aa80 con 0x7fada40afe20 2024-03-24T10:36:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c03f950 con 0x7f554c003970 2024-03-24T10:36:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f556414ddf0 con 0x7f554c003970 2024-03-24T10:36:51.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6bf80ad100 con 0x7f6c000c54a0 2024-03-24T10:36:51.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f556415c500 con 0x7f554c003970 2024-03-24T10:36:51.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde140052d0 con 0x7fde2415beb0 2024-03-24T10:36:51.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde240ca180 con 0x7fde2415beb0 2024-03-24T10:36:51.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde240cdc70 con 0x7fde2415beb0 2024-03-24T10:36:51.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80074e0 con 0x7f2fbc071ce0 2024-03-24T10:36:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbe1403aca0 con 0x7fbe180516c0 2024-03-24T10:36:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7fbe1cff9640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe0406b8e0 0x7fbe0406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe140ac380 con 0x7fbe180516c0 2024-03-24T10:36:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f40ab4eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.175 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/2904866431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fbc0b4260 con 0x7f2fbc071ce0 2024-03-24T10:36:51.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f40ab4eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40a4168660 0x7f40a40ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f40ab4eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a416b6b0 0x7f40a40abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/2904866431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fbc0b4820 con 0x7f2fbc071ce0 2024-03-24T10:36:51.176 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb8007640 con 0x7f2fbc071ce0 2024-03-24T10:36:51.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40ab4eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f40a416c1f0 con 0x7f40a406d830 2024-03-24T10:36:51.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40ab4eb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40a40aeac0 con 0x7f40a416b6b0 2024-03-24T10:36:51.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40ab4eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f40a40aeda0 con 0x7f40a4168660 2024-03-24T10:36:51.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40a9a88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a416b6b0 0x7f40a40abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7f6c0527b640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6be406b8e0 0x7f6be406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.107+0000 7fadaa4d7640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40afe20 0x7fada41587a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fada40d0ca0 tx=0x7fad9400e960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8004a00 con 0x7f2fbc071ce0 2024-03-24T10:36:51.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7fbe1ffff640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe0406b8e0 0x7fbe0406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.178 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7fbe1ffff640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe0406b8e0 0x7fbe0406dda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe2007ab00 tx=0x7fbe200686c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f6c0527b640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6be406b8e0 0x7f6be406dda0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00112c0 tx=0x7f6bf0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d200052b0 con 0x7f7d200e3250 2024-03-24T10:36:51.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40a9a88640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a416b6b0 0x7f40a40abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:49396/0 (socket says 172.21.15.72:49396) 2024-03-24T10:36:51.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40a9a88640 1 -- 172.21.15.72:0/683381733 learned_addr learned my addr 172.21.15.72:0/683381733 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:51.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.109+0000 7f40a9287640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f40a8a86640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40a4168660 0x7f40a40ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5564073d50 con 0x7f554c003970 2024-03-24T10:36:51.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2fb8004c20 con 0x7f2fbc071ce0 2024-03-24T10:36:51.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f7d180443f0 con 0x7f7d200e3250 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f40a8a86640 1 -- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a416b6b0 msgr2=0x7f40a40abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f40a8a86640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a416b6b0 0x7f40a40abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f40a8a86640 1 -- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 msgr2=0x7f40a40ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f40a8a86640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f40a8a86640 1 -- 172.21.15.72:0/683381733 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409c005f90 con 0x7f40a4168660 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f555c03fab0 con 0x7f554c003970 2024-03-24T10:36:51.181 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/2904866431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa4005290 con 0x7f2fbc071ce0 2024-03-24T10:36:51.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f40a8a86640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40a4168660 0x7f40a40ab5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f409400c390 tx=0x7f409400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.108+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde14005430 con 0x7fde2415beb0 2024-03-24T10:36:51.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde14007220 con 0x7fde2415beb0 2024-03-24T10:36:51.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.110+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde04005290 con 0x7fde2415beb0 2024-03-24T10:36:51.182 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f5552ffd640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f554406b910 0x7f554406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fde14007440 con 0x7fde2415beb0 2024-03-24T10:36:51.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f5561d9b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f554406b910 0x7f554406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f555c0ad1b0 con 0x7f554c003970 2024-03-24T10:36:51.183 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f2fb27fc640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2fa006b8e0 0x7f2fa006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f7d0f7fe640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7d1406b900 0x7f7d1406ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7d180ac700 con 0x7f7d200e3250 2024-03-24T10:36:51.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.111+0000 7f7d26ffd640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7d1406b900 0x7f7d1406ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7f2fc1295640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2fa006b8e0 0x7f2fa006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6bf8077a20 con 0x7f6c000c54a0 2024-03-24T10:36:51.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fde0bfff640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde1006b810 0x7fde1006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2fb808a130 con 0x7f2fbc071ce0 2024-03-24T10:36:51.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7f5561d9b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f554406b910 0x7f554406ddd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5564140e10 tx=0x7f5558007ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fde14089760 con 0x7fde2415beb0 2024-03-24T10:36:51.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fde237fe640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde1006b810 0x7fde1006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7f2fc1295640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2fa006b8e0 0x7f2fa006dda0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fac036000 tx=0x7f2fac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad940052e0 con 0x7fada40afe20 2024-03-24T10:36:51.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fadabf3a640 1 -- 172.21.15.72:0/84508248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada415ad60 con 0x7fada40afe20 2024-03-24T10:36:51.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fadabf3a640 1 -- 172.21.15.72:0/84508248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada415b320 con 0x7fada40afe20 2024-03-24T10:36:51.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7fde237fe640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde1006b810 0x7fde1006dcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde1802b9e0 tx=0x7fde18008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.112+0000 7f7d26ffd640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7d1406b900 0x7f7d1406ddc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0099b0 tx=0x7f7d1c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.113+0000 7fadabf3a640 1 -- 172.21.15.72:0/84508248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada4073d50 con 0x7fada40afe20 2024-03-24T10:36:51.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.116+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad94005440 con 0x7fada40afe20 2024-03-24T10:36:51.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.116+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad940037f0 con 0x7fada40afe20 2024-03-24T10:36:51.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.116+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbe14076c10 con 0x7fbe180516c0 2024-03-24T10:36:51.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.116+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f7d18076fc0 con 0x7f7d200e3250 2024-03-24T10:36:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.117+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fad94003950 con 0x7fada40afe20 2024-03-24T10:36:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.118+0000 7fad9a7fc640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad8806b810 0x7fad8806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.118+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fad94089eb0 con 0x7fada40afe20 2024-03-24T10:36:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.118+0000 7fada9cd6640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad8806b810 0x7fad8806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.119+0000 7fada9cd6640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad8806b810 0x7fad8806dcd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fada4155890 tx=0x7fada0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.120+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2fb8054880 con 0x7f2fbc071ce0 2024-03-24T10:36:51.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.120+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fad94054630 con 0x7fada40afe20 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.121+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40940052d0 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.121+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4094005430 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.121+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a416c440 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.121+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4094003810 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.121+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a40ae690 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.123+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a416c960 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.123+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4094003970 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.124+0000 7f4099ffb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f408806b8e0 0x7f408806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.124+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4094089aa0 con 0x7f40a4168660 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.124+0000 7f40a9287640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f408806b8e0 0x7f408806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:51.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.125+0000 7f40a9287640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f408806b8e0 0x7f408806dda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f40a406d5a0 tx=0x7f40a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:51.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.125+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f555c077900 con 0x7f554c003970 2024-03-24T10:36:51.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.132+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f40940541f0 con 0x7f40a4168660 2024-03-24T10:36:51.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.134+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fde14053ef0 con 0x7fde2415beb0 2024-03-24T10:36:51.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.516+0000 7f6c074df640 1 -- 172.21.15.72:0/3552983082 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6be0005810 con 0x7f6c000c54a0 2024-03-24T10:36:51.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.516+0000 7f6bf5ffb640 1 -- 172.21.15.72:0/3552983082 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6bf804e090 con 0x7f6c000c54a0 2024-03-24T10:36:51.517 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.519+0000 7f6beb7fe640 1 -- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6be406b8e0 msgr2=0x7f6be406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.519+0000 7f6beb7fe640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6be406b8e0 0x7f6be406dda0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00112c0 tx=0x7f6bf0009190 comp rx=0 tx=0).stop 2024-03-24T10:36:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.519+0000 7f6beb7fe640 1 -- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 msgr2=0x7f6c000ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.519+0000 7f6beb7fe640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c000ca800 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8033000 tx=0x7f6bf8004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 -- 172.21.15.72:0/3552983082 shutdown_connections 2024-03-24T10:36:51.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6be406b8e0 0x7f6be406dda0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c000c54a0 0x7f6c000ca800 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c000b2130 0x7f6c00160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 --2- 172.21.15.72:0/3552983082 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c0006c240 0x7f6c001f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 -- 172.21.15.72:0/3552983082 >> 172.21.15.72:0/3552983082 conn(0x7f6c0009a9d0 msgr2=0x7f6c001e9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 -- 172.21.15.72:0/3552983082 shutdown_connections 2024-03-24T10:36:51.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.520+0000 7f6beb7fe640 1 -- 172.21.15.72:0/3552983082 wait complete. 2024-03-24T10:36:51.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.523+0000 7f2fc3cfa640 1 -- 172.21.15.72:0/2904866431 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2fa4005540 con 0x7f2fbc071ce0 2024-03-24T10:36:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.523+0000 7f2fb27fc640 1 -- 172.21.15.72:0/2904866431 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2fb8057f40 con 0x7f2fbc071ce0 2024-03-24T10:36:51.524 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.524+0000 7fbe0a7fc640 1 -- 172.21.15.72:0/811806609 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbdf8005540 con 0x7fbe180516c0 2024-03-24T10:36:51.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.524+0000 7fbe1cff9640 1 -- 172.21.15.72:0/811806609 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe1407a2d0 con 0x7fbe180516c0 2024-03-24T10:36:51.525 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2024-03-24T10:36:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.525+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7d20048380 con 0x7f7d200e3250 2024-03-24T10:36:51.525 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.525+0000 7f7d0f7fe640 1 -- 172.21.15.72:0/245680604 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d1807a680 con 0x7f7d200e3250 2024-03-24T10:36:51.526 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:51.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 -- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2fa006b8e0 msgr2=0x7f2fa006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2fa006b8e0 0x7f2fa006dda0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2fac036000 tx=0x7f2fac008030 comp rx=0 tx=0).stop 2024-03-24T10:36:51.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 -- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 msgr2=0x7f2fbc1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 0x7f2fbc1585a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c420 tx=0x7f2fb800c8e0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 -- 172.21.15.72:0/2904866431 shutdown_connections 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2fa006b8e0 0x7f2fa006dda0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fbc162330 0x7f2fbc0c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2fbc0c3000 0x7f2fbc0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 --2- 172.21.15.72:0/2904866431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2fbc071ce0 0x7f2fbc1585a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.527+0000 7f2f9ffff640 1 -- 172.21.15.72:0/2904866431 >> 172.21.15.72:0/2904866431 conn(0x7f2fbc06b130 msgr2=0x7f2fbc06e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7f2f9ffff640 1 -- 172.21.15.72:0/2904866431 shutdown_connections 2024-03-24T10:36:51.529 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7f2f9ffff640 1 -- 172.21.15.72:0/2904866431 wait complete. 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe0406b8e0 msgr2=0x7fbe0406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe0406b8e0 0x7fbe0406dda0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe2007ab00 tx=0x7fbe200686c0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 msgr2=0x7fbe180cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 0x7fbe180cc370 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbe14033000 tx=0x7fbe140046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 shutdown_connections 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe0406b8e0 0x7fbe0406dda0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe180e34c0 0x7fbe18050d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe180516c0 0x7fbe180cc370 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 --2- 172.21.15.72:0/811806609 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe18009dd0 0x7fbe180e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.528+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 >> 172.21.15.72:0/811806609 conn(0x7fbe180537e0 msgr2=0x7fbe1800a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.529+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 shutdown_connections 2024-03-24T10:36:51.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.529+0000 7fbe265f4640 1 -- 172.21.15.72:0/811806609 wait complete. 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.529+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7d1406b900 msgr2=0x7f7d1406ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.529+0000 7f7d27fff640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7d1406b900 0x7f7d1406ddc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c0099b0 tx=0x7f7d1c009060 comp rx=0 tx=0).stop 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.529+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 msgr2=0x7f7d200cfe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.529+0000 7f7d27fff640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 0x7f7d200cfe70 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d180098c0 tx=0x7f7d18004730 comp rx=0 tx=0).stop 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 shutdown_connections 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f7d1406b900 0x7f7d1406ddc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7d200e3250 0x7f7d200cfe70 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f7d20053370 0x7f7d200d8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 --2- 172.21.15.72:0/245680604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7d2004ff70 0x7f7d200d3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 >> 172.21.15.72:0/245680604 conn(0x7f7d20009fa0 msgr2=0x7f7d20005f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 shutdown_connections 2024-03-24T10:36:51.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.530+0000 7f7d27fff640 1 -- 172.21.15.72:0/245680604 wait complete. 2024-03-24T10:36:51.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.531+0000 7fadabf3a640 1 -- 172.21.15.72:0/84508248 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fada40b4df0 con 0x7fada40afe20 2024-03-24T10:36:51.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.533+0000 7fad9a7fc640 1 -- 172.21.15.72:0/84508248 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad94019090 con 0x7fada40afe20 2024-03-24T10:36:51.536 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.536+0000 7fad87fff640 1 -- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad8806b810 msgr2=0x7fad8806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.536+0000 7fad87fff640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad8806b810 0x7fad8806dcd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fada4155890 tx=0x7fada0008040 comp rx=0 tx=0).stop 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.536+0000 7fad87fff640 1 -- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40afe20 msgr2=0x7fada41587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.536+0000 7fad87fff640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40afe20 0x7fada41587a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fada40d0ca0 tx=0x7fad9400e960 comp rx=0 tx=0).stop 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.537+0000 7fad87fff640 1 -- 172.21.15.72:0/84508248 shutdown_connections 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.537+0000 7fad87fff640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad8806b810 0x7fad8806dcd0 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fada4155890 tx=0x7fada0008040 comp rx=0 tx=0).stop 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.537+0000 7fad87fff640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fada40afe20 0x7fada41587a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.537+0000 7fad87fff640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fada415b840 0x7fada40af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.537+0000 7fad87fff640 1 --2- 172.21.15.72:0/84508248 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fada415e9d0 0x7fada4147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.537+0000 7fad87fff640 1 -- 172.21.15.72:0/84508248 >> 172.21.15.72:0/84508248 conn(0x7fada40b1810 msgr2=0x7fada4165080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.538+0000 7fad87fff640 1 -- 172.21.15.72:0/84508248 shutdown_connections 2024-03-24T10:36:51.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.538+0000 7fad87fff640 1 -- 172.21.15.72:0/84508248 wait complete. 2024-03-24T10:36:51.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.538+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f556413df50 con 0x7f554c003970 2024-03-24T10:36:51.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.539+0000 7f5552ffd640 1 -- 172.21.15.72:0/1014530642 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f555c07afc0 con 0x7f554c003970 2024-03-24T10:36:51.542 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:51.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-03-24T10:36:51.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.541+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f40a40ae850 con 0x7f40a4168660 2024-03-24T10:36:51.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.542+0000 7f4099ffb640 1 -- 172.21.15.72:0/683381733 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f40940578b0 con 0x7f40a4168660 2024-03-24T10:36:51.543 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f554406b910 msgr2=0x7f554406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f554406b910 0x7f554406ddd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5564140e10 tx=0x7f5558007ab0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 msgr2=0x7f55640a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 0x7f55640a9430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f555c036040 tx=0x7f555c004ab0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 shutdown_connections 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f554406b910 0x7f554406ddd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55641f2cf0 0x7f55641f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f556414d970 0x7f5564143670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 --2- 172.21.15.72:0/1014530642 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f554c003970 0x7f55640a9430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 >> 172.21.15.72:0/1014530642 conn(0x7f55640b1810 msgr2=0x7f55640b3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.544 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 shutdown_connections 2024-03-24T10:36:51.545 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.543+0000 7f5568d6b640 1 -- 172.21.15.72:0/1014530642 wait complete. 2024-03-24T10:36:51.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.545+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f408806b8e0 msgr2=0x7f408806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.545+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f408806b8e0 0x7f408806dda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f40a406d5a0 tx=0x7f40a0008040 comp rx=0 tx=0).stop 2024-03-24T10:36:51.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.545+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40a4168660 msgr2=0x7f40a40ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.545+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40a4168660 0x7f40a40ab5d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f409400c390 tx=0x7f409400c850 comp rx=0 tx=0).stop 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 shutdown_connections 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f408806b8e0 0x7f408806dda0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40a416b6b0 0x7f40a40abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40a4168660 0x7f40a40ab5d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 --2- 172.21.15.72:0/683381733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40a406d830 0x7f40a40ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 >> 172.21.15.72:0/683381733 conn(0x7f40a40b1710 msgr2=0x7f40a40b0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 shutdown_connections 2024-03-24T10:36:51.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7f40ab4eb640 1 -- 172.21.15.72:0/683381733 wait complete. 2024-03-24T10:36:51.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.546+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fde04005810 con 0x7fde2415beb0 2024-03-24T10:36:51.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.547+0000 7fde0bfff640 1 -- 172.21.15.72:0/1229498659 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde140575b0 con 0x7fde2415beb0 2024-03-24T10:36:51.549 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2024-03-24T10:36:51.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-03-24T10:36:51.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-03-24T10:36:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde1006b810 msgr2=0x7fde1006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde1006b810 0x7fde1006dcd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fde1802b9e0 tx=0x7fde18008030 comp rx=0 tx=0).stop 2024-03-24T10:36:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 msgr2=0x7fde240ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240ca7f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde1400c390 tx=0x7fde1400c850 comp rx=0 tx=0).stop 2024-03-24T10:36:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 shutdown_connections 2024-03-24T10:36:51.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde1006b810 0x7fde1006dcd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde2415c290 0x7fde240cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde2415beb0 0x7fde240ca7f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 --2- 172.21.15.72:0/1229498659 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde240d0900 0x7fde241532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:51.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.550+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 >> 172.21.15.72:0/1229498659 conn(0x7fde2409a9d0 msgr2=0x7fde2409adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.551+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 shutdown_connections 2024-03-24T10:36:51.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:51.551+0000 7fde2a0fb640 1 -- 172.21.15.72:0/1229498659 wait complete. 2024-03-24T10:36:51.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-03-24T10:36:51.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-03-24T10:36:51.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2024-03-24T10:36:51.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-03-24T10:36:51.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-03-24T10:36:52.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-24T10:36:52.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-24T10:36:52.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-24T10:36:52.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-24T10:36:52.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-24T10:36:52.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-24T10:36:52.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-24T10:36:52.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-24T10:36:52.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.710+0000 7fbed4a42640 1 Processor -- start 2024-03-24T10:36:52.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.710+0000 7fbed4a42640 1 -- start start 2024-03-24T10:36:52.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.711+0000 7fbed4a42640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbed01405b0 0x7fbed00b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.711+0000 7fbed4a42640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed0072520 0x7fbed0072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.711+0000 7fbed4a42640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed00b2b10 con 0x7fbed006d510 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.711+0000 7fbed4a42640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbed00b2df0 con 0x7fbed01405b0 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.711+0000 7fbed4a42640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbed00b30d0 con 0x7fbed0072520 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbeced9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbed006d510 0x7fbed0140df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37672/0 (socket says 172.21.15.72:37672) 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbeced9d640 1 -- 172.21.15.72:0/968327053 learned_addr learned my addr 172.21.15.72:0/968327053 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbece59c640 1 --2- 172.21.15.72:0/968327053 >> v2:172.21.15.79:3300/0 conn(0x7fbed01405b0 0x7fbed00b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbece59c640 1 -- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed0072520 msgr2=0x7fbed0072980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbece59c640 1 --2- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed0072520 0x7fbed0072980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbece59c640 1 -- 172.21.15.72:0/968327053 >> v1:172.21.15.72:6789/0 conn(0x7fbed006d510 legacy=0x7fbed0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.712+0000 7fbece59c640 1 -- 172.21.15.72:0/968327053 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed00b33b0 con 0x7fbed01405b0 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.714+0000 7fbece59c640 1 --2- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01405b0 0x7fbed00b3e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097a0 tx=0x7fbec002d940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76e4af4863ce86a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.715+0000 7fbecd59a640 1 -- 172.21.15.72:0/968327053 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0033820 con 0x7fbed01405b0 2024-03-24T10:36:52.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.715+0000 7fbecd59a640 1 -- 172.21.15.72:0/968327053 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec002f040 con 0x7fbed01405b0 2024-03-24T10:36:52.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 -- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01405b0 msgr2=0x7fbed00b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 --2- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01405b0 0x7fbed00b3e90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbec00097a0 tx=0x7fbec002d940 comp rx=0 tx=0).stop 2024-03-24T10:36:52.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 -- 172.21.15.72:0/968327053 shutdown_connections 2024-03-24T10:36:52.717 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 --2- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed0072520 0x7fbed0072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 --2- 172.21.15.72:0/968327053 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed01405b0 0x7fbed00b3e90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.718 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 -- 172.21.15.72:0/968327053 >> 172.21.15.72:0/968327053 conn(0x7fbed00b1810 msgr2=0x7fbed00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 -- 172.21.15.72:0/968327053 shutdown_connections 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.716+0000 7fbed4a42640 1 -- 172.21.15.72:0/968327053 wait complete. 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.719+0000 7fbed4a42640 1 Processor -- start 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.719+0000 7fbed4a42640 1 -- start start 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbed4a42640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 0x7fbed00aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbed4a42640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed0072520 0x7fbed0137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbed4a42640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed01405b0 0x7fbed013e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbed4a42640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbed0139230 con 0x7fbed0072520 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbed4a42640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbed01385b0 con 0x7fbed006d510 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbed4a42640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbed0138890 con 0x7fbed01405b0 2024-03-24T10:36:52.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbece59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 0x7fbed00aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbece59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 0x7fbed00aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53612/0 (socket says 172.21.15.72:53612) 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbece59c640 1 -- 172.21.15.72:0/727138142 learned_addr learned my addr 172.21.15.72:0/727138142 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.720+0000 7fbeced9d640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed01405b0 0x7fbed013e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbece59c640 1 -- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed01405b0 msgr2=0x7fbed013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbece59c640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed01405b0 0x7fbed013e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbece59c640 1 -- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed0072520 msgr2=0x7fbed0137ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbecdd9b640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed0072520 0x7fbed0137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbece59c640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed0072520 0x7fbed0137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbece59c640 1 -- 172.21.15.72:0/727138142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec0009400 con 0x7fbed006d510 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbecdd9b640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed0072520 0x7fbed0137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.721+0000 7fbece59c640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 0x7fbed00aeb50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbec002de80 tx=0x7fbec0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.723+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0038040 con 0x7fbed006d510 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.723+0000 7fbed4a42640 1 -- 172.21.15.72:0/727138142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed0138b70 con 0x7fbed006d510 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.723+0000 7fbed4a42640 1 -- 172.21.15.72:0/727138142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed015c2c0 con 0x7fbed006d510 2024-03-24T10:36:52.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.723+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0043660 con 0x7fbed006d510 2024-03-24T10:36:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.723+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0043a10 con 0x7fbed006d510 2024-03-24T10:36:52.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.726+0000 7fbed4a42640 1 -- 172.21.15.72:0/727138142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb4005290 con 0x7fbed006d510 2024-03-24T10:36:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.727+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbec0033830 con 0x7fbed006d510 2024-03-24T10:36:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.728+0000 7fbebeffd640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbeb006b8e0 0x7fbeb006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.728+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbec00ac650 con 0x7fbed006d510 2024-03-24T10:36:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.728+0000 7fbecdd9b640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbeb006b8e0 0x7fbeb006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.729+0000 7fbecdd9b640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbeb006b8e0 0x7fbeb006dda0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbed015b240 tx=0x7fbec4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.732+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbec0076e50 con 0x7fbed006d510 2024-03-24T10:36:52.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.759+0000 7ff8fac02640 1 Processor -- start 2024-03-24T10:36:52.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.759+0000 7ff8fac02640 1 -- start start 2024-03-24T10:36:52.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8fac02640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8f40cf0c0 0x7ff8f416edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7f5fb01e2640 1 Processor -- start 2024-03-24T10:36:52.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8fac02640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f40cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8fac02640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f4072ef0 con 0x7ff8f40cddf0 2024-03-24T10:36:52.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8fac02640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff8f40ce260 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8fac02640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f416bb90 con 0x7ff8f416f330 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8f9c00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8f40cf0c0 0x7ff8f416edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8f9c00640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8f40cf0c0 0x7ff8f416edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53614/0 (socket says 172.21.15.72:53614) 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7ff8f9c00640 1 -- 172.21.15.72:0/792787831 learned_addr learned my addr 172.21.15.72:0/792787831 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.762+0000 7ff8f9c00640 1 -- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 msgr2=0x7ff8f40cd8b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.762+0000 7ff8f9c00640 1 --2- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f40cd8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.762+0000 7ff8f9c00640 1 -- 172.21.15.72:0/792787831 >> v1:172.21.15.79:6789/0 conn(0x7ff8f40cddf0 legacy=0x7ff8f408b260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.762+0000 7ff8f9c00640 1 -- 172.21.15.72:0/792787831 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f416be70 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.761+0000 7f5fb01e2640 1 -- start start 2024-03-24T10:36:52.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.762+0000 7f6c2af13640 1 Processor -- start 2024-03-24T10:36:52.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.762+0000 7f6c2af13640 1 -- start start 2024-03-24T10:36:52.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fb01e2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5fa815a560 0x7f5fa806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fb01e2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa806ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fb01e2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fa80b3f90 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fb01e2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5fa80cd760 con 0x7f5fa815a560 2024-03-24T10:36:52.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fb01e2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa806bfd0 con 0x7f5fa806b600 2024-03-24T10:36:52.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fad77d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5fa80cd2d0 0x7f5fa815eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37682/0 (socket says 172.21.15.72:37682) 2024-03-24T10:36:52.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fad77d640 1 -- 172.21.15.72:0/2953752175 learned_addr learned my addr 172.21.15.72:0/2953752175 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:52.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7ff8f9c00640 1 --2- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f416edf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009870 tx=0x7ff8e402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d4bab50908c133f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fadf7e640 1 --2- 172.21.15.72:0/2953752175 >> v2:172.21.15.72:3300/0 conn(0x7f5fa815a560 0x7f5fa806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c2af13640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c1c0e1300 0x7f6c1c034c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f5fae77f640 1 --2- 172.21.15.72:0/2953752175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa806ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c2af13640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0364f0 0x7f6c1c051850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c2af13640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1c050b40 con 0x7f6c1c035340 2024-03-24T10:36:52.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f5fae77f640 1 -- 172.21.15.72:0/2953752175 >> v2:172.21.15.72:3300/0 conn(0x7f5fa815a560 msgr2=0x7f5fa806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:52.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f5fae77f640 1 --2- 172.21.15.72:0/2953752175 >> v2:172.21.15.72:3300/0 conn(0x7f5fa815a560 0x7f5fa806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f5facf7c640 1 -- 172.21.15.72:0/2953752175 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4144501409 0 0) 0x7f5fa80b3f90 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f5fae77f640 1 -- 172.21.15.72:0/2953752175 >> v1:172.21.15.72:6789/0 conn(0x7f5fa80cd2d0 legacy=0x7f5fa815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f5fae77f640 1 -- 172.21.15.72:0/2953752175 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa815a940 con 0x7f5fa806b600 2024-03-24T10:36:52.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f5fadf7e640 1 --2- 172.21.15.72:0/2953752175 >> v2:172.21.15.72:3300/0 conn(0x7f5fa815a560 0x7f5fa806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:52.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7efc4853e640 1 Processor -- start 2024-03-24T10:36:52.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7efc4853e640 1 -- start start 2024-03-24T10:36:52.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c2af13640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1c056400 con 0x7f6c1c0e1300 2024-03-24T10:36:52.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c2af13640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c035bc0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c28caf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c1c0e1300 0x7f6c1c034c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c28caf640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6c1c0e1300 0x7f6c1c034c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53622/0 (socket says 172.21.15.72:53622) 2024-03-24T10:36:52.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f6c28caf640 1 -- 172.21.15.72:0/4194406462 learned_addr learned my addr 172.21.15.72:0/4194406462 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.763+0000 7f6c23fff640 1 --1- 172.21.15.72:0/4194406462 >> v1:172.21.15.79:6789/0 conn(0x7f6c1c035340 0x7f6c1c035de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:39470/0 (socket says 172.21.15.72:39470) 2024-03-24T10:36:52.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f6c294b0640 1 --2- 172.21.15.72:0/4194406462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0364f0 0x7f6c1c051850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f6c294b0640 1 -- 172.21.15.72:0/4194406462 >> v2:172.21.15.79:3300/0 conn(0x7f6c1c0e1300 msgr2=0x7f6c1c034c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:52.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f6c294b0640 1 --2- 172.21.15.72:0/4194406462 >> v2:172.21.15.79:3300/0 conn(0x7f6c1c0e1300 0x7f6c1c034c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f6c294b0640 1 -- 172.21.15.72:0/4194406462 >> v1:172.21.15.79:6789/0 conn(0x7f6c1c035340 legacy=0x7f6c1c035de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7ff8f8bfe640 1 -- 172.21.15.72:0/792787831 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4030860 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7ff8f8bfe640 1 -- 172.21.15.72:0/792787831 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8e40309c0 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7ff8f8bfe640 1 -- 172.21.15.72:0/792787831 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4030d50 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.764+0000 7f6c294b0640 1 -- 172.21.15.72:0/4194406462 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1c035160 con 0x7f6c1c0364f0 2024-03-24T10:36:52.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7f6c294b0640 1 --2- 172.21.15.72:0/4194406462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0364f0 0x7f6c1c051850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800dbc0 tx=0x7f6c18033e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1e1808dcffb9d4b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7ff8fac02640 1 -- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 msgr2=0x7ff8f416edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7ff8fac02640 1 --2- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f416edf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009870 tx=0x7ff8e402b9a0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7efc4853e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc401615c0 0x7efc400d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7f5fae77f640 1 --2- 172.21.15.72:0/2953752175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa806ba90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4010c70 tx=0x7f5fa402ffe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b532464f1a891e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7ff8fac02640 1 -- 172.21.15.72:0/792787831 shutdown_connections 2024-03-24T10:36:52.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7ff8fac02640 1 --2- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f40cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7ff8fac02640 1 --2- 172.21.15.72:0/792787831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f416edf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7ff8fac02640 1 -- 172.21.15.72:0/792787831 >> 172.21.15.72:0/792787831 conn(0x7ff8f40b16a0 msgr2=0x7ff8f40b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7f6c237fe640 1 -- 172.21.15.72:0/4194406462 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18034990 con 0x7f6c1c0364f0 2024-03-24T10:36:52.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7f6c237fe640 1 -- 172.21.15.72:0/4194406462 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c18034af0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7efc462da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc401615c0 0x7efc400d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7efc462da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc401615c0 0x7efc400d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53626/0 (socket says 172.21.15.72:53626) 2024-03-24T10:36:52.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.765+0000 7efc462da640 1 -- 172.21.15.72:0/49919372 learned_addr learned my addr 172.21.15.72:0/49919372 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7efc4853e640 1 --2- 172.21.15.72:0/49919372 >> v2:172.21.15.72:3300/0 conn(0x7efc400d10c0 0x7efc400d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7f555f657640 1 Processor -- start 2024-03-24T10:36:52.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7f555f657640 1 -- start start 2024-03-24T10:36:52.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7f5facf7c640 1 -- 172.21.15.72:0/2953752175 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4030d90 con 0x7f5fa806b600 2024-03-24T10:36:52.778 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7efc46adb640 1 --2- 172.21.15.72:0/49919372 >> v2:172.21.15.72:3300/0 conn(0x7efc400d10c0 0x7efc400d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc400d4ca0 con 0x7efc401619a0 2024-03-24T10:36:52.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efc400d4f20 con 0x7efc400d10c0 2024-03-24T10:36:52.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efc400cf710 con 0x7efc401615c0 2024-03-24T10:36:52.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7f5facf7c640 1 -- 172.21.15.72:0/2953752175 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fa4034070 con 0x7f5fa806b600 2024-03-24T10:36:52.779 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7efc452d8640 1 -- 172.21.15.72:0/49919372 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933854086 0 0) 0x7efc400d4ca0 con 0x7efc401619a0 2024-03-24T10:36:52.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7f6c2af13640 1 -- 172.21.15.72:0/4194406462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0364f0 msgr2=0x7f6c1c051850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7f6c2af13640 1 --2- 172.21.15.72:0/4194406462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0364f0 0x7f6c1c051850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800dbc0 tx=0x7f6c18033e70 comp rx=0 tx=0).stop 2024-03-24T10:36:52.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f6c2af13640 1 -- 172.21.15.72:0/4194406462 shutdown_connections 2024-03-24T10:36:52.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f6c2af13640 1 --2- 172.21.15.72:0/4194406462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0364f0 0x7f6c1c051850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f6c2af13640 1 --2- 172.21.15.72:0/4194406462 >> v2:172.21.15.79:3300/0 conn(0x7f6c1c0e1300 0x7f6c1c034c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f6c2af13640 1 -- 172.21.15.72:0/4194406462 >> 172.21.15.72:0/4194406462 conn(0x7f6c1c01e6f0 msgr2=0x7f6c1c055420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7efc452d8640 1 -- 172.21.15.72:0/49919372 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc2c003520 con 0x7efc401619a0 2024-03-24T10:36:52.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7efc46adb640 1 -- 172.21.15.72:0/49919372 >> v2:172.21.15.79:3300/0 conn(0x7efc401615c0 msgr2=0x7efc400d4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:52.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7efc46adb640 1 --2- 172.21.15.72:0/49919372 >> v2:172.21.15.79:3300/0 conn(0x7efc401615c0 0x7efc400d4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7efc46adb640 1 -- 172.21.15.72:0/49919372 >> v1:172.21.15.79:6789/0 conn(0x7efc401619a0 legacy=0x7efc400d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7efc46adb640 1 -- 172.21.15.72:0/49919372 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400cf9f0 con 0x7efc400d10c0 2024-03-24T10:36:52.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555f657640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 0x7f555806e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555f657640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f555806e970 0x7f55580cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555f657640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55580b2e90 con 0x7f555815aee0 2024-03-24T10:36:52.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555f657640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f555806ee00 con 0x7f555806e970 2024-03-24T10:36:52.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555f657640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f55580b3170 con 0x7f55580b3f30 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555cbf2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 0x7f555806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555cbf2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 0x7f555806e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36130/0 (socket says 172.21.15.72:36130) 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f555cbf2640 1 -- 172.21.15.72:0/2607123689 learned_addr learned my addr 172.21.15.72:0/2607123689 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f555cbf2640 1 -- 172.21.15.72:0/2607123689 >> v2:172.21.15.72:3300/0 conn(0x7f555806e970 msgr2=0x7f55580cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f555cbf2640 1 --2- 172.21.15.72:0/2607123689 >> v2:172.21.15.72:3300/0 conn(0x7f555806e970 0x7f55580cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f555cbf2640 1 -- 172.21.15.72:0/2607123689 >> v1:172.21.15.72:6789/0 conn(0x7f555815aee0 legacy=0x7f555815f360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:52.783 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f5facf7c640 1 -- 172.21.15.72:0/2953752175 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa403a600 con 0x7f5fa806b600 2024-03-24T10:36:52.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f183f684640 1 Processor -- start 2024-03-24T10:36:52.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7f183f684640 1 -- start start 2024-03-24T10:36:52.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f555cbf2640 1 -- 172.21.15.72:0/2607123689 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55580b3450 con 0x7f55580b3f30 2024-03-24T10:36:52.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7efc46adb640 1 --2- 172.21.15.72:0/49919372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400d10c0 0x7efc400d1c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc4008caf0 tx=0x7efc30034220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dcbbc50de6d15f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7efc452d8640 1 -- 172.21.15.72:0/49919372 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30034dc0 con 0x7efc400d10c0 2024-03-24T10:36:52.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7efc452d8640 1 -- 172.21.15.72:0/49919372 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc3003c440 con 0x7efc400d10c0 2024-03-24T10:36:52.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7efc452d8640 1 -- 172.21.15.72:0/49919372 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3003c7d0 con 0x7efc400d10c0 2024-03-24T10:36:52.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f5fb01e2640 1 -- 172.21.15.72:0/2953752175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 msgr2=0x7f5fa806ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/2953752175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa806ba90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4010c70 tx=0x7f5fa402ffe0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f6c2af13640 1 -- 172.21.15.72:0/4194406462 shutdown_connections 2024-03-24T10:36:52.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f5fb01e2640 1 -- 172.21.15.72:0/2953752175 shutdown_connections 2024-03-24T10:36:52.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183f684640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1838165f90 0x7f18381663d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183f684640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18380715b0 con 0x7f1838071a40 2024-03-24T10:36:52.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183f684640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1838166910 con 0x7f183814be80 2024-03-24T10:36:52.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183f684640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f183806d1a0 con 0x7f1838165f90 2024-03-24T10:36:52.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/2953752175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa806ba90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/2953752175 >> v2:172.21.15.72:3300/0 conn(0x7f5fa815a560 0x7f5fa806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f5fb01e2640 1 -- 172.21.15.72:0/2953752175 >> 172.21.15.72:0/2953752175 conn(0x7f5fa80b2590 msgr2=0x7f5fa80b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183cc1f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1838165f90 0x7f18381663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183d420640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f183814be80 0x7f183806ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:39488/0 (socket says 172.21.15.72:39488) 2024-03-24T10:36:52.789 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183d420640 1 -- 172.21.15.72:0/370302531 learned_addr learned my addr 172.21.15.72:0/370302531 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f555cbf2640 1 --2- 172.21.15.72:0/2607123689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 0x7f555806e430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4176ad8aa71d5348 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.790 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7ff8fac02640 1 -- 172.21.15.72:0/792787831 shutdown_connections 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.766+0000 7ff8fac02640 1 -- 172.21.15.72:0/792787831 wait complete. 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7ff8fac02640 1 Processor -- start 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.767+0000 7ff8fac02640 1 -- start start 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7ff8fac02640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8f40cddf0 0x7ff8f408adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.768+0000 7ff8fac02640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f415fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400d10c0 msgr2=0x7efc400d1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7efc4853e640 1 --2- 172.21.15.72:0/49919372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400d10c0 0x7efc400d1c20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc4008caf0 tx=0x7efc30034220 comp rx=0 tx=0).stop 2024-03-24T10:36:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f6c2af13640 1 -- 172.21.15.72:0/4194406462 wait complete. 2024-03-24T10:36:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f183cc1f640 1 -- 172.21.15.72:0/370302531 >> v1:172.21.15.79:6789/0 conn(0x7f183814be80 legacy=0x7f183806ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f554ffff640 1 -- 172.21.15.72:0/2607123689 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554031640 con 0x7f55580b3f30 2024-03-24T10:36:52.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f554ffff640 1 -- 172.21.15.72:0/2607123689 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55540317a0 con 0x7f55580b3f30 2024-03-24T10:36:52.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7f554ffff640 1 -- 172.21.15.72:0/2607123689 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5554031b30 con 0x7f55580b3f30 2024-03-24T10:36:52.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 shutdown_connections 2024-03-24T10:36:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7efc4853e640 1 --2- 172.21.15.72:0/49919372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc400d10c0 0x7efc400d1c20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7efc4853e640 1 --2- 172.21.15.72:0/49919372 >> v2:172.21.15.79:3300/0 conn(0x7efc401615c0 0x7efc400d4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 >> 172.21.15.72:0/49919372 conn(0x7efc4009d320 msgr2=0x7efc400d4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 shutdown_connections 2024-03-24T10:36:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f183cc1f640 1 -- 172.21.15.72:0/370302531 >> v1:172.21.15.72:6789/0 conn(0x7f1838071a40 legacy=0x7f1838071ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7efc4853e640 1 -- 172.21.15.72:0/49919372 wait complete. 2024-03-24T10:36:52.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f5fb01e2640 1 -- 172.21.15.72:0/2953752175 shutdown_connections 2024-03-24T10:36:52.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8fac02640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f4164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8fa401640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f4164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f415fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f415fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53628/0 (socket says 172.21.15.72:53628) 2024-03-24T10:36:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 -- 172.21.15.72:0/4169177631 learned_addr learned my addr 172.21.15.72:0/4169177631 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f4166180 con 0x7ff8f40cddf0 2024-03-24T10:36:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f41614b0 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff8f4161770 con 0x7ff8f416f330 2024-03-24T10:36:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f9c00640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8f40cddf0 0x7ff8f408adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 -- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 msgr2=0x7ff8f4164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f4164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 -- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8f40cddf0 msgr2=0x7ff8f408adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8f40cddf0 0x7ff8f408adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.769+0000 7ff8f93ff640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e40094d0 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7ff8f93ff640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f415fbf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b9e0 tx=0x7ff8ec00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.797 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f183cc1f640 1 -- 172.21.15.72:0/370302531 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18380b3ea0 con 0x7f1838165f90 2024-03-24T10:36:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f555f657640 1 -- 172.21.15.72:0/2607123689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 msgr2=0x7f555806e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f555f657640 1 --2- 172.21.15.72:0/2607123689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 0x7f555806e430 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f555f657640 1 -- 172.21.15.72:0/2607123689 shutdown_connections 2024-03-24T10:36:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f555f657640 1 --2- 172.21.15.72:0/2607123689 >> v2:172.21.15.72:3300/0 conn(0x7f555806e970 0x7f55580cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f555f657640 1 --2- 172.21.15.72:0/2607123689 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f55580b3f30 0x7f555806e430 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555402b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.798 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f555f657640 1 -- 172.21.15.72:0/2607123689 >> 172.21.15.72:0/2607123689 conn(0x7f55580b1810 msgr2=0x7f55580b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec007750 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8ec017050 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec007ad0 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.770+0000 7f5fb01e2640 1 -- 172.21.15.72:0/2953752175 wait complete. 2024-03-24T10:36:52.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7f6c2af13640 1 Processor -- start 2024-03-24T10:36:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f4161a50 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f4162010 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7f183cc1f640 1 --2- 172.21.15.72:0/370302531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1838165f90 0x7f18381663d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18280097d0 tx=0x7f182802b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14eda2a1a6e9fe4d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.800 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7f555f657640 1 -- 172.21.15.72:0/2607123689 shutdown_connections 2024-03-24T10:36:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7efc4853e640 1 Processor -- start 2024-03-24T10:36:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7f555f657640 1 -- 172.21.15.72:0/2607123689 wait complete. 2024-03-24T10:36:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7f182ffff640 1 -- 172.21.15.72:0/370302531 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828030800 con 0x7f1838165f90 2024-03-24T10:36:52.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7efc4853e640 1 -- start start 2024-03-24T10:36:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7f5fb01e2640 1 Processor -- start 2024-03-24T10:36:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7f5fb01e2640 1 -- start start 2024-03-24T10:36:52.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f84acfc9640 1 Processor -- start 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7f182ffff640 1 -- 172.21.15.72:0/370302531 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1828030960 con 0x7f1838165f90 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7f182ffff640 1 -- 172.21.15.72:0/370302531 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828030800 con 0x7f1838165f90 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 -- 172.21.15.72:0/370302531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1838165f90 msgr2=0x7f18381663d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 --2- 172.21.15.72:0/370302531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1838165f90 0x7f18381663d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18280097d0 tx=0x7f182802b940 comp rx=0 tx=0).stop 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 -- 172.21.15.72:0/370302531 shutdown_connections 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 --2- 172.21.15.72:0/370302531 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1838165f90 0x7f18381663d0 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18280097d0 tx=0x7f182802b940 comp rx=0 tx=0).stop 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 -- 172.21.15.72:0/370302531 >> 172.21.15.72:0/370302531 conn(0x7f18380b1810 msgr2=0x7f18380b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 -- 172.21.15.72:0/370302531 shutdown_connections 2024-03-24T10:36:52.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.771+0000 7f6c2af13640 1 -- start start 2024-03-24T10:36:52.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.772+0000 7f6c2af13640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1c035340 0x7f6c1c178120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc4853e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc400d10c0 0x7efc401eff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc4853e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc401615c0 0x7efc400cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc4853e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 0x7efc400d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc46adb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 0x7efc400d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc46adb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 0x7efc400d2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51538/0 (socket says 172.21.15.72:51538) 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc46adb640 1 -- 172.21.15.72:0/3452682339 learned_addr learned my addr 172.21.15.72:0/3452682339 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efc400cc200 con 0x7efc401619a0 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc401f1480 con 0x7efc401615c0 2024-03-24T10:36:52.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efc401f0ae0 con 0x7efc400d10c0 2024-03-24T10:36:52.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fb01e2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa80ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f183f684640 1 -- 172.21.15.72:0/370302531 wait complete. 2024-03-24T10:36:52.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f555f657640 1 Processor -- start 2024-03-24T10:36:52.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f555f657640 1 -- start start 2024-03-24T10:36:52.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fb01e2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa80cd2d0 0x7f5fa8158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7f84acfc9640 1 -- start start 2024-03-24T10:36:52.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84acfc9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84a8157de0 0x7f84a815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fadf7e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa80ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84acfc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 0x7f84a815c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fadf7e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa80ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36170/0 (socket says 172.21.15.72:36170) 2024-03-24T10:36:52.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fadf7e640 1 -- 172.21.15.72:0/3357583445 learned_addr learned my addr 172.21.15.72:0/3357583445 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84acfc9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84a80722a0 con 0x7f84a8071ec0 2024-03-24T10:36:52.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fa815a560 0x7f5fa8200290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc46adb640 1 -- 172.21.15.72:0/3452682339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc400d10c0 msgr2=0x7efc401eff80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-24T10:36:52.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc46adb640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc400d10c0 0x7efc401eff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc46adb640 1 -- 172.21.15.72:0/3452682339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc401615c0 msgr2=0x7efc400cb780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-24T10:36:52.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc46adb640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc401615c0 0x7efc400cb780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.809 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7efc46adb640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc30009400 con 0x7efc401619a0 2024-03-24T10:36:52.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fad77d640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa80cd2d0 0x7f5fa8158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84acfc9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f84a815b920 con 0x7f84a8157de0 2024-03-24T10:36:52.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84acfc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f84a815aa90 con 0x7f84a8158260 2024-03-24T10:36:52.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa8158200 con 0x7f5fa815a560 2024-03-24T10:36:52.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84a6d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 0x7f84a815c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84a6d9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 0x7f84a815c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36184/0 (socket says 172.21.15.72:36184) 2024-03-24T10:36:52.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f84a6d9d640 1 -- 172.21.15.72:0/2861427084 learned_addr learned my addr 172.21.15.72:0/2861427084 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f849ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f84a8157de0 0x7f84a815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa80ab540 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5fa81571a0 con 0x7f5fa806b600 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f555f657640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555806e970 0x7f5558146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7f555f657640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f555815aee0 0x7f555814a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555f657640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5558146690 0x7f555814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555f657640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f555815e640 con 0x7f555806e970 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555f657640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5558159610 con 0x7f5558146690 2024-03-24T10:36:52.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555f657640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f555815e360 con 0x7f555815aee0 2024-03-24T10:36:52.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555cbf2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f555815aee0 0x7f555814a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555cbf2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f555815aee0 0x7f555814a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36196/0 (socket says 172.21.15.72:36196) 2024-03-24T10:36:52.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555cbf2640 1 -- 172.21.15.72:0/1116506438 learned_addr learned my addr 172.21.15.72:0/1116506438 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7efc46adb640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 0x7efc400d2680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efc30034760 tx=0x7efc300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555d3f3640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555806e970 0x7f5558146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555dbf4640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5558146690 0x7f555814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.773+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff8ec007c30 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7ff8ea7fc640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8d806b8e0 0x7ff8d806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff8ec093160 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.774+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8f404f470 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f84a6d9d640 1 -- 172.21.15.72:0/2861427084 >> v2:172.21.15.72:3300/0 conn(0x7f84a8157de0 msgr2=0x7f84a815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f84a6d9d640 1 --2- 172.21.15.72:0/2861427084 >> v2:172.21.15.72:3300/0 conn(0x7f84a8157de0 0x7f84a815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f84a6d9d640 1 -- 172.21.15.72:0/2861427084 >> v1:172.21.15.72:6789/0 conn(0x7f84a8071ec0 legacy=0x7f84a81576d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-24T10:36:52.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f84a6d9d640 1 -- 172.21.15.72:0/2861427084 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a815aca0 con 0x7f84a8158260 2024-03-24T10:36:52.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c2af13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 0x7f6c1c04a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c2af13640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0e1300 0x7f6c1c051750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30047440 con 0x7efc401619a0 2024-03-24T10:36:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f183f684640 1 Processor -- start 2024-03-24T10:36:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f183f684640 1 -- start start 2024-03-24T10:36:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c2af13640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c0db3f0 con 0x7f6c1c035340 2024-03-24T10:36:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 0x7f6c1c04a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c23fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 0x7f6c1c04a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53670/0 (socket says 172.21.15.72:53670) 2024-03-24T10:36:52.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c23fff640 1 -- 172.21.15.72:0/100403966 learned_addr learned my addr 172.21.15.72:0/100403966 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc300475a0 con 0x7efc401619a0 2024-03-24T10:36:52.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555d3f3640 1 -- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f555815aee0 msgr2=0x7f555814a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.817 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7ff8f9c00640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8d806b8e0 0x7ff8d806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f5fad77d640 1 -- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 msgr2=0x7f5fa80ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f5fad77d640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa80ab000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f5fad77d640 1 -- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fa815a560 msgr2=0x7f5fa8200290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f5fad77d640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fa815a560 0x7f5fa8200290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f5fad77d640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa0009a70 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555d3f3640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f555815aee0 0x7f555814a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555d3f3640 1 -- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5558146690 msgr2=0x7f555814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555d3f3640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5558146690 0x7f555814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f5fad77d640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa80cd2d0 0x7f5fa8158ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800c3e0 tx=0x7f5f9800c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f6c28caf640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1c035340 0x7f6c1c178120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1c01f270 con 0x7f6c1c0364f0 2024-03-24T10:36:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1c04e600 con 0x7f6c1c0e1300 2024-03-24T10:36:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.775+0000 7f555d3f3640 1 -- 172.21.15.72:0/1116506438 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55540094d0 con 0x7f555806e970 2024-03-24T10:36:52.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f555d3f3640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555806e970 0x7f5558146150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f554800b490 tx=0x7f554800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30047950 con 0x7efc401619a0 2024-03-24T10:36:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc401f0dc0 con 0x7efc401619a0 2024-03-24T10:36:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f183f684640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1838071a40 0x7f1838146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7ff8f9c00640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8d806b8e0 0x7ff8d806dda0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4036000 tx=0x7ff8e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc400ce3d0 con 0x7efc401619a0 2024-03-24T10:36:52.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548011830 con 0x7f555806e970 2024-03-24T10:36:52.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c23fff640 1 -- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0e1300 msgr2=0x7f6c1c051750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c23fff640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0e1300 0x7f6c1c051750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c23fff640 1 -- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1c035340 msgr2=0x7f6c1c178120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c23fff640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1c035340 0x7f6c1c178120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c23fff640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1800d8a0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f6c23fff640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 0x7f6c1c04a580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000c5f0 tx=0x7f6c1000c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55581598b0 con 0x7f555806e970 2024-03-24T10:36:52.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f84a6d9d640 1 --2- 172.21.15.72:0/2861427084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 0x7f84a815c290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009e50 tx=0x7f84a002bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917047507ef52f7f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f183f684640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f183814be80 0x7f18381ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.776+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555815df80 con 0x7f555806e970 2024-03-24T10:36:52.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5548011990 con 0x7f555806e970 2024-03-24T10:36:52.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5548011d20 con 0x7f555806e970 2024-03-24T10:36:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183d420640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1838071a40 0x7f1838146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183d420640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1838071a40 0x7f1838146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53674/0 (socket says 172.21.15.72:53674) 2024-03-24T10:36:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183d420640 1 -- 172.21.15.72:0/908433032 learned_addr learned my addr 172.21.15.72:0/908433032 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183cc1f640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f183814be80 0x7f18381ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18381ed190 0x7f1838161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f18381ed940 con 0x7f18381ed190 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18381f8230 con 0x7f1838071a40 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1838146eb0 con 0x7f183814be80 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f84a5d9b640 1 -- 172.21.15.72:0/2861427084 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a002ca80 con 0x7f84a8158260 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f84a5d9b640 1 -- 172.21.15.72:0/2861427084 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a002cbe0 con 0x7f84a8158260 2024-03-24T10:36:52.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f84a5d9b640 1 -- 172.21.15.72:0/2861427084 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a00343f0 con 0x7f84a8158260 2024-03-24T10:36:52.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc401f15c0 con 0x7efc401619a0 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183cc1f640 1 -- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1838071a40 msgr2=0x7f1838146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f183cc1f640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1838071a40 0x7f1838146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f183cc1f640 1 -- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18381ed190 msgr2=0x7f1838161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.777+0000 7f183dc21640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18381ed190 0x7f1838161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f183cc1f640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18381ed190 0x7f1838161b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f183cc1f640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1828009400 con 0x7f183814be80 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f183dc21640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18381ed190 0x7f1838161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:52.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f183cc1f640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f183814be80 0x7f18381ecc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1828033000 tx=0x7f1828004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f84acfc9640 1 -- 172.21.15.72:0/2861427084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 msgr2=0x7f84a815c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f84acfc9640 1 --2- 172.21.15.72:0/2861427084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 0x7f84a815c290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009e50 tx=0x7f84a002bee0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5538005290 con 0x7f555806e970 2024-03-24T10:36:52.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f84acfc9640 1 -- 172.21.15.72:0/2861427084 shutdown_connections 2024-03-24T10:36:52.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f84acfc9640 1 --2- 172.21.15.72:0/2861427084 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8158260 0x7f84a815c290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f84acfc9640 1 --2- 172.21.15.72:0/2861427084 >> v2:172.21.15.72:3300/0 conn(0x7f84a8157de0 0x7f84a815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7f84acfc9640 1 -- 172.21.15.72:0/2861427084 >> 172.21.15.72:0/2861427084 conn(0x7f84a80b2090 msgr2=0x7f84a80b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:52.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.778+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efc30043040 con 0x7efc401619a0 2024-03-24T10:36:52.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f84acfc9640 1 -- 172.21.15.72:0/2861427084 shutdown_connections 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7efc36ffd640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc2406b8e0 0x7efc2406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc300b4860 con 0x7efc401619a0 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7efc462da640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc2406b8e0 0x7efc2406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f554801a400 con 0x7f555806e970 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f554dffb640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f553c06b840 0x7f553c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5548058fa0 con 0x7f555806e970 2024-03-24T10:36:52.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f980074e0 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f98007640 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f980049e0 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa40108d0 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa8157720 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.781+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5f98004b40 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.782+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa8068cc0 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.782+0000 7f5f9e7fc640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5f8c06b8e0 0x7f5f8c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff8ec05d8b0 con 0x7ff8f40cf0c0 2024-03-24T10:36:52.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.781+0000 7f84acfc9640 1 -- 172.21.15.72:0/2861427084 wait complete. 2024-03-24T10:36:52.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f182803e040 con 0x7f183814be80 2024-03-24T10:36:52.834 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f182802f560 con 0x7f183814be80 2024-03-24T10:36:52.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1828030800 con 0x7f183814be80 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f183815d080 con 0x7f183814be80 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f183815d320 con 0x7f183814be80 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c100074e0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.779+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1c04afd0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1c04eb30 con 0x7f6c1c0364f0 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c10007640 con 0x7f6c1c0364f0 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.781+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10004a00 con 0x7f6c1c0364f0 2024-03-24T10:36:52.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.782+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6c10004be0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.782+0000 7f5fadf7e640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5f8c06b8e0 0x7f5f8c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.782+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5f9808a1b0 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.781+0000 7f555cbf2640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f553c06b840 0x7f553c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.783+0000 7f84acfc9640 1 Processor -- start 2024-03-24T10:36:52.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.783+0000 7f84acfc9640 1 -- start start 2024-03-24T10:36:52.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.780+0000 7efc462da640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc2406b8e0 0x7efc2406dda0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009940 tx=0x7efc3c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.783+0000 7f5fadf7e640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5f8c06b8e0 0x7f5f8c06dda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80afeb0 tx=0x7f5fa000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.783+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c04005290 con 0x7f6c1c0364f0 2024-03-24T10:36:52.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.783+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f182802f910 con 0x7f183814be80 2024-03-24T10:36:52.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.782+0000 7f6c217fa640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6c0806b8e0 0x7f6c0806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84acfc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8071ec0 0x7f84a80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f555cbf2640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f553c06b840 0x7f553c06dd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f55540090b0 tx=0x7f555403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84acfc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 0x7f84a8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f182dffb640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f181c06b810 0x7f181c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f18280acb20 con 0x7f183814be80 2024-03-24T10:36:52.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1838073d50 con 0x7f183814be80 2024-03-24T10:36:52.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c10089bf0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f6c28caf640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6c0806b8e0 0x7f6c0806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84acfc9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84a8158260 0x7f84a8203e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84acfc9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81560c0 con 0x7f84a8158260 2024-03-24T10:36:52.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84acfc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81563a0 con 0x7f84a8157de0 2024-03-24T10:36:52.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f183d420640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f181c06b810 0x7f181c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84acfc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f84a8156680 con 0x7f84a8071ec0 2024-03-24T10:36:52.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 0x7f84a8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 0x7f84a8154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53686/0 (socket says 172.21.15.72:53686) 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 -- 172.21.15.72:0/4015082362 learned_addr learned my addr 172.21.15.72:0/4015082362 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84a6d9d640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84a8158260 0x7f84a8203e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84a659c640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8071ec0 0x7f84a80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 -- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8071ec0 msgr2=0x7f84a80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8071ec0 0x7f84a80ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 -- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84a8158260 msgr2=0x7f84a8203e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84a8158260 0x7f84a8203e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f849ffff640 1 -- 172.21.15.72:0/4015082362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a0009b30 con 0x7f84a8157de0 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.784+0000 7f84a659c640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8071ec0 0x7f84a80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.785+0000 7f849ffff640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 0x7f84a8154000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f849000e9b0 tx=0x7f849000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.785+0000 7f183d420640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f181c06b810 0x7f181c06dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1830005c00 tx=0x7f1830009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.785+0000 7f6c28caf640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6c0806b8e0 0x7f6c0806dda0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c2406a440 tx=0x7f6c2408d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.786+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efc401f15c0 con 0x7efc401619a0 2024-03-24T10:36:52.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.789+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5f98054900 con 0x7f5fa80cd2d0 2024-03-24T10:36:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.789+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1828077160 con 0x7f183814be80 2024-03-24T10:36:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.791+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6c100542b0 con 0x7f6c1c0364f0 2024-03-24T10:36:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.791+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490009670 con 0x7f84a8157de0 2024-03-24T10:36:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.791+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f849000c9a0 con 0x7f84a8157de0 2024-03-24T10:36:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.791+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849000cd50 con 0x7f84a8157de0 2024-03-24T10:36:52.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.792+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a8156960 con 0x7f84a8157de0 2024-03-24T10:36:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.792+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a8157160 con 0x7f84a8157de0 2024-03-24T10:36:52.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.793+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f55480552d0 con 0x7f555806e970 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.793+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84a8068120 con 0x7f84a8157de0 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.794+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8490013470 con 0x7f84a8157de0 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.794+0000 7f849effd640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f848806b8e0 0x7f848806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.795+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f849008a6a0 con 0x7f84a8157de0 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.795+0000 7f84a659c640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f848806b8e0 0x7f848806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.796+0000 7f84a659c640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f848806b8e0 0x7f848806dda0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f849800a8b0 tx=0x7f8498008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:52.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:52.798+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8490054e10 con 0x7f84a8157de0 2024-03-24T10:36:53.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.126+0000 7fbed4a42640 1 -- 172.21.15.72:0/727138142 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbeb4005540 con 0x7fbed006d510 2024-03-24T10:36:53.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.127+0000 7fbebeffd640 1 -- 172.21.15.72:0/727138142 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbec004c3b0 con 0x7fbed006d510 2024-03-24T10:36:53.127 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:53.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 -- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbeb006b8e0 msgr2=0x7fbeb006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbeb006b8e0 0x7fbeb006dda0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbed015b240 tx=0x7fbec4008040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 -- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 msgr2=0x7fbed00aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 0x7fbed00aeb50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbec002de80 tx=0x7fbec0004730 comp rx=0 tx=0).stop 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 -- 172.21.15.72:0/727138142 shutdown_connections 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbeb006b8e0 0x7fbeb006dda0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbed01405b0 0x7fbed013e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbed0072520 0x7fbed0137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 --2- 172.21.15.72:0/727138142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbed006d510 0x7fbed00aeb50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.130+0000 7fbebcff9640 1 -- 172.21.15.72:0/727138142 >> 172.21.15.72:0/727138142 conn(0x7fbed00b1810 msgr2=0x7fbed0142cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.131+0000 7fbebcff9640 1 -- 172.21.15.72:0/727138142 shutdown_connections 2024-03-24T10:36:53.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.131+0000 7fbebcff9640 1 -- 172.21.15.72:0/727138142 wait complete. 2024-03-24T10:36:53.148 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-03-24T10:36:53.148 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.178+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5fa8068120 con 0x7f5fa80cd2d0 2024-03-24T10:36:53.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.178+0000 7f5f9e7fc640 1 -- 172.21.15.72:0/3357583445 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5f98057fc0 con 0x7f5fa80cd2d0 2024-03-24T10:36:53.179 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.180+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5f8c06b8e0 msgr2=0x7f5f8c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.180+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5f8c06b8e0 0x7f5f8c06dda0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80afeb0 tx=0x7f5fa000b040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.180+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa80cd2d0 msgr2=0x7f5fa8158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.180+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa80cd2d0 0x7f5fa8158ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800c3e0 tx=0x7f5f9800c8a0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 shutdown_connections 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5f8c06b8e0 0x7f5f8c06dda0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5fa815a560 0x7f5fa8200290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5fa80cd2d0 0x7f5fa8158ae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 --2- 172.21.15.72:0/3357583445 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5fa806b600 0x7f5fa80ab000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 >> 172.21.15.72:0/3357583445 conn(0x7f5fa80b2590 msgr2=0x7f5fa80b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 shutdown_connections 2024-03-24T10:36:53.184 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.181+0000 7f5fb01e2640 1 -- 172.21.15.72:0/3357583445 wait complete. 2024-03-24T10:36:53.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.185+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6c04005540 con 0x7f6c1c0364f0 2024-03-24T10:36:53.186 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.185+0000 7f6c217fa640 1 -- 172.21.15.72:0/100403966 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6c10018070 con 0x7f6c1c0364f0 2024-03-24T10:36:53.186 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.186+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff8f4068bf0 con 0x7ff8f40cf0c0 2024-03-24T10:36:53.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.187+0000 7ff8ea7fc640 1 -- 172.21.15.72:0/4169177631 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff8ec060f70 con 0x7ff8f40cf0c0 2024-03-24T10:36:53.187 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.188+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6c0806b8e0 msgr2=0x7f6c0806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.188+0000 7f6c2af13640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6c0806b8e0 0x7f6c0806dda0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c2406a440 tx=0x7f6c2408d040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.188+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 msgr2=0x7f6c1c04a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.188+0000 7f6c2af13640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 0x7f6c1c04a580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000c5f0 tx=0x7f6c1000c9f0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 shutdown_connections 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6c0806b8e0 0x7f6c0806dda0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6c1c0e1300 0x7f6c1c051750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c1c0364f0 0x7f6c1c04a580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.189 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 --2- 172.21.15.72:0/100403966 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c1c035340 0x7f6c1c178120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 >> 172.21.15.72:0/100403966 conn(0x7f6c1c01e6f0 msgr2=0x7f6c1c007b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 shutdown_connections 2024-03-24T10:36:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.189+0000 7f6c2af13640 1 -- 172.21.15.72:0/100403966 wait complete. 2024-03-24T10:36:53.190 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8d806b8e0 msgr2=0x7ff8d806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8d806b8e0 0x7ff8d806dda0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4036000 tx=0x7ff8e4008030 comp rx=0 tx=0).stop 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 msgr2=0x7ff8f415fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f415fbf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00b9e0 tx=0x7ff8ec00bea0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 shutdown_connections 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8d806b8e0 0x7ff8d806dda0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8f416f330 0x7ff8f4164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8f40cf0c0 0x7ff8f415fbf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 --2- 172.21.15.72:0/4169177631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8f40cddf0 0x7ff8f408adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.191 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 >> 172.21.15.72:0/4169177631 conn(0x7ff8f40b16a0 msgr2=0x7ff8f4072380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 shutdown_connections 2024-03-24T10:36:53.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.190+0000 7ff8fac02640 1 -- 172.21.15.72:0/4169177631 wait complete. 2024-03-24T10:36:53.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-03-24T10:36:53.197 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-03-24T10:36:53.202 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.203+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efc401f15c0 con 0x7efc401619a0 2024-03-24T10:36:53.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.203+0000 7efc36ffd640 1 -- 172.21.15.72:0/3452682339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc401f15c0 con 0x7efc401619a0 2024-03-24T10:36:53.204 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:53.204 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-03-24T10:36:53.205 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f18380b4ba0 con 0x7f183814be80 2024-03-24T10:36:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc2406b8e0 msgr2=0x7efc2406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7f182dffb640 1 -- 172.21.15.72:0/908433032 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1828034070 con 0x7f183814be80 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc2406b8e0 0x7efc2406dda0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efc3c009940 tx=0x7efc3c009240 comp rx=0 tx=0).stop 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 msgr2=0x7efc400d2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 0x7efc400d2680 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efc30034760 tx=0x7efc300046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 shutdown_connections 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc2406b8e0 0x7efc2406dda0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc401619a0 0x7efc400d2680 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc401615c0 0x7efc400cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 --2- 172.21.15.72:0/3452682339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc400d10c0 0x7efc401eff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.205+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 >> 172.21.15.72:0/3452682339 conn(0x7efc4009d320 msgr2=0x7efc4006bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.208 INFO:teuthology.orchestra.run.smithi072.stdout:55834574859 2024-03-24T10:36:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.206+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 shutdown_connections 2024-03-24T10:36:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.206+0000 7efc4853e640 1 -- 172.21.15.72:0/3452682339 wait complete. 2024-03-24T10:36:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.206+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5538005810 con 0x7f555806e970 2024-03-24T10:36:53.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.206+0000 7f554dffb640 1 -- 172.21.15.72:0/1116506438 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5548015030 con 0x7f555806e970 2024-03-24T10:36:53.209 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f181c06b810 msgr2=0x7f181c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f181c06b810 0x7f181c06dcd0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1830005c00 tx=0x7f1830009040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f183814be80 msgr2=0x7f18381ecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f183814be80 0x7f18381ecc50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1828033000 tx=0x7f1828004730 comp rx=0 tx=0).stop 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 shutdown_connections 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f181c06b810 0x7f181c06dcd0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f18381ed190 0x7f1838161b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f183814be80 0x7f18381ecc50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 --2- 172.21.15.72:0/908433032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1838071a40 0x7f1838146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 >> 172.21.15.72:0/908433032 conn(0x7f18380b1810 msgr2=0x7f18380b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 shutdown_connections 2024-03-24T10:36:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.208+0000 7f183f684640 1 -- 172.21.15.72:0/908433032 wait complete. 2024-03-24T10:36:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f553c06b840 msgr2=0x7f553c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f553c06b840 0x7f553c06dd00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f55540090b0 tx=0x7f555403c040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555806e970 msgr2=0x7f5558146150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555806e970 0x7f5558146150 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f554800b490 tx=0x7f554800b950 comp rx=0 tx=0).stop 2024-03-24T10:36:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 shutdown_connections 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f553c06b840 0x7f553c06dd00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5558146690 0x7f555814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f555815aee0 0x7f555814a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 --2- 172.21.15.72:0/1116506438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f555806e970 0x7f5558146150 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 >> 172.21.15.72:0/1116506438 conn(0x7f55580b1810 msgr2=0x7f55580cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 shutdown_connections 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.210+0000 7f555f657640 1 -- 172.21.15.72:0/1116506438 wait complete. 2024-03-24T10:36:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.213+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f84a81564e0 con 0x7f84a8157de0 2024-03-24T10:36:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.213+0000 7f849effd640 1 -- 172.21.15.72:0/4015082362 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84a81564e0 con 0x7f84a8157de0 2024-03-24T10:36:53.214 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2024-03-24T10:36:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f848806b8e0 msgr2=0x7f848806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f848806b8e0 0x7f848806dda0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f849800a8b0 tx=0x7f8498008040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 msgr2=0x7f84a8154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 0x7f84a8154000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f849000e9b0 tx=0x7f849000ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 shutdown_connections 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f848806b8e0 0x7f848806dda0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f84a8158260 0x7f84a8203e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84a8157de0 0x7f84a8154000 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f849000e9b0 tx=0x7f849000ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 --2- 172.21.15.72:0/4015082362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f84a8071ec0 0x7f84a80ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 >> 172.21.15.72:0/4015082362 conn(0x7f84a80b2090 msgr2=0x7f84a806d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.215+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 shutdown_connections 2024-03-24T10:36:53.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.216+0000 7f84acfc9640 1 -- 172.21.15.72:0/4015082362 wait complete. 2024-03-24T10:36:53.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-03-24T10:36:53.221 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2024-03-24T10:36:53.224 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.225 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-03-24T10:36:53.226 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-03-24T10:36:53.229 DEBUG:teuthology.parallel:result is None 2024-03-24T10:36:53.229 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-24T10:36:53.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.368+0000 7faa4d34f640 1 Processor -- start 2024-03-24T10:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.368+0000 7faa4d34f640 1 -- start start 2024-03-24T10:36:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa4d34f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa4815e640 0x7faa480b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa4d34f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa480b3690 con 0x7faa480d0a00 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa4d34f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4806c6e0 con 0x7faa480cfe70 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa4d34f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7faa480b30d0 con 0x7faa4815e640 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa477fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7faa480d0a00 0x7faa480b14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37712/0 (socket says 172.21.15.72:37712) 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa477fe640 1 -- 172.21.15.72:0/3784160998 learned_addr learned my addr 172.21.15.72:0/3784160998 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa46ffd640 1 --2- 172.21.15.72:0/3784160998 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa4815e640 0x7faa480b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35831014 0 0) 0x7faa480b3690 con 0x7faa480d0a00 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa30003520 con 0x7faa480d0a00 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924369110 0 0) 0x7faa4806c6e0 con 0x7faa480cfe70 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa480b3690 con 0x7faa480cfe70 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa46ffd640 1 -- 172.21.15.72:0/3784160998 >> v1:172.21.15.79:6789/0 conn(0x7faa480cfe70 legacy=0x7faa480d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa46ffd640 1 -- 172.21.15.72:0/3784160998 >> v1:172.21.15.72:6789/0 conn(0x7faa480d0a00 legacy=0x7faa480b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.369+0000 7faa46ffd640 1 -- 172.21.15.72:0/3784160998 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa480b33b0 con 0x7faa4815e640 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.370+0000 7faa46ffd640 1 --2- 172.21.15.72:0/3784160998 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa4815e640 0x7faa480b2a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa380097d0 tx=0x7faa3802b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c580a1ecea0e7096 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.370+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38031770 con 0x7faa4815e640 2024-03-24T10:36:53.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.370+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa380318d0 con 0x7faa4815e640 2024-03-24T10:36:53.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.370+0000 7faa45ffb640 1 -- 172.21.15.72:0/3784160998 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38031c60 con 0x7faa4815e640 2024-03-24T10:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 -- 172.21.15.72:0/3784160998 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa4815e640 msgr2=0x7faa480b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3784160998 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa4815e640 0x7faa480b2a70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faa380097d0 tx=0x7faa3802b810 comp rx=0 tx=0).stop 2024-03-24T10:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 -- 172.21.15.72:0/3784160998 shutdown_connections 2024-03-24T10:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3784160998 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa4815e640 0x7faa480b2a70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 -- 172.21.15.72:0/3784160998 >> 172.21.15.72:0/3784160998 conn(0x7faa480d1d50 msgr2=0x7faa480d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 -- 172.21.15.72:0/3784160998 shutdown_connections 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.371+0000 7faa4d34f640 1 -- 172.21.15.72:0/3784160998 wait complete. 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.372+0000 7faa4d34f640 1 Processor -- start 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.372+0000 7faa4d34f640 1 -- start start 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa480cfe70 0x7faa480c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa480d0a00 0x7faa480afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 0x7faa4814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7faa480c8a40 con 0x7faa4815e640 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faa480c8760 con 0x7faa480d0a00 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7faa48151b30 con 0x7faa480cfe70 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 0x7faa4814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa46ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa480cfe70 0x7faa480c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa467fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa480d0a00 0x7faa480afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 0x7faa4814fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51590/0 (socket says 172.21.15.72:51590) 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa46ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa480cfe70 0x7faa480c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36230/0 (socket says 172.21.15.72:36230) 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 -- 172.21.15.72:0/3908441597 learned_addr learned my addr 172.21.15.72:0/3908441597 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 -- 172.21.15.72:0/3908441597 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa480cfe70 msgr2=0x7faa480c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa480cfe70 0x7faa480c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 -- 172.21.15.72:0/3908441597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa480d0a00 msgr2=0x7faa480afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa480d0a00 0x7faa480afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 -- 172.21.15.72:0/3908441597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa38009400 con 0x7faa4815e640 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa477fe640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 0x7faa4814fda0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa4000cb40 tx=0x7faa4000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4000aca0 con 0x7faa4815e640 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4000ae20 con 0x7faa4815e640 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa48151e10 con 0x7faa4815e640 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40012640 con 0x7faa4815e640 2024-03-24T10:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.373+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa480c8370 con 0x7faa4815e640 2024-03-24T10:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.374+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4809fe20 con 0x7faa4815e640 2024-03-24T10:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.375+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7faa40007070 con 0x7faa4815e640 2024-03-24T10:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.375+0000 7faa2f7fe640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faa3406b810 0x7faa3406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.375+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faa4008a4e0 con 0x7faa4815e640 2024-03-24T10:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.375+0000 7faa46ffd640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faa3406b810 0x7faa3406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.376+0000 7faa46ffd640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faa3406b810 0x7faa3406dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa38036000 tx=0x7faa3803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.380+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7faa40054c70 con 0x7faa4815e640 2024-03-24T10:36:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.550+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faa480d11b0 con 0x7faa3406b810 2024-03-24T10:36:53.558 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.558+0000 7faa2f7fe640 1 -- 172.21.15.72:0/3908441597 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7faa38031a40 con 0x7faa3406b810 2024-03-24T10:36:53.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:53.564 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:36:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faa3406b810 msgr2=0x7faa3406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faa3406b810 0x7faa3406dcd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7faa38036000 tx=0x7faa3803d040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 msgr2=0x7faa4814fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 0x7faa4814fda0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faa4000cb40 tx=0x7faa4000a060 comp rx=0 tx=0).stop 2024-03-24T10:36:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 shutdown_connections 2024-03-24T10:36:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faa3406b810 0x7faa3406dcd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7faa4815e640 0x7faa4814fda0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faa480d0a00 0x7faa480afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 --2- 172.21.15.72:0/3908441597 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7faa480cfe70 0x7faa480c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 >> 172.21.15.72:0/3908441597 conn(0x7faa480d1d50 msgr2=0x7faa480cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 shutdown_connections 2024-03-24T10:36:53.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.561+0000 7faa4d34f640 1 -- 172.21.15.72:0/3908441597 wait complete. 2024-03-24T10:36:53.572 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-03-24T10:36:52.144811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003402"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978256+0000","last_change":"2024-03-24T10:36:25.218550+0000","last_active":"2024-03-24T10:36:31.978256+0000","last_peered":"2024-03-24T10:36:31.978256+0000","last_clean":"2024-03-24T10:36:31.978256+0000","last_became_active":"2024-03-24T10:36:25.218268+0000","last_became_peered":"2024-03-24T10:36:25.218268+0000","last_unstale":"2024-03-24T10:36:31.978256+0000","last_undegraded":"2024-03-24T10:36:31.978256+0000","last_fullsized":"2024-03-24T10:36:31.978256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:50:40.435818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240464+0000","last_change":"2024-03-24T10:36:26.226821+0000","last_active":"2024-03-24T10:36:31.240464+0000","last_peered":"2024-03-24T10:36:31.240464+0000","last_clean":"2024-03-24T10:36:31.240464+0000","last_became_active":"2024-03-24T10:36:26.226545+0000","last_became_peered":"2024-03-24T10:36:26.226545+0000","last_unstale":"2024-03-24T10:36:31.240464+0000","last_undegraded":"2024-03-24T10:36:31.240464+0000","last_fullsized":"2024-03-24T10:36:31.240464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239815+0000","last_change":"2024-03-24T10:36:30.290828+0000","last_active":"2024-03-24T10:36:31.239815+0000","last_peered":"2024-03-24T10:36:31.239815+0000","last_clean":"2024-03-24T10:36:31.239815+0000","last_became_active":"2024-03-24T10:36:30.290163+0000","last_became_peered":"2024-03-24T10:36:30.290163+0000","last_unstale":"2024-03-24T10:36:31.239815+0000","last_undegraded":"2024-03-24T10:36:31.239815+0000","last_fullsized":"2024-03-24T10:36:31.239815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240623+0000","last_change":"2024-03-24T10:36:25.212258+0000","last_active":"2024-03-24T10:36:31.240623+0000","last_peered":"2024-03-24T10:36:31.240623+0000","last_clean":"2024-03-24T10:36:31.240623+0000","last_became_active":"2024-03-24T10:36:25.211985+0000","last_became_peered":"2024-03-24T10:36:25.211985+0000","last_unstale":"2024-03-24T10:36:31.240623+0000","last_undegraded":"2024-03-24T10:36:31.240623+0000","last_fullsized":"2024-03-24T10:36:31.240623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977983+0000","last_change":"2024-03-24T10:36:26.245457+0000","last_active":"2024-03-24T10:36:31.977983+0000","last_peered":"2024-03-24T10:36:31.977983+0000","last_clean":"2024-03-24T10:36:31.977983+0000","last_became_active":"2024-03-24T10:36:26.245157+0000","last_became_peered":"2024-03-24T10:36:26.245157+0000","last_unstale":"2024-03-24T10:36:31.977983+0000","last_undegraded":"2024-03-24T10:36:31.977983+0000","last_fullsized":"2024-03-24T10:36:31.977983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239707+0000","last_change":"2024-03-24T10:36:30.258067+0000","last_active":"2024-03-24T10:36:31.239707+0000","last_peered":"2024-03-24T10:36:31.239707+0000","last_clean":"2024-03-24T10:36:31.239707+0000","last_became_active":"2024-03-24T10:36:30.257502+0000","last_became_peered":"2024-03-24T10:36:30.257502+0000","last_unstale":"2024-03-24T10:36:31.239707+0000","last_undegraded":"2024-03-24T10:36:31.239707+0000","last_fullsized":"2024-03-24T10:36:31.239707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:22.635599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978573+0000","last_change":"2024-03-24T10:36:25.222492+0000","last_active":"2024-03-24T10:36:31.978573+0000","last_peered":"2024-03-24T10:36:31.978573+0000","last_clean":"2024-03-24T10:36:31.978573+0000","last_became_active":"2024-03-24T10:36:25.222187+0000","last_became_peered":"2024-03-24T10:36:25.222187+0000","last_unstale":"2024-03-24T10:36:31.978573+0000","last_undegraded":"2024-03-24T10:36:31.978573+0000","last_fullsized":"2024-03-24T10:36:31.978573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:02.259009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240704+0000","last_change":"2024-03-24T10:36:26.241575+0000","last_active":"2024-03-24T10:36:31.240704+0000","last_peered":"2024-03-24T10:36:31.240704+0000","last_clean":"2024-03-24T10:36:31.240704+0000","last_became_active":"2024-03-24T10:36:26.240567+0000","last_became_peered":"2024-03-24T10:36:26.240567+0000","last_unstale":"2024-03-24T10:36:31.240704+0000","last_undegraded":"2024-03-24T10:36:31.240704+0000","last_fullsized":"2024-03-24T10:36:31.240704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240064+0000","last_change":"2024-03-24T10:36:30.255999+0000","last_active":"2024-03-24T10:36:31.240064+0000","last_peered":"2024-03-24T10:36:31.240064+0000","last_clean":"2024-03-24T10:36:31.240064+0000","last_became_active":"2024-03-24T10:36:30.255602+0000","last_became_peered":"2024-03-24T10:36:30.255602+0000","last_unstale":"2024-03-24T10:36:31.240064+0000","last_undegraded":"2024-03-24T10:36:31.240064+0000","last_fullsized":"2024-03-24T10:36:31.240064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978234+0000","last_change":"2024-03-24T10:36:25.221818+0000","last_active":"2024-03-24T10:36:31.978234+0000","last_peered":"2024-03-24T10:36:31.978234+0000","last_clean":"2024-03-24T10:36:31.978234+0000","last_became_active":"2024-03-24T10:36:25.221527+0000","last_became_peered":"2024-03-24T10:36:25.221527+0000","last_unstale":"2024-03-24T10:36:31.978234+0000","last_undegraded":"2024-03-24T10:36:31.978234+0000","last_fullsized":"2024-03-24T10:36:31.978234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240821+0000","last_change":"2024-03-24T10:36:26.232930+0000","last_active":"2024-03-24T10:36:31.240821+0000","last_peered":"2024-03-24T10:36:31.240821+0000","last_clean":"2024-03-24T10:36:31.240821+0000","last_became_active":"2024-03-24T10:36:26.232665+0000","last_became_peered":"2024-03-24T10:36:26.232665+0000","last_unstale":"2024-03-24T10:36:31.240821+0000","last_undegraded":"2024-03-24T10:36:31.240821+0000","last_fullsized":"2024-03-24T10:36:31.240821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239844+0000","last_change":"2024-03-24T10:36:30.251201+0000","last_active":"2024-03-24T10:36:31.239844+0000","last_peered":"2024-03-24T10:36:31.239844+0000","last_clean":"2024-03-24T10:36:31.239844+0000","last_became_active":"2024-03-24T10:36:30.250845+0000","last_became_peered":"2024-03-24T10:36:30.250845+0000","last_unstale":"2024-03-24T10:36:31.239844+0000","last_undegraded":"2024-03-24T10:36:31.239844+0000","last_fullsized":"2024-03-24T10:36:31.239844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:15.088511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977560+0000","last_change":"2024-03-24T10:36:26.233671+0000","last_active":"2024-03-24T10:36:31.977560+0000","last_peered":"2024-03-24T10:36:31.977560+0000","last_clean":"2024-03-24T10:36:31.977560+0000","last_became_active":"2024-03-24T10:36:26.233382+0000","last_became_peered":"2024-03-24T10:36:26.233382+0000","last_unstale":"2024-03-24T10:36:31.977560+0000","last_undegraded":"2024-03-24T10:36:31.977560+0000","last_fullsized":"2024-03-24T10:36:31.977560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978239+0000","last_change":"2024-03-24T10:36:25.221318+0000","last_active":"2024-03-24T10:36:31.978239+0000","last_peered":"2024-03-24T10:36:31.978239+0000","last_clean":"2024-03-24T10:36:31.978239+0000","last_became_active":"2024-03-24T10:36:25.220530+0000","last_became_peered":"2024-03-24T10:36:25.220530+0000","last_unstale":"2024-03-24T10:36:31.978239+0000","last_undegraded":"2024-03-24T10:36:31.978239+0000","last_fullsized":"2024-03-24T10:36:31.978239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240532+0000","last_change":"2024-03-24T10:36:30.257835+0000","last_active":"2024-03-24T10:36:31.240532+0000","last_peered":"2024-03-24T10:36:31.240532+0000","last_clean":"2024-03-24T10:36:31.240532+0000","last_became_active":"2024-03-24T10:36:30.257484+0000","last_became_peered":"2024-03-24T10:36:30.257484+0000","last_unstale":"2024-03-24T10:36:31.240532+0000","last_undegraded":"2024-03-24T10:36:31.240532+0000","last_fullsized":"2024-03-24T10:36:31.240532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240057+0000","last_change":"2024-03-24T10:36:26.228855+0000","last_active":"2024-03-24T10:36:31.240057+0000","last_peered":"2024-03-24T10:36:31.240057+0000","last_clean":"2024-03-24T10:36:31.240057+0000","last_became_active":"2024-03-24T10:36:26.228590+0000","last_became_peered":"2024-03-24T10:36:26.228590+0000","last_unstale":"2024-03-24T10:36:31.240057+0000","last_undegraded":"2024-03-24T10:36:31.240057+0000","last_fullsized":"2024-03-24T10:36:31.240057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978913+0000","last_change":"2024-03-24T10:36:25.217987+0000","last_active":"2024-03-24T10:36:31.978913+0000","last_peered":"2024-03-24T10:36:31.978913+0000","last_clean":"2024-03-24T10:36:31.978913+0000","last_became_active":"2024-03-24T10:36:25.217693+0000","last_became_peered":"2024-03-24T10:36:25.217693+0000","last_unstale":"2024-03-24T10:36:31.978913+0000","last_undegraded":"2024-03-24T10:36:31.978913+0000","last_fullsized":"2024-03-24T10:36:31.978913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240063+0000","last_change":"2024-03-24T10:36:30.255718+0000","last_active":"2024-03-24T10:36:31.240063+0000","last_peered":"2024-03-24T10:36:31.240063+0000","last_clean":"2024-03-24T10:36:31.240063+0000","last_became_active":"2024-03-24T10:36:30.255368+0000","last_became_peered":"2024-03-24T10:36:30.255368+0000","last_unstale":"2024-03-24T10:36:31.240063+0000","last_undegraded":"2024-03-24T10:36:31.240063+0000","last_fullsized":"2024-03-24T10:36:31.240063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240629+0000","last_change":"2024-03-24T10:36:26.219340+0000","last_active":"2024-03-24T10:36:31.240629+0000","last_peered":"2024-03-24T10:36:31.240629+0000","last_clean":"2024-03-24T10:36:31.240629+0000","last_became_active":"2024-03-24T10:36:26.219047+0000","last_became_peered":"2024-03-24T10:36:26.219047+0000","last_unstale":"2024-03-24T10:36:31.240629+0000","last_undegraded":"2024-03-24T10:36:31.240629+0000","last_fullsized":"2024-03-24T10:36:31.240629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978316+0000","last_change":"2024-03-24T10:36:25.218156+0000","last_active":"2024-03-24T10:36:31.978316+0000","last_peered":"2024-03-24T10:36:31.978316+0000","last_clean":"2024-03-24T10:36:31.978316+0000","last_became_active":"2024-03-24T10:36:25.217886+0000","last_became_peered":"2024-03-24T10:36:25.217886+0000","last_unstale":"2024-03-24T10:36:31.978316+0000","last_undegraded":"2024-03-24T10:36:31.978316+0000","last_fullsized":"2024-03-24T10:36:31.978316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979111+0000","last_change":"2024-03-24T10:36:30.289797+0000","last_active":"2024-03-24T10:36:31.979111+0000","last_peered":"2024-03-24T10:36:31.979111+0000","last_clean":"2024-03-24T10:36:31.979111+0000","last_became_active":"2024-03-24T10:36:30.288673+0000","last_became_peered":"2024-03-24T10:36:30.288673+0000","last_unstale":"2024-03-24T10:36:31.979111+0000","last_undegraded":"2024-03-24T10:36:31.979111+0000","last_fullsized":"2024-03-24T10:36:31.979111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240174+0000","last_change":"2024-03-24T10:36:26.216354+0000","last_active":"2024-03-24T10:36:31.240174+0000","last_peered":"2024-03-24T10:36:31.240174+0000","last_clean":"2024-03-24T10:36:31.240174+0000","last_became_active":"2024-03-24T10:36:26.215438+0000","last_became_peered":"2024-03-24T10:36:26.215438+0000","last_unstale":"2024-03-24T10:36:31.240174+0000","last_undegraded":"2024-03-24T10:36:31.240174+0000","last_fullsized":"2024-03-24T10:36:31.240174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:47:16.583659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:25.219905+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:25.219621+0000","last_became_peered":"2024-03-24T10:36:25.219621+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240448+0000","last_change":"2024-03-24T10:36:30.258214+0000","last_active":"2024-03-24T10:36:31.240448+0000","last_peered":"2024-03-24T10:36:31.240448+0000","last_clean":"2024-03-24T10:36:31.240448+0000","last_became_active":"2024-03-24T10:36:30.257701+0000","last_became_peered":"2024-03-24T10:36:30.257701+0000","last_unstale":"2024-03-24T10:36:31.240448+0000","last_undegraded":"2024-03-24T10:36:31.240448+0000","last_fullsized":"2024-03-24T10:36:31.240448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978555+0000","last_change":"2024-03-24T10:36:26.228673+0000","last_active":"2024-03-24T10:36:31.978555+0000","last_peered":"2024-03-24T10:36:31.978555+0000","last_clean":"2024-03-24T10:36:31.978555+0000","last_became_active":"2024-03-24T10:36:26.228223+0000","last_became_peered":"2024-03-24T10:36:26.228223+0000","last_unstale":"2024-03-24T10:36:31.978555+0000","last_undegraded":"2024-03-24T10:36:31.978555+0000","last_fullsized":"2024-03-24T10:36:31.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978776+0000","last_change":"2024-03-24T10:36:25.218606+0000","last_active":"2024-03-24T10:36:31.978776+0000","last_peered":"2024-03-24T10:36:31.978776+0000","last_clean":"2024-03-24T10:36:31.978776+0000","last_became_active":"2024-03-24T10:36:25.218305+0000","last_became_peered":"2024-03-24T10:36:25.218305+0000","last_unstale":"2024-03-24T10:36:31.978776+0000","last_undegraded":"2024-03-24T10:36:31.978776+0000","last_fullsized":"2024-03-24T10:36:31.978776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239964+0000","last_change":"2024-03-24T10:36:30.291483+0000","last_active":"2024-03-24T10:36:31.239964+0000","last_peered":"2024-03-24T10:36:31.239964+0000","last_clean":"2024-03-24T10:36:31.239964+0000","last_became_active":"2024-03-24T10:36:30.291163+0000","last_became_peered":"2024-03-24T10:36:30.291163+0000","last_unstale":"2024-03-24T10:36:31.239964+0000","last_undegraded":"2024-03-24T10:36:31.239964+0000","last_fullsized":"2024-03-24T10:36:31.239964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240422+0000","last_change":"2024-03-24T10:36:26.234337+0000","last_active":"2024-03-24T10:36:31.240422+0000","last_peered":"2024-03-24T10:36:31.240422+0000","last_clean":"2024-03-24T10:36:31.240422+0000","last_became_active":"2024-03-24T10:36:26.234055+0000","last_became_peered":"2024-03-24T10:36:26.234055+0000","last_unstale":"2024-03-24T10:36:31.240422+0000","last_undegraded":"2024-03-24T10:36:31.240422+0000","last_fullsized":"2024-03-24T10:36:31.240422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979094+0000","last_change":"2024-03-24T10:36:25.216567+0000","last_active":"2024-03-24T10:36:31.979094+0000","last_peered":"2024-03-24T10:36:31.979094+0000","last_clean":"2024-03-24T10:36:31.979094+0000","last_became_active":"2024-03-24T10:36:25.216217+0000","last_became_peered":"2024-03-24T10:36:25.216217+0000","last_unstale":"2024-03-24T10:36:31.979094+0000","last_undegraded":"2024-03-24T10:36:31.979094+0000","last_fullsized":"2024-03-24T10:36:31.979094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239785+0000","last_change":"2024-03-24T10:36:30.292210+0000","last_active":"2024-03-24T10:36:31.239785+0000","last_peered":"2024-03-24T10:36:31.239785+0000","last_clean":"2024-03-24T10:36:31.239785+0000","last_became_active":"2024-03-24T10:36:30.291693+0000","last_became_peered":"2024-03-24T10:36:30.291693+0000","last_unstale":"2024-03-24T10:36:31.239785+0000","last_undegraded":"2024-03-24T10:36:31.239785+0000","last_fullsized":"2024-03-24T10:36:31.239785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978627+0000","last_change":"2024-03-24T10:36:26.216940+0000","last_active":"2024-03-24T10:36:31.978627+0000","last_peered":"2024-03-24T10:36:31.978627+0000","last_clean":"2024-03-24T10:36:31.978627+0000","last_became_active":"2024-03-24T10:36:26.216516+0000","last_became_peered":"2024-03-24T10:36:26.216516+0000","last_unstale":"2024-03-24T10:36:31.978627+0000","last_undegraded":"2024-03-24T10:36:31.978627+0000","last_fullsized":"2024-03-24T10:36:31.978627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978689+0000","last_change":"2024-03-24T10:36:25.220871+0000","last_active":"2024-03-24T10:36:31.978689+0000","last_peered":"2024-03-24T10:36:31.978689+0000","last_clean":"2024-03-24T10:36:31.978689+0000","last_became_active":"2024-03-24T10:36:25.220566+0000","last_became_peered":"2024-03-24T10:36:25.220566+0000","last_unstale":"2024-03-24T10:36:31.978689+0000","last_undegraded":"2024-03-24T10:36:31.978689+0000","last_fullsized":"2024-03-24T10:36:31.978689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:11.467800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978512+0000","last_change":"2024-03-24T10:36:30.287965+0000","last_active":"2024-03-24T10:36:31.978512+0000","last_peered":"2024-03-24T10:36:31.978512+0000","last_clean":"2024-03-24T10:36:31.978512+0000","last_became_active":"2024-03-24T10:36:30.287151+0000","last_became_peered":"2024-03-24T10:36:30.287151+0000","last_unstale":"2024-03-24T10:36:31.978512+0000","last_undegraded":"2024-03-24T10:36:31.978512+0000","last_fullsized":"2024-03-24T10:36:31.978512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:42.603073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240890+0000","last_change":"2024-03-24T10:36:26.228488+0000","last_active":"2024-03-24T10:36:31.240890+0000","last_peered":"2024-03-24T10:36:31.240890+0000","last_clean":"2024-03-24T10:36:31.240890+0000","last_became_active":"2024-03-24T10:36:26.228001+0000","last_became_peered":"2024-03-24T10:36:26.228001+0000","last_unstale":"2024-03-24T10:36:31.240890+0000","last_undegraded":"2024-03-24T10:36:31.240890+0000","last_fullsized":"2024-03-24T10:36:31.240890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978655+0000","last_change":"2024-03-24T10:36:25.213196+0000","last_active":"2024-03-24T10:36:31.978655+0000","last_peered":"2024-03-24T10:36:31.978655+0000","last_clean":"2024-03-24T10:36:31.978655+0000","last_became_active":"2024-03-24T10:36:25.212908+0000","last_became_peered":"2024-03-24T10:36:25.212908+0000","last_unstale":"2024-03-24T10:36:31.978655+0000","last_undegraded":"2024-03-24T10:36:31.978655+0000","last_fullsized":"2024-03-24T10:36:31.978655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977909+0000","last_change":"2024-03-24T10:36:30.257971+0000","last_active":"2024-03-24T10:36:31.977909+0000","last_peered":"2024-03-24T10:36:31.977909+0000","last_clean":"2024-03-24T10:36:31.977909+0000","last_became_active":"2024-03-24T10:36:30.257595+0000","last_became_peered":"2024-03-24T10:36:30.257595+0000","last_unstale":"2024-03-24T10:36:31.977909+0000","last_undegraded":"2024-03-24T10:36:31.977909+0000","last_fullsized":"2024-03-24T10:36:31.977909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240167+0000","last_change":"2024-03-24T10:36:26.230507+0000","last_active":"2024-03-24T10:36:31.240167+0000","last_peered":"2024-03-24T10:36:31.240167+0000","last_clean":"2024-03-24T10:36:31.240167+0000","last_became_active":"2024-03-24T10:36:26.230065+0000","last_became_peered":"2024-03-24T10:36:26.230065+0000","last_unstale":"2024-03-24T10:36:31.240167+0000","last_undegraded":"2024-03-24T10:36:31.240167+0000","last_fullsized":"2024-03-24T10:36:31.240167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240522+0000","last_change":"2024-03-24T10:36:25.215977+0000","last_active":"2024-03-24T10:36:31.240522+0000","last_peered":"2024-03-24T10:36:31.240522+0000","last_clean":"2024-03-24T10:36:31.240522+0000","last_became_active":"2024-03-24T10:36:25.215688+0000","last_became_peered":"2024-03-24T10:36:25.215688+0000","last_unstale":"2024-03-24T10:36:31.240522+0000","last_undegraded":"2024-03-24T10:36:31.240522+0000","last_fullsized":"2024-03-24T10:36:31.240522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978606+0000","last_change":"2024-03-24T10:36:30.255099+0000","last_active":"2024-03-24T10:36:31.978606+0000","last_peered":"2024-03-24T10:36:31.978606+0000","last_clean":"2024-03-24T10:36:31.978606+0000","last_became_active":"2024-03-24T10:36:30.254701+0000","last_became_peered":"2024-03-24T10:36:30.254701+0000","last_unstale":"2024-03-24T10:36:31.978606+0000","last_undegraded":"2024-03-24T10:36:31.978606+0000","last_fullsized":"2024-03-24T10:36:31.978606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977951+0000","last_change":"2024-03-24T10:36:26.218799+0000","last_active":"2024-03-24T10:36:31.977951+0000","last_peered":"2024-03-24T10:36:31.977951+0000","last_clean":"2024-03-24T10:36:31.977951+0000","last_became_active":"2024-03-24T10:36:26.218417+0000","last_became_peered":"2024-03-24T10:36:26.218417+0000","last_unstale":"2024-03-24T10:36:31.977951+0000","last_undegraded":"2024-03-24T10:36:31.977951+0000","last_fullsized":"2024-03-24T10:36:31.977951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638115+0000","last_change":"2024-03-24T10:36:25.215346+0000","last_active":"2024-03-24T10:36:31.638115+0000","last_peered":"2024-03-24T10:36:31.638115+0000","last_clean":"2024-03-24T10:36:31.638115+0000","last_became_active":"2024-03-24T10:36:25.215072+0000","last_became_peered":"2024-03-24T10:36:25.215072+0000","last_unstale":"2024-03-24T10:36:31.638115+0000","last_undegraded":"2024-03-24T10:36:31.638115+0000","last_fullsized":"2024-03-24T10:36:31.638115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979217+0000","last_change":"2024-03-24T10:36:30.258147+0000","last_active":"2024-03-24T10:36:31.979217+0000","last_peered":"2024-03-24T10:36:31.979217+0000","last_clean":"2024-03-24T10:36:31.979217+0000","last_became_active":"2024-03-24T10:36:30.257704+0000","last_became_peered":"2024-03-24T10:36:30.257704+0000","last_unstale":"2024-03-24T10:36:31.979217+0000","last_undegraded":"2024-03-24T10:36:31.979217+0000","last_fullsized":"2024-03-24T10:36:31.979217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977926+0000","last_change":"2024-03-24T10:36:26.235288+0000","last_active":"2024-03-24T10:36:31.977926+0000","last_peered":"2024-03-24T10:36:31.977926+0000","last_clean":"2024-03-24T10:36:31.977926+0000","last_became_active":"2024-03-24T10:36:26.235008+0000","last_became_peered":"2024-03-24T10:36:26.235008+0000","last_unstale":"2024-03-24T10:36:31.977926+0000","last_undegraded":"2024-03-24T10:36:31.977926+0000","last_fullsized":"2024-03-24T10:36:31.977926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:56:34.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978361+0000","last_change":"2024-03-24T10:36:25.223252+0000","last_active":"2024-03-24T10:36:31.978361+0000","last_peered":"2024-03-24T10:36:31.978361+0000","last_clean":"2024-03-24T10:36:31.978361+0000","last_became_active":"2024-03-24T10:36:25.222927+0000","last_became_peered":"2024-03-24T10:36:25.222927+0000","last_unstale":"2024-03-24T10:36:31.978361+0000","last_undegraded":"2024-03-24T10:36:31.978361+0000","last_fullsized":"2024-03-24T10:36:31.978361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978487+0000","last_change":"2024-03-24T10:36:30.287525+0000","last_active":"2024-03-24T10:36:31.978487+0000","last_peered":"2024-03-24T10:36:31.978487+0000","last_clean":"2024-03-24T10:36:31.978487+0000","last_became_active":"2024-03-24T10:36:30.287145+0000","last_became_peered":"2024-03-24T10:36:30.287145+0000","last_unstale":"2024-03-24T10:36:31.978487+0000","last_undegraded":"2024-03-24T10:36:31.978487+0000","last_fullsized":"2024-03-24T10:36:31.978487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239931+0000","last_change":"2024-03-24T10:36:26.245809+0000","last_active":"2024-03-24T10:36:31.239931+0000","last_peered":"2024-03-24T10:36:31.239931+0000","last_clean":"2024-03-24T10:36:31.239931+0000","last_became_active":"2024-03-24T10:36:26.245498+0000","last_became_peered":"2024-03-24T10:36:26.245498+0000","last_unstale":"2024-03-24T10:36:31.239931+0000","last_undegraded":"2024-03-24T10:36:31.239931+0000","last_fullsized":"2024-03-24T10:36:31.239931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240567+0000","last_change":"2024-03-24T10:36:25.216299+0000","last_active":"2024-03-24T10:36:31.240567+0000","last_peered":"2024-03-24T10:36:31.240567+0000","last_clean":"2024-03-24T10:36:31.240567+0000","last_became_active":"2024-03-24T10:36:25.215751+0000","last_became_peered":"2024-03-24T10:36:25.215751+0000","last_unstale":"2024-03-24T10:36:31.240567+0000","last_undegraded":"2024-03-24T10:36:31.240567+0000","last_fullsized":"2024-03-24T10:36:31.240567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978454+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:36:31.978454+0000","last_peered":"2024-03-24T10:36:31.978454+0000","last_clean":"2024-03-24T10:36:31.978454+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:36:31.978454+0000","last_undegraded":"2024-03-24T10:36:31.978454+0000","last_fullsized":"2024-03-24T10:36:31.978454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977877+0000","last_change":"2024-03-24T10:36:30.288784+0000","last_active":"2024-03-24T10:36:31.977877+0000","last_peered":"2024-03-24T10:36:31.977877+0000","last_clean":"2024-03-24T10:36:31.977877+0000","last_became_active":"2024-03-24T10:36:30.288412+0000","last_became_peered":"2024-03-24T10:36:30.288412+0000","last_unstale":"2024-03-24T10:36:31.977877+0000","last_undegraded":"2024-03-24T10:36:31.977877+0000","last_fullsized":"2024-03-24T10:36:31.977877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978384+0000","last_change":"2024-03-24T10:36:26.245642+0000","last_active":"2024-03-24T10:36:31.978384+0000","last_peered":"2024-03-24T10:36:31.978384+0000","last_clean":"2024-03-24T10:36:31.978384+0000","last_became_active":"2024-03-24T10:36:26.245341+0000","last_became_peered":"2024-03-24T10:36:26.245341+0000","last_unstale":"2024-03-24T10:36:31.978384+0000","last_undegraded":"2024-03-24T10:36:31.978384+0000","last_fullsized":"2024-03-24T10:36:31.978384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638364+0000","last_change":"2024-03-24T10:36:25.220827+0000","last_active":"2024-03-24T10:36:31.638364+0000","last_peered":"2024-03-24T10:36:31.638364+0000","last_clean":"2024-03-24T10:36:31.638364+0000","last_became_active":"2024-03-24T10:36:25.220515+0000","last_became_peered":"2024-03-24T10:36:25.220515+0000","last_unstale":"2024-03-24T10:36:31.638364+0000","last_undegraded":"2024-03-24T10:36:31.638364+0000","last_fullsized":"2024-03-24T10:36:31.638364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977666+0000","last_change":"2024-03-24T10:36:30.288795+0000","last_active":"2024-03-24T10:36:31.977666+0000","last_peered":"2024-03-24T10:36:31.977666+0000","last_clean":"2024-03-24T10:36:31.977666+0000","last_became_active":"2024-03-24T10:36:30.288440+0000","last_became_peered":"2024-03-24T10:36:30.288440+0000","last_unstale":"2024-03-24T10:36:31.977666+0000","last_undegraded":"2024-03-24T10:36:31.977666+0000","last_fullsized":"2024-03-24T10:36:31.977666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240779+0000","last_change":"2024-03-24T10:36:26.228495+0000","last_active":"2024-03-24T10:36:31.240779+0000","last_peered":"2024-03-24T10:36:31.240779+0000","last_clean":"2024-03-24T10:36:31.240779+0000","last_became_active":"2024-03-24T10:36:26.227905+0000","last_became_peered":"2024-03-24T10:36:26.227905+0000","last_unstale":"2024-03-24T10:36:31.240779+0000","last_undegraded":"2024-03-24T10:36:31.240779+0000","last_fullsized":"2024-03-24T10:36:31.240779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978754+0000","last_change":"2024-03-24T10:36:25.217156+0000","last_active":"2024-03-24T10:36:31.978754+0000","last_peered":"2024-03-24T10:36:31.978754+0000","last_clean":"2024-03-24T10:36:31.978754+0000","last_became_active":"2024-03-24T10:36:25.216896+0000","last_became_peered":"2024-03-24T10:36:25.216896+0000","last_unstale":"2024-03-24T10:36:31.978754+0000","last_undegraded":"2024-03-24T10:36:31.978754+0000","last_fullsized":"2024-03-24T10:36:31.978754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978225+0000","last_change":"2024-03-24T10:36:30.260197+0000","last_active":"2024-03-24T10:36:31.978225+0000","last_peered":"2024-03-24T10:36:31.978225+0000","last_clean":"2024-03-24T10:36:31.978225+0000","last_became_active":"2024-03-24T10:36:30.259827+0000","last_became_peered":"2024-03-24T10:36:30.259827+0000","last_unstale":"2024-03-24T10:36:31.978225+0000","last_undegraded":"2024-03-24T10:36:31.978225+0000","last_fullsized":"2024-03-24T10:36:31.978225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978711+0000","last_change":"2024-03-24T10:36:26.236212+0000","last_active":"2024-03-24T10:36:31.978711+0000","last_peered":"2024-03-24T10:36:31.978711+0000","last_clean":"2024-03-24T10:36:31.978711+0000","last_became_active":"2024-03-24T10:36:26.235669+0000","last_became_peered":"2024-03-24T10:36:26.235669+0000","last_unstale":"2024-03-24T10:36:31.978711+0000","last_undegraded":"2024-03-24T10:36:31.978711+0000","last_fullsized":"2024-03-24T10:36:31.978711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:22.915113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638384+0000","last_change":"2024-03-24T10:36:25.219420+0000","last_active":"2024-03-24T10:36:31.638384+0000","last_peered":"2024-03-24T10:36:31.638384+0000","last_clean":"2024-03-24T10:36:31.638384+0000","last_became_active":"2024-03-24T10:36:25.218854+0000","last_became_peered":"2024-03-24T10:36:25.218854+0000","last_unstale":"2024-03-24T10:36:31.638384+0000","last_undegraded":"2024-03-24T10:36:31.638384+0000","last_fullsized":"2024-03-24T10:36:31.638384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239363+0000","last_change":"2024-03-24T10:36:30.287411+0000","last_active":"2024-03-24T10:36:31.239363+0000","last_peered":"2024-03-24T10:36:31.239363+0000","last_clean":"2024-03-24T10:36:31.239363+0000","last_became_active":"2024-03-24T10:36:30.286957+0000","last_became_peered":"2024-03-24T10:36:30.286957+0000","last_unstale":"2024-03-24T10:36:31.239363+0000","last_undegraded":"2024-03-24T10:36:31.239363+0000","last_fullsized":"2024-03-24T10:36:31.239363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978539+0000","last_change":"2024-03-24T10:36:26.236702+0000","last_active":"2024-03-24T10:36:31.978539+0000","last_peered":"2024-03-24T10:36:31.978539+0000","last_clean":"2024-03-24T10:36:31.978539+0000","last_became_active":"2024-03-24T10:36:26.236444+0000","last_became_peered":"2024-03-24T10:36:26.236444+0000","last_unstale":"2024-03-24T10:36:31.978539+0000","last_undegraded":"2024-03-24T10:36:31.978539+0000","last_fullsized":"2024-03-24T10:36:31.978539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240722+0000","last_change":"2024-03-24T10:36:25.213103+0000","last_active":"2024-03-24T10:36:31.240722+0000","last_peered":"2024-03-24T10:36:31.240722+0000","last_clean":"2024-03-24T10:36:31.240722+0000","last_became_active":"2024-03-24T10:36:25.212568+0000","last_became_peered":"2024-03-24T10:36:25.212568+0000","last_unstale":"2024-03-24T10:36:31.240722+0000","last_undegraded":"2024-03-24T10:36:31.240722+0000","last_fullsized":"2024-03-24T10:36:31.240722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239802+0000","last_change":"2024-03-24T10:36:30.257883+0000","last_active":"2024-03-24T10:36:31.239802+0000","last_peered":"2024-03-24T10:36:31.239802+0000","last_clean":"2024-03-24T10:36:31.239802+0000","last_became_active":"2024-03-24T10:36:30.257543+0000","last_became_peered":"2024-03-24T10:36:30.257543+0000","last_unstale":"2024-03-24T10:36:31.239802+0000","last_undegraded":"2024-03-24T10:36:31.239802+0000","last_fullsized":"2024-03-24T10:36:31.239802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:25.370328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978339+0000","last_change":"2024-03-24T10:36:26.235416+0000","last_active":"2024-03-24T10:36:31.978339+0000","last_peered":"2024-03-24T10:36:31.978339+0000","last_clean":"2024-03-24T10:36:31.978339+0000","last_became_active":"2024-03-24T10:36:26.235039+0000","last_became_peered":"2024-03-24T10:36:26.235039+0000","last_unstale":"2024-03-24T10:36:31.978339+0000","last_undegraded":"2024-03-24T10:36:31.978339+0000","last_fullsized":"2024-03-24T10:36:31.978339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638000+0000","last_change":"2024-03-24T10:36:25.215430+0000","last_active":"2024-03-24T10:36:31.638000+0000","last_peered":"2024-03-24T10:36:31.638000+0000","last_clean":"2024-03-24T10:36:31.638000+0000","last_became_active":"2024-03-24T10:36:25.215118+0000","last_became_peered":"2024-03-24T10:36:25.215118+0000","last_unstale":"2024-03-24T10:36:31.638000+0000","last_undegraded":"2024-03-24T10:36:31.638000+0000","last_fullsized":"2024-03-24T10:36:31.638000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978465+0000","last_change":"2024-03-24T10:36:30.252499+0000","last_active":"2024-03-24T10:36:31.978465+0000","last_peered":"2024-03-24T10:36:31.978465+0000","last_clean":"2024-03-24T10:36:31.978465+0000","last_became_active":"2024-03-24T10:36:30.252134+0000","last_became_peered":"2024-03-24T10:36:30.252134+0000","last_unstale":"2024-03-24T10:36:31.978465+0000","last_undegraded":"2024-03-24T10:36:31.978465+0000","last_fullsized":"2024-03-24T10:36:31.978465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977517+0000","last_change":"2024-03-24T10:36:26.226532+0000","last_active":"2024-03-24T10:36:31.977517+0000","last_peered":"2024-03-24T10:36:31.977517+0000","last_clean":"2024-03-24T10:36:31.977517+0000","last_became_active":"2024-03-24T10:36:26.226220+0000","last_became_peered":"2024-03-24T10:36:26.226220+0000","last_unstale":"2024-03-24T10:36:31.977517+0000","last_undegraded":"2024-03-24T10:36:31.977517+0000","last_fullsized":"2024-03-24T10:36:31.977517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977582+0000","last_change":"2024-03-24T10:36:25.216401+0000","last_active":"2024-03-24T10:36:31.977582+0000","last_peered":"2024-03-24T10:36:31.977582+0000","last_clean":"2024-03-24T10:36:31.977582+0000","last_became_active":"2024-03-24T10:36:25.216137+0000","last_became_peered":"2024-03-24T10:36:25.216137+0000","last_unstale":"2024-03-24T10:36:31.977582+0000","last_undegraded":"2024-03-24T10:36:31.977582+0000","last_fullsized":"2024-03-24T10:36:31.977582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240400+0000","last_change":"2024-03-24T10:36:30.287578+0000","last_active":"2024-03-24T10:36:31.240400+0000","last_peered":"2024-03-24T10:36:31.240400+0000","last_clean":"2024-03-24T10:36:31.240400+0000","last_became_active":"2024-03-24T10:36:30.287214+0000","last_became_peered":"2024-03-24T10:36:30.287214+0000","last_unstale":"2024-03-24T10:36:31.240400+0000","last_undegraded":"2024-03-24T10:36:31.240400+0000","last_fullsized":"2024-03-24T10:36:31.240400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:27:44.336084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978149+0000","last_change":"2024-03-24T10:36:26.235579+0000","last_active":"2024-03-24T10:36:31.978149+0000","last_peered":"2024-03-24T10:36:31.978149+0000","last_clean":"2024-03-24T10:36:31.978149+0000","last_became_active":"2024-03-24T10:36:26.234789+0000","last_became_peered":"2024-03-24T10:36:26.234789+0000","last_unstale":"2024-03-24T10:36:31.978149+0000","last_undegraded":"2024-03-24T10:36:31.978149+0000","last_fullsized":"2024-03-24T10:36:31.978149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240458+0000","last_change":"2024-03-24T10:36:25.213457+0000","last_active":"2024-03-24T10:36:31.240458+0000","last_peered":"2024-03-24T10:36:31.240458+0000","last_clean":"2024-03-24T10:36:31.240458+0000","last_became_active":"2024-03-24T10:36:25.213160+0000","last_became_peered":"2024-03-24T10:36:25.213160+0000","last_unstale":"2024-03-24T10:36:31.240458+0000","last_undegraded":"2024-03-24T10:36:31.240458+0000","last_fullsized":"2024-03-24T10:36:31.240458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240747+0000","last_change":"2024-03-24T10:36:30.287535+0000","last_active":"2024-03-24T10:36:31.240747+0000","last_peered":"2024-03-24T10:36:31.240747+0000","last_clean":"2024-03-24T10:36:31.240747+0000","last_became_active":"2024-03-24T10:36:30.287117+0000","last_became_peered":"2024-03-24T10:36:30.287117+0000","last_unstale":"2024-03-24T10:36:31.240747+0000","last_undegraded":"2024-03-24T10:36:31.240747+0000","last_fullsized":"2024-03-24T10:36:31.240747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:14:00.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978297+0000","last_change":"2024-03-24T10:36:26.236223+0000","last_active":"2024-03-24T10:36:31.978297+0000","last_peered":"2024-03-24T10:36:31.978297+0000","last_clean":"2024-03-24T10:36:31.978297+0000","last_became_active":"2024-03-24T10:36:26.235923+0000","last_became_peered":"2024-03-24T10:36:26.235923+0000","last_unstale":"2024-03-24T10:36:31.978297+0000","last_undegraded":"2024-03-24T10:36:31.978297+0000","last_fullsized":"2024-03-24T10:36:31.978297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978459+0000","last_change":"2024-03-24T10:36:25.209119+0000","last_active":"2024-03-24T10:36:31.978459+0000","last_peered":"2024-03-24T10:36:31.978459+0000","last_clean":"2024-03-24T10:36:31.978459+0000","last_became_active":"2024-03-24T10:36:25.208379+0000","last_became_peered":"2024-03-24T10:36:25.208379+0000","last_unstale":"2024-03-24T10:36:31.978459+0000","last_undegraded":"2024-03-24T10:36:31.978459+0000","last_fullsized":"2024-03-24T10:36:31.978459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240879+0000","last_change":"2024-03-24T10:36:30.288794+0000","last_active":"2024-03-24T10:36:31.240879+0000","last_peered":"2024-03-24T10:36:31.240879+0000","last_clean":"2024-03-24T10:36:31.240879+0000","last_became_active":"2024-03-24T10:36:30.288455+0000","last_became_peered":"2024-03-24T10:36:30.288455+0000","last_unstale":"2024-03-24T10:36:31.240879+0000","last_undegraded":"2024-03-24T10:36:31.240879+0000","last_fullsized":"2024-03-24T10:36:31.240879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978280+0000","last_change":"2024-03-24T10:36:26.235572+0000","last_active":"2024-03-24T10:36:31.978280+0000","last_peered":"2024-03-24T10:36:31.978280+0000","last_clean":"2024-03-24T10:36:31.978280+0000","last_became_active":"2024-03-24T10:36:26.234988+0000","last_became_peered":"2024-03-24T10:36:26.234988+0000","last_unstale":"2024-03-24T10:36:31.978280+0000","last_undegraded":"2024-03-24T10:36:31.978280+0000","last_fullsized":"2024-03-24T10:36:31.978280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:35.680520+0000","last_change":"2024-03-24T10:36:25.218162+0000","last_active":"2024-03-24T10:36:35.680520+0000","last_peered":"2024-03-24T10:36:35.680520+0000","last_clean":"2024-03-24T10:36:35.680520+0000","last_became_active":"2024-03-24T10:36:25.217883+0000","last_became_peered":"2024-03-24T10:36:25.217883+0000","last_unstale":"2024-03-24T10:36:35.680520+0000","last_undegraded":"2024-03-24T10:36:35.680520+0000","last_fullsized":"2024-03-24T10:36:35.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978846+0000","last_change":"2024-03-24T10:36:30.257936+0000","last_active":"2024-03-24T10:36:31.978846+0000","last_peered":"2024-03-24T10:36:31.978846+0000","last_clean":"2024-03-24T10:36:31.978846+0000","last_became_active":"2024-03-24T10:36:30.257563+0000","last_became_peered":"2024-03-24T10:36:30.257563+0000","last_unstale":"2024-03-24T10:36:31.978846+0000","last_undegraded":"2024-03-24T10:36:31.978846+0000","last_fullsized":"2024-03-24T10:36:31.978846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240985+0000","last_change":"2024-03-24T10:36:26.231768+0000","last_active":"2024-03-24T10:36:31.240985+0000","last_peered":"2024-03-24T10:36:31.240985+0000","last_clean":"2024-03-24T10:36:31.240985+0000","last_became_active":"2024-03-24T10:36:26.231505+0000","last_became_peered":"2024-03-24T10:36:26.231505+0000","last_unstale":"2024-03-24T10:36:31.240985+0000","last_undegraded":"2024-03-24T10:36:31.240985+0000","last_fullsized":"2024-03-24T10:36:31.240985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:12.471736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978654+0000","last_change":"2024-03-24T10:36:25.220658+0000","last_active":"2024-03-24T10:36:31.978654+0000","last_peered":"2024-03-24T10:36:31.978654+0000","last_clean":"2024-03-24T10:36:31.978654+0000","last_became_active":"2024-03-24T10:36:25.220451+0000","last_became_peered":"2024-03-24T10:36:25.220451+0000","last_unstale":"2024-03-24T10:36:31.978654+0000","last_undegraded":"2024-03-24T10:36:31.978654+0000","last_fullsized":"2024-03-24T10:36:31.978654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240105+0000","last_change":"2024-03-24T10:36:30.255676+0000","last_active":"2024-03-24T10:36:31.240105+0000","last_peered":"2024-03-24T10:36:31.240105+0000","last_clean":"2024-03-24T10:36:31.240105+0000","last_became_active":"2024-03-24T10:36:30.255314+0000","last_became_peered":"2024-03-24T10:36:30.255314+0000","last_unstale":"2024-03-24T10:36:31.240105+0000","last_undegraded":"2024-03-24T10:36:31.240105+0000","last_fullsized":"2024-03-24T10:36:31.240105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978164+0000","last_change":"2024-03-24T10:36:26.240945+0000","last_active":"2024-03-24T10:36:31.978164+0000","last_peered":"2024-03-24T10:36:31.978164+0000","last_clean":"2024-03-24T10:36:31.978164+0000","last_became_active":"2024-03-24T10:36:26.240664+0000","last_became_peered":"2024-03-24T10:36:26.240664+0000","last_unstale":"2024-03-24T10:36:31.978164+0000","last_undegraded":"2024-03-24T10:36:31.978164+0000","last_fullsized":"2024-03-24T10:36:31.978164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240312+0000","last_change":"2024-03-24T10:36:25.215416+0000","last_active":"2024-03-24T10:36:31.240312+0000","last_peered":"2024-03-24T10:36:31.240312+0000","last_clean":"2024-03-24T10:36:31.240312+0000","last_became_active":"2024-03-24T10:36:25.215130+0000","last_became_peered":"2024-03-24T10:36:25.215130+0000","last_unstale":"2024-03-24T10:36:31.240312+0000","last_undegraded":"2024-03-24T10:36:31.240312+0000","last_fullsized":"2024-03-24T10:36:31.240312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240235+0000","last_change":"2024-03-24T10:36:30.258107+0000","last_active":"2024-03-24T10:36:31.240235+0000","last_peered":"2024-03-24T10:36:31.240235+0000","last_clean":"2024-03-24T10:36:31.240235+0000","last_became_active":"2024-03-24T10:36:30.257548+0000","last_became_peered":"2024-03-24T10:36:30.257548+0000","last_unstale":"2024-03-24T10:36:31.240235+0000","last_undegraded":"2024-03-24T10:36:31.240235+0000","last_fullsized":"2024-03-24T10:36:31.240235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:27:22.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240228+0000","last_change":"2024-03-24T10:36:26.238486+0000","last_active":"2024-03-24T10:36:31.240228+0000","last_peered":"2024-03-24T10:36:31.240228+0000","last_clean":"2024-03-24T10:36:31.240228+0000","last_became_active":"2024-03-24T10:36:26.237843+0000","last_became_peered":"2024-03-24T10:36:26.237843+0000","last_unstale":"2024-03-24T10:36:31.240228+0000","last_undegraded":"2024-03-24T10:36:31.240228+0000","last_fullsized":"2024-03-24T10:36:31.240228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978669+0000","last_change":"2024-03-24T10:36:25.220880+0000","last_active":"2024-03-24T10:36:31.978669+0000","last_peered":"2024-03-24T10:36:31.978669+0000","last_clean":"2024-03-24T10:36:31.978669+0000","last_became_active":"2024-03-24T10:36:25.220622+0000","last_became_peered":"2024-03-24T10:36:25.220622+0000","last_unstale":"2024-03-24T10:36:31.978669+0000","last_undegraded":"2024-03-24T10:36:31.978669+0000","last_fullsized":"2024-03-24T10:36:31.978669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239888+0000","last_change":"2024-03-24T10:36:30.291355+0000","last_active":"2024-03-24T10:36:31.239888+0000","last_peered":"2024-03-24T10:36:31.239888+0000","last_clean":"2024-03-24T10:36:31.239888+0000","last_became_active":"2024-03-24T10:36:30.290079+0000","last_became_peered":"2024-03-24T10:36:30.290079+0000","last_unstale":"2024-03-24T10:36:31.239888+0000","last_undegraded":"2024-03-24T10:36:31.239888+0000","last_fullsized":"2024-03-24T10:36:31.239888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:26:51.570024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:30.290362+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:30.289924+0000","last_became_peered":"2024-03-24T10:36:30.289924+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978144+0000","last_change":"2024-03-24T10:36:26.223759+0000","last_active":"2024-03-24T10:36:31.978144+0000","last_peered":"2024-03-24T10:36:31.978144+0000","last_clean":"2024-03-24T10:36:31.978144+0000","last_became_active":"2024-03-24T10:36:26.223332+0000","last_became_peered":"2024-03-24T10:36:26.223332+0000","last_unstale":"2024-03-24T10:36:31.978144+0000","last_undegraded":"2024-03-24T10:36:31.978144+0000","last_fullsized":"2024-03-24T10:36:31.978144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239431+0000","last_change":"2024-03-24T10:36:25.211540+0000","last_active":"2024-03-24T10:36:31.239431+0000","last_peered":"2024-03-24T10:36:31.239431+0000","last_clean":"2024-03-24T10:36:31.239431+0000","last_became_active":"2024-03-24T10:36:25.211248+0000","last_became_peered":"2024-03-24T10:36:25.211248+0000","last_unstale":"2024-03-24T10:36:31.239431+0000","last_undegraded":"2024-03-24T10:36:31.239431+0000","last_fullsized":"2024-03-24T10:36:31.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977993+0000","last_change":"2024-03-24T10:36:30.254914+0000","last_active":"2024-03-24T10:36:31.977993+0000","last_peered":"2024-03-24T10:36:31.977993+0000","last_clean":"2024-03-24T10:36:31.977993+0000","last_became_active":"2024-03-24T10:36:30.254506+0000","last_became_peered":"2024-03-24T10:36:30.254506+0000","last_unstale":"2024-03-24T10:36:31.977993+0000","last_undegraded":"2024-03-24T10:36:31.977993+0000","last_fullsized":"2024-03-24T10:36:31.977993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239911+0000","last_change":"2024-03-24T10:36:26.226712+0000","last_active":"2024-03-24T10:36:31.239911+0000","last_peered":"2024-03-24T10:36:31.239911+0000","last_clean":"2024-03-24T10:36:31.239911+0000","last_became_active":"2024-03-24T10:36:26.226434+0000","last_became_peered":"2024-03-24T10:36:26.226434+0000","last_unstale":"2024-03-24T10:36:31.239911+0000","last_undegraded":"2024-03-24T10:36:31.239911+0000","last_fullsized":"2024-03-24T10:36:31.239911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240043+0000","last_change":"2024-03-24T10:36:25.216508+0000","last_active":"2024-03-24T10:36:31.240043+0000","last_peered":"2024-03-24T10:36:31.240043+0000","last_clean":"2024-03-24T10:36:31.240043+0000","last_became_active":"2024-03-24T10:36:25.216249+0000","last_became_peered":"2024-03-24T10:36:25.216249+0000","last_unstale":"2024-03-24T10:36:31.240043+0000","last_undegraded":"2024-03-24T10:36:31.240043+0000","last_fullsized":"2024-03-24T10:36:31.240043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977716+0000","last_change":"2024-03-24T10:36:25.217255+0000","last_active":"2024-03-24T10:36:31.977716+0000","last_peered":"2024-03-24T10:36:31.977716+0000","last_clean":"2024-03-24T10:36:31.977716+0000","last_became_active":"2024-03-24T10:36:25.216974+0000","last_became_peered":"2024-03-24T10:36:25.216974+0000","last_unstale":"2024-03-24T10:36:31.977716+0000","last_undegraded":"2024-03-24T10:36:31.977716+0000","last_fullsized":"2024-03-24T10:36:31.977716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978369+0000","last_change":"2024-03-24T10:36:26.235283+0000","last_active":"2024-03-24T10:36:31.978369+0000","last_peered":"2024-03-24T10:36:31.978369+0000","last_clean":"2024-03-24T10:36:31.978369+0000","last_became_active":"2024-03-24T10:36:26.234957+0000","last_became_peered":"2024-03-24T10:36:26.234957+0000","last_unstale":"2024-03-24T10:36:31.978369+0000","last_undegraded":"2024-03-24T10:36:31.978369+0000","last_fullsized":"2024-03-24T10:36:31.978369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638315+0000","last_change":"2024-03-24T10:36:30.258066+0000","last_active":"2024-03-24T10:36:31.638315+0000","last_peered":"2024-03-24T10:36:31.638315+0000","last_clean":"2024-03-24T10:36:31.638315+0000","last_became_active":"2024-03-24T10:36:30.257721+0000","last_became_peered":"2024-03-24T10:36:30.257721+0000","last_unstale":"2024-03-24T10:36:31.638315+0000","last_undegraded":"2024-03-24T10:36:31.638315+0000","last_fullsized":"2024-03-24T10:36:31.638315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:48.645675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240710+0000","last_change":"2024-03-24T10:36:25.217924+0000","last_active":"2024-03-24T10:36:31.240710+0000","last_peered":"2024-03-24T10:36:31.240710+0000","last_clean":"2024-03-24T10:36:31.240710+0000","last_became_active":"2024-03-24T10:36:25.217653+0000","last_became_peered":"2024-03-24T10:36:25.217653+0000","last_unstale":"2024-03-24T10:36:31.240710+0000","last_undegraded":"2024-03-24T10:36:31.240710+0000","last_fullsized":"2024-03-24T10:36:31.240710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:21:41.967893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239946+0000","last_change":"2024-03-24T10:36:26.222302+0000","last_active":"2024-03-24T10:36:31.239946+0000","last_peered":"2024-03-24T10:36:31.239946+0000","last_clean":"2024-03-24T10:36:31.239946+0000","last_became_active":"2024-03-24T10:36:26.221621+0000","last_became_peered":"2024-03-24T10:36:26.221621+0000","last_unstale":"2024-03-24T10:36:31.239946+0000","last_undegraded":"2024-03-24T10:36:31.239946+0000","last_fullsized":"2024-03-24T10:36:31.239946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240272+0000","last_change":"2024-03-24T10:36:30.252503+0000","last_active":"2024-03-24T10:36:31.240272+0000","last_peered":"2024-03-24T10:36:31.240272+0000","last_clean":"2024-03-24T10:36:31.240272+0000","last_became_active":"2024-03-24T10:36:30.252117+0000","last_became_peered":"2024-03-24T10:36:30.252117+0000","last_unstale":"2024-03-24T10:36:31.240272+0000","last_undegraded":"2024-03-24T10:36:31.240272+0000","last_fullsized":"2024-03-24T10:36:31.240272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:35:10.560451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977432+0000","last_change":"2024-03-24T10:36:26.227933+0000","last_active":"2024-03-24T10:36:31.977432+0000","last_peered":"2024-03-24T10:36:31.977432+0000","last_clean":"2024-03-24T10:36:31.977432+0000","last_became_active":"2024-03-24T10:36:26.227650+0000","last_became_peered":"2024-03-24T10:36:26.227650+0000","last_unstale":"2024-03-24T10:36:31.977432+0000","last_undegraded":"2024-03-24T10:36:31.977432+0000","last_fullsized":"2024-03-24T10:36:31.977432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638092+0000","last_change":"2024-03-24T10:36:26.240695+0000","last_active":"2024-03-24T10:36:31.638092+0000","last_peered":"2024-03-24T10:36:31.638092+0000","last_clean":"2024-03-24T10:36:31.638092+0000","last_became_active":"2024-03-24T10:36:26.240417+0000","last_became_peered":"2024-03-24T10:36:26.240417+0000","last_unstale":"2024-03-24T10:36:31.638092+0000","last_undegraded":"2024-03-24T10:36:31.638092+0000","last_fullsized":"2024-03-24T10:36:31.638092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240378+0000","last_change":"2024-03-24T10:36:26.242019+0000","last_active":"2024-03-24T10:36:31.240378+0000","last_peered":"2024-03-24T10:36:31.240378+0000","last_clean":"2024-03-24T10:36:31.240378+0000","last_became_active":"2024-03-24T10:36:26.241585+0000","last_became_peered":"2024-03-24T10:36:26.241585+0000","last_unstale":"2024-03-24T10:36:31.240378+0000","last_undegraded":"2024-03-24T10:36:31.240378+0000","last_fullsized":"2024-03-24T10:36:31.240378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978268+0000","last_change":"2024-03-24T10:36:26.228956+0000","last_active":"2024-03-24T10:36:31.978268+0000","last_peered":"2024-03-24T10:36:31.978268+0000","last_clean":"2024-03-24T10:36:31.978268+0000","last_became_active":"2024-03-24T10:36:26.228649+0000","last_became_peered":"2024-03-24T10:36:26.228649+0000","last_unstale":"2024-03-24T10:36:31.978268+0000","last_undegraded":"2024-03-24T10:36:31.978268+0000","last_fullsized":"2024-03-24T10:36:31.978268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240896+0000","last_change":"2024-03-24T10:36:26.230293+0000","last_active":"2024-03-24T10:36:31.240896+0000","last_peered":"2024-03-24T10:36:31.240896+0000","last_clean":"2024-03-24T10:36:31.240896+0000","last_became_active":"2024-03-24T10:36:26.229555+0000","last_became_peered":"2024-03-24T10:36:26.229555+0000","last_unstale":"2024-03-24T10:36:31.240896+0000","last_undegraded":"2024-03-24T10:36:31.240896+0000","last_fullsized":"2024-03-24T10:36:31.240896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978476+0000","last_change":"2024-03-24T10:36:26.222799+0000","last_active":"2024-03-24T10:36:31.978476+0000","last_peered":"2024-03-24T10:36:31.978476+0000","last_clean":"2024-03-24T10:36:31.978476+0000","last_became_active":"2024-03-24T10:36:26.221223+0000","last_became_peered":"2024-03-24T10:36:26.221223+0000","last_unstale":"2024-03-24T10:36:31.978476+0000","last_undegraded":"2024-03-24T10:36:31.978476+0000","last_fullsized":"2024-03-24T10:36:31.978476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978086+0000","last_change":"2024-03-24T10:36:26.226953+0000","last_active":"2024-03-24T10:36:31.978086+0000","last_peered":"2024-03-24T10:36:31.978086+0000","last_clean":"2024-03-24T10:36:31.978086+0000","last_became_active":"2024-03-24T10:36:26.226663+0000","last_became_peered":"2024-03-24T10:36:26.226663+0000","last_unstale":"2024-03-24T10:36:31.978086+0000","last_undegraded":"2024-03-24T10:36:31.978086+0000","last_fullsized":"2024-03-24T10:36:31.978086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240327+0000","last_change":"2024-03-24T10:36:26.229550+0000","last_active":"2024-03-24T10:36:31.240327+0000","last_peered":"2024-03-24T10:36:31.240327+0000","last_clean":"2024-03-24T10:36:31.240327+0000","last_became_active":"2024-03-24T10:36:26.229243+0000","last_became_peered":"2024-03-24T10:36:26.229243+0000","last_unstale":"2024-03-24T10:36:31.240327+0000","last_undegraded":"2024-03-24T10:36:31.240327+0000","last_fullsized":"2024-03-24T10:36:31.240327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239502+0000","last_change":"2024-03-24T10:36:26.228357+0000","last_active":"2024-03-24T10:36:31.239502+0000","last_peered":"2024-03-24T10:36:31.239502+0000","last_clean":"2024-03-24T10:36:31.239502+0000","last_became_active":"2024-03-24T10:36:26.228105+0000","last_became_peered":"2024-03-24T10:36:26.228105+0000","last_unstale":"2024-03-24T10:36:31.239502+0000","last_undegraded":"2024-03-24T10:36:31.239502+0000","last_fullsized":"2024-03-24T10:36:31.239502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240201+0000","last_change":"2024-03-24T10:36:26.230259+0000","last_active":"2024-03-24T10:36:31.240201+0000","last_peered":"2024-03-24T10:36:31.240201+0000","last_clean":"2024-03-24T10:36:31.240201+0000","last_became_active":"2024-03-24T10:36:26.229990+0000","last_became_peered":"2024-03-24T10:36:26.229990+0000","last_unstale":"2024-03-24T10:36:31.240201+0000","last_undegraded":"2024-03-24T10:36:31.240201+0000","last_fullsized":"2024-03-24T10:36:31.240201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240293+0000","last_change":"2024-03-24T10:36:26.242160+0000","last_active":"2024-03-24T10:36:31.240293+0000","last_peered":"2024-03-24T10:36:31.240293+0000","last_clean":"2024-03-24T10:36:31.240293+0000","last_became_active":"2024-03-24T10:36:26.241598+0000","last_became_peered":"2024-03-24T10:36:26.241598+0000","last_unstale":"2024-03-24T10:36:31.240293+0000","last_undegraded":"2024-03-24T10:36:31.240293+0000","last_fullsized":"2024-03-24T10:36:31.240293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978044+0000","last_change":"2024-03-24T10:36:26.239300+0000","last_active":"2024-03-24T10:36:31.978044+0000","last_peered":"2024-03-24T10:36:31.978044+0000","last_clean":"2024-03-24T10:36:31.978044+0000","last_became_active":"2024-03-24T10:36:26.239004+0000","last_became_peered":"2024-03-24T10:36:26.239004+0000","last_unstale":"2024-03-24T10:36:31.978044+0000","last_undegraded":"2024-03-24T10:36:31.978044+0000","last_fullsized":"2024-03-24T10:36:31.978044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977873+0000","last_change":"2024-03-24T10:36:26.234784+0000","last_active":"2024-03-24T10:36:31.977873+0000","last_peered":"2024-03-24T10:36:31.977873+0000","last_clean":"2024-03-24T10:36:31.977873+0000","last_became_active":"2024-03-24T10:36:26.234304+0000","last_became_peered":"2024-03-24T10:36:26.234304+0000","last_unstale":"2024-03-24T10:36:31.977873+0000","last_undegraded":"2024-03-24T10:36:31.977873+0000","last_fullsized":"2024-03-24T10:36:31.977873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978675+0000","last_change":"2024-03-24T10:36:26.234967+0000","last_active":"2024-03-24T10:36:31.978675+0000","last_peered":"2024-03-24T10:36:31.978675+0000","last_clean":"2024-03-24T10:36:31.978675+0000","last_became_active":"2024-03-24T10:36:26.234619+0000","last_became_peered":"2024-03-24T10:36:26.234619+0000","last_unstale":"2024-03-24T10:36:31.978675+0000","last_undegraded":"2024-03-24T10:36:31.978675+0000","last_fullsized":"2024-03-24T10:36:31.978675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638313+0000","last_change":"2024-03-24T10:36:26.218406+0000","last_active":"2024-03-24T10:36:31.638313+0000","last_peered":"2024-03-24T10:36:31.638313+0000","last_clean":"2024-03-24T10:36:31.638313+0000","last_became_active":"2024-03-24T10:36:26.218130+0000","last_became_peered":"2024-03-24T10:36:26.218130+0000","last_unstale":"2024-03-24T10:36:31.638313+0000","last_undegraded":"2024-03-24T10:36:31.638313+0000","last_fullsized":"2024-03-24T10:36:31.638313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240564+0000","last_change":"2024-03-24T10:36:26.241244+0000","last_active":"2024-03-24T10:36:31.240564+0000","last_peered":"2024-03-24T10:36:31.240564+0000","last_clean":"2024-03-24T10:36:31.240564+0000","last_became_active":"2024-03-24T10:36:26.240263+0000","last_became_peered":"2024-03-24T10:36:26.240263+0000","last_unstale":"2024-03-24T10:36:31.240564+0000","last_undegraded":"2024-03-24T10:36:31.240564+0000","last_fullsized":"2024-03-24T10:36:31.240564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239339+0000","last_change":"2024-03-24T10:36:26.233360+0000","last_active":"2024-03-24T10:36:31.239339+0000","last_peered":"2024-03-24T10:36:31.239339+0000","last_clean":"2024-03-24T10:36:31.239339+0000","last_became_active":"2024-03-24T10:36:26.232820+0000","last_became_peered":"2024-03-24T10:36:26.232820+0000","last_unstale":"2024-03-24T10:36:31.239339+0000","last_undegraded":"2024-03-24T10:36:31.239339+0000","last_fullsized":"2024-03-24T10:36:31.239339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978230+0000","last_change":"2024-03-24T10:36:26.229654+0000","last_active":"2024-03-24T10:36:31.978230+0000","last_peered":"2024-03-24T10:36:31.978230+0000","last_clean":"2024-03-24T10:36:31.978230+0000","last_became_active":"2024-03-24T10:36:26.229360+0000","last_became_peered":"2024-03-24T10:36:26.229360+0000","last_unstale":"2024-03-24T10:36:31.978230+0000","last_undegraded":"2024-03-24T10:36:31.978230+0000","last_fullsized":"2024-03-24T10:36:31.978230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978201+0000","last_change":"2024-03-24T10:36:26.232307+0000","last_active":"2024-03-24T10:36:31.978201+0000","last_peered":"2024-03-24T10:36:31.978201+0000","last_clean":"2024-03-24T10:36:31.978201+0000","last_became_active":"2024-03-24T10:36:26.232003+0000","last_became_peered":"2024-03-24T10:36:26.232003+0000","last_unstale":"2024-03-24T10:36:31.978201+0000","last_undegraded":"2024-03-24T10:36:31.978201+0000","last_fullsized":"2024-03-24T10:36:31.978201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240018+0000","last_change":"2024-03-24T10:36:26.227231+0000","last_active":"2024-03-24T10:36:31.240018+0000","last_peered":"2024-03-24T10:36:31.240018+0000","last_clean":"2024-03-24T10:36:31.240018+0000","last_became_active":"2024-03-24T10:36:26.225847+0000","last_became_peered":"2024-03-24T10:36:26.225847+0000","last_unstale":"2024-03-24T10:36:31.240018+0000","last_undegraded":"2024-03-24T10:36:31.240018+0000","last_fullsized":"2024-03-24T10:36:31.240018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240927+0000","last_change":"2024-03-24T10:36:26.232739+0000","last_active":"2024-03-24T10:36:31.240927+0000","last_peered":"2024-03-24T10:36:31.240927+0000","last_clean":"2024-03-24T10:36:31.240927+0000","last_became_active":"2024-03-24T10:36:26.231159+0000","last_became_peered":"2024-03-24T10:36:26.231159+0000","last_unstale":"2024-03-24T10:36:31.240927+0000","last_undegraded":"2024-03-24T10:36:31.240927+0000","last_fullsized":"2024-03-24T10:36:31.240927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977892+0000","last_change":"2024-03-24T10:36:26.244230+0000","last_active":"2024-03-24T10:36:31.977892+0000","last_peered":"2024-03-24T10:36:31.977892+0000","last_clean":"2024-03-24T10:36:31.977892+0000","last_became_active":"2024-03-24T10:36:26.243918+0000","last_became_peered":"2024-03-24T10:36:26.243918+0000","last_unstale":"2024-03-24T10:36:31.977892+0000","last_undegraded":"2024-03-24T10:36:31.977892+0000","last_fullsized":"2024-03-24T10:36:31.977892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978041+0000","last_change":"2024-03-24T10:36:26.244721+0000","last_active":"2024-03-24T10:36:31.978041+0000","last_peered":"2024-03-24T10:36:31.978041+0000","last_clean":"2024-03-24T10:36:31.978041+0000","last_became_active":"2024-03-24T10:36:26.244427+0000","last_became_peered":"2024-03-24T10:36:26.244427+0000","last_unstale":"2024-03-24T10:36:31.978041+0000","last_undegraded":"2024-03-24T10:36:31.978041+0000","last_fullsized":"2024-03-24T10:36:31.978041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978616+0000","last_change":"2024-03-24T10:36:26.242508+0000","last_active":"2024-03-24T10:36:31.978616+0000","last_peered":"2024-03-24T10:36:31.978616+0000","last_clean":"2024-03-24T10:36:31.978616+0000","last_became_active":"2024-03-24T10:36:26.242179+0000","last_became_peered":"2024-03-24T10:36:26.242179+0000","last_unstale":"2024-03-24T10:36:31.978616+0000","last_undegraded":"2024-03-24T10:36:31.978616+0000","last_fullsized":"2024-03-24T10:36:31.978616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:38.572103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239819+0000","last_change":"2024-03-24T10:36:26.235232+0000","last_active":"2024-03-24T10:36:31.239819+0000","last_peered":"2024-03-24T10:36:31.239819+0000","last_clean":"2024-03-24T10:36:31.239819+0000","last_became_active":"2024-03-24T10:36:26.234954+0000","last_became_peered":"2024-03-24T10:36:26.234954+0000","last_unstale":"2024-03-24T10:36:31.239819+0000","last_undegraded":"2024-03-24T10:36:31.239819+0000","last_fullsized":"2024-03-24T10:36:31.239819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978320+0000","last_change":"2024-03-24T10:36:26.235229+0000","last_active":"2024-03-24T10:36:31.978320+0000","last_peered":"2024-03-24T10:36:31.978320+0000","last_clean":"2024-03-24T10:36:31.978320+0000","last_became_active":"2024-03-24T10:36:26.234686+0000","last_became_peered":"2024-03-24T10:36:26.234686+0000","last_unstale":"2024-03-24T10:36:31.978320+0000","last_undegraded":"2024-03-24T10:36:31.978320+0000","last_fullsized":"2024-03-24T10:36:31.978320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240402+0000","last_change":"2024-03-24T10:36:26.242391+0000","last_active":"2024-03-24T10:36:31.240402+0000","last_peered":"2024-03-24T10:36:31.240402+0000","last_clean":"2024-03-24T10:36:31.240402+0000","last_became_active":"2024-03-24T10:36:26.241891+0000","last_became_peered":"2024-03-24T10:36:26.241891+0000","last_unstale":"2024-03-24T10:36:31.240402+0000","last_undegraded":"2024-03-24T10:36:31.240402+0000","last_fullsized":"2024-03-24T10:36:31.240402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978072+0000","last_change":"2024-03-24T10:36:26.224899+0000","last_active":"2024-03-24T10:36:31.978072+0000","last_peered":"2024-03-24T10:36:31.978072+0000","last_clean":"2024-03-24T10:36:31.978072+0000","last_became_active":"2024-03-24T10:36:26.224612+0000","last_became_peered":"2024-03-24T10:36:26.224612+0000","last_unstale":"2024-03-24T10:36:31.978072+0000","last_undegraded":"2024-03-24T10:36:31.978072+0000","last_fullsized":"2024-03-24T10:36:31.978072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240698+0000","last_change":"2024-03-24T10:36:26.241713+0000","last_active":"2024-03-24T10:36:31.240698+0000","last_peered":"2024-03-24T10:36:31.240698+0000","last_clean":"2024-03-24T10:36:31.240698+0000","last_became_active":"2024-03-24T10:36:26.241441+0000","last_became_peered":"2024-03-24T10:36:26.241441+0000","last_unstale":"2024-03-24T10:36:31.240698+0000","last_undegraded":"2024-03-24T10:36:31.240698+0000","last_fullsized":"2024-03-24T10:36:31.240698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978166+0000","last_change":"2024-03-24T10:36:26.229024+0000","last_active":"2024-03-24T10:36:31.978166+0000","last_peered":"2024-03-24T10:36:31.978166+0000","last_clean":"2024-03-24T10:36:31.978166+0000","last_became_active":"2024-03-24T10:36:26.228715+0000","last_became_peered":"2024-03-24T10:36:26.228715+0000","last_unstale":"2024-03-24T10:36:31.978166+0000","last_undegraded":"2024-03-24T10:36:31.978166+0000","last_fullsized":"2024-03-24T10:36:31.978166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979045+0000","last_change":"2024-03-24T10:36:26.226685+0000","last_active":"2024-03-24T10:36:31.979045+0000","last_peered":"2024-03-24T10:36:31.979045+0000","last_clean":"2024-03-24T10:36:31.979045+0000","last_became_active":"2024-03-24T10:36:26.226405+0000","last_became_peered":"2024-03-24T10:36:26.226405+0000","last_unstale":"2024-03-24T10:36:31.979045+0000","last_undegraded":"2024-03-24T10:36:31.979045+0000","last_fullsized":"2024-03-24T10:36:31.979045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978516+0000","last_change":"2024-03-24T10:36:26.234917+0000","last_active":"2024-03-24T10:36:31.978516+0000","last_peered":"2024-03-24T10:36:31.978516+0000","last_clean":"2024-03-24T10:36:31.978516+0000","last_became_active":"2024-03-24T10:36:26.234583+0000","last_became_peered":"2024-03-24T10:36:26.234583+0000","last_unstale":"2024-03-24T10:36:31.978516+0000","last_undegraded":"2024-03-24T10:36:31.978516+0000","last_fullsized":"2024-03-24T10:36:31.978516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:36:53.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:36:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 Processor -- start 2024-03-24T10:36:53.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 -- start start 2024-03-24T10:36:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb4406e500 0x7fcb44071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb44160040 0x7fcb440cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb44071630 con 0x7fcb440cee90 2024-03-24T10:36:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcb44160940 con 0x7fcb44160040 2024-03-24T10:36:53.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.713+0000 7fcb4aa6f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fcb440cf850 con 0x7fcb4406e500 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb43fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fcb440cee90 0x7fcb4415f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37722/0 (socket says 172.21.15.72:37722) 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb43fff640 1 -- 172.21.15.72:0/3730153625 learned_addr learned my addr 172.21.15.72:0/3730153625 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4900c640 1 --2- 172.21.15.72:0/3730153625 >> v2:172.21.15.79:3300/0 conn(0x7fcb44160040 0x7fcb440cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4880b640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb4406e500 0x7fcb44071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb437fe640 1 -- 172.21.15.72:0/3730153625 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1081997178 0 0) 0x7fcb44071630 con 0x7fcb440cee90 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb437fe640 1 -- 172.21.15.72:0/3730153625 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb34003520 con 0x7fcb440cee90 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4900c640 1 -- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb4406e500 msgr2=0x7fcb44071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4900c640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb4406e500 0x7fcb44071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4900c640 1 -- 172.21.15.72:0/3730153625 >> v1:172.21.15.72:6789/0 conn(0x7fcb440cee90 legacy=0x7fcb4415f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4900c640 1 -- 172.21.15.72:0/3730153625 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4415c220 con 0x7fcb44160040 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.714+0000 7fcb4880b640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb4406e500 0x7fcb44071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4900c640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb44160040 0x7fcb440cf310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009d90 tx=0x7fcb3c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd6230127d0f9c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb437fe640 1 -- 172.21.15.72:0/3730153625 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c02cc50 con 0x7fcb44160040 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb437fe640 1 -- 172.21.15.72:0/3730153625 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c02cdb0 con 0x7fcb44160040 2024-03-24T10:36:53.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb437fe640 1 -- 172.21.15.72:0/3730153625 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c034640 con 0x7fcb44160040 2024-03-24T10:36:53.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb44160040 msgr2=0x7fcb440cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.719 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb44160040 0x7fcb440cf310 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009d90 tx=0x7fcb3c02bea0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/3730153625 shutdown_connections 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb44160040 0x7fcb440cf310 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/3730153625 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb4406e500 0x7fcb44071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.715+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/3730153625 >> 172.21.15.72:0/3730153625 conn(0x7fcb440b1920 msgr2=0x7fcb440b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.716+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/3730153625 shutdown_connections 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.716+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/3730153625 wait complete. 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.717+0000 7fcb4aa6f640 1 Processor -- start 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.717+0000 7fcb4aa6f640 1 -- start start 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.717+0000 7fcb4aa6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 0x7fcb4414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.717+0000 7fcb4aa6f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb440cee90 0x7fcb4414a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4aa6f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb44160040 0x7fcb4414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4aa6f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb440aec20 con 0x7fcb440cee90 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4aa6f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb440aef00 con 0x7fcb4406e500 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4aa6f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fcb440af1e0 con 0x7fcb44160040 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb43fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb440cee90 0x7fcb4414a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 0x7fcb4414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 0x7fcb4414fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53720/0 (socket says 172.21.15.72:53720) 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 -- 172.21.15.72:0/2155064175 learned_addr learned my addr 172.21.15.72:0/2155064175 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4900c640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb44160040 0x7fcb4414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 -- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb44160040 msgr2=0x7fcb4414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb44160040 0x7fcb4414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 -- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb440cee90 msgr2=0x7fcb4414a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb440cee90 0x7fcb4414a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 -- 172.21.15.72:0/2155064175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb38009400 con 0x7fcb4406e500 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb43fff640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb440cee90 0x7fcb4414a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:53.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4880b640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 0x7fcb4414fef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800e960 tx=0x7fcb3800ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:53.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800ca00 con 0x7fcb4406e500 2024-03-24T10:36:53.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3800cb60 con 0x7fcb4406e500 2024-03-24T10:36:53.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb3c009a70 con 0x7fcb4406e500 2024-03-24T10:36:53.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38013470 con 0x7fcb4406e500 2024-03-24T10:36:53.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.718+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb440af7a0 con 0x7fcb4406e500 2024-03-24T10:36:53.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.719+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4404f550 con 0x7fcb4406e500 2024-03-24T10:36:53.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.720+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcb380135d0 con 0x7fcb4406e500 2024-03-24T10:36:53.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.720+0000 7fcb417fa640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb2806b810 0x7fcb2806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:53.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.720+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcb3808a6e0 con 0x7fcb4406e500 2024-03-24T10:36:53.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.720+0000 7fcb43fff640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb2806b810 0x7fcb2806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:53.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.720+0000 7fcb43fff640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb2806b810 0x7fcb2806dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb441f51f0 tx=0x7fcb30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:53.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.729+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcb38054e60 con 0x7fcb4406e500 2024-03-24T10:36:53.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.901+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcb440712c0 con 0x7fcb2806b810 2024-03-24T10:36:53.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.908+0000 7fcb417fa640 1 -- 172.21.15.72:0/2155064175 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fcb300018a0 con 0x7fcb2806b810 2024-03-24T10:36:53.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb2806b810 msgr2=0x7fcb2806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb2806b810 0x7fcb2806dcd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcb441f51f0 tx=0x7fcb30009040 comp rx=0 tx=0).stop 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 msgr2=0x7fcb4414fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 0x7fcb4414fef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800e960 tx=0x7fcb3800ee20 comp rx=0 tx=0).stop 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 shutdown_connections 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb2806b810 0x7fcb2806dcd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb44160040 0x7fcb4414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb440cee90 0x7fcb4414a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 --2- 172.21.15.72:0/2155064175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb4406e500 0x7fcb4414fef0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 >> 172.21.15.72:0/2155064175 conn(0x7fcb440b1920 msgr2=0x7fcb4415a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 shutdown_connections 2024-03-24T10:36:53.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:53.912+0000 7fcb4aa6f640 1 -- 172.21.15.72:0/2155064175 wait complete. 2024-03-24T10:36:53.925 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-03-24T10:36:52.144811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219476,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755244,"statfs":{"total":773094113280,"available":772869369856,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003402"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978256+0000","last_change":"2024-03-24T10:36:25.218550+0000","last_active":"2024-03-24T10:36:31.978256+0000","last_peered":"2024-03-24T10:36:31.978256+0000","last_clean":"2024-03-24T10:36:31.978256+0000","last_became_active":"2024-03-24T10:36:25.218268+0000","last_became_peered":"2024-03-24T10:36:25.218268+0000","last_unstale":"2024-03-24T10:36:31.978256+0000","last_undegraded":"2024-03-24T10:36:31.978256+0000","last_fullsized":"2024-03-24T10:36:31.978256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:50:40.435818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240464+0000","last_change":"2024-03-24T10:36:26.226821+0000","last_active":"2024-03-24T10:36:31.240464+0000","last_peered":"2024-03-24T10:36:31.240464+0000","last_clean":"2024-03-24T10:36:31.240464+0000","last_became_active":"2024-03-24T10:36:26.226545+0000","last_became_peered":"2024-03-24T10:36:26.226545+0000","last_unstale":"2024-03-24T10:36:31.240464+0000","last_undegraded":"2024-03-24T10:36:31.240464+0000","last_fullsized":"2024-03-24T10:36:31.240464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239815+0000","last_change":"2024-03-24T10:36:30.290828+0000","last_active":"2024-03-24T10:36:31.239815+0000","last_peered":"2024-03-24T10:36:31.239815+0000","last_clean":"2024-03-24T10:36:31.239815+0000","last_became_active":"2024-03-24T10:36:30.290163+0000","last_became_peered":"2024-03-24T10:36:30.290163+0000","last_unstale":"2024-03-24T10:36:31.239815+0000","last_undegraded":"2024-03-24T10:36:31.239815+0000","last_fullsized":"2024-03-24T10:36:31.239815+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240623+0000","last_change":"2024-03-24T10:36:25.212258+0000","last_active":"2024-03-24T10:36:31.240623+0000","last_peered":"2024-03-24T10:36:31.240623+0000","last_clean":"2024-03-24T10:36:31.240623+0000","last_became_active":"2024-03-24T10:36:25.211985+0000","last_became_peered":"2024-03-24T10:36:25.211985+0000","last_unstale":"2024-03-24T10:36:31.240623+0000","last_undegraded":"2024-03-24T10:36:31.240623+0000","last_fullsized":"2024-03-24T10:36:31.240623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977983+0000","last_change":"2024-03-24T10:36:26.245457+0000","last_active":"2024-03-24T10:36:31.977983+0000","last_peered":"2024-03-24T10:36:31.977983+0000","last_clean":"2024-03-24T10:36:31.977983+0000","last_became_active":"2024-03-24T10:36:26.245157+0000","last_became_peered":"2024-03-24T10:36:26.245157+0000","last_unstale":"2024-03-24T10:36:31.977983+0000","last_undegraded":"2024-03-24T10:36:31.977983+0000","last_fullsized":"2024-03-24T10:36:31.977983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239707+0000","last_change":"2024-03-24T10:36:30.258067+0000","last_active":"2024-03-24T10:36:31.239707+0000","last_peered":"2024-03-24T10:36:31.239707+0000","last_clean":"2024-03-24T10:36:31.239707+0000","last_became_active":"2024-03-24T10:36:30.257502+0000","last_became_peered":"2024-03-24T10:36:30.257502+0000","last_unstale":"2024-03-24T10:36:31.239707+0000","last_undegraded":"2024-03-24T10:36:31.239707+0000","last_fullsized":"2024-03-24T10:36:31.239707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:22.635599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978573+0000","last_change":"2024-03-24T10:36:25.222492+0000","last_active":"2024-03-24T10:36:31.978573+0000","last_peered":"2024-03-24T10:36:31.978573+0000","last_clean":"2024-03-24T10:36:31.978573+0000","last_became_active":"2024-03-24T10:36:25.222187+0000","last_became_peered":"2024-03-24T10:36:25.222187+0000","last_unstale":"2024-03-24T10:36:31.978573+0000","last_undegraded":"2024-03-24T10:36:31.978573+0000","last_fullsized":"2024-03-24T10:36:31.978573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:02.259009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240704+0000","last_change":"2024-03-24T10:36:26.241575+0000","last_active":"2024-03-24T10:36:31.240704+0000","last_peered":"2024-03-24T10:36:31.240704+0000","last_clean":"2024-03-24T10:36:31.240704+0000","last_became_active":"2024-03-24T10:36:26.240567+0000","last_became_peered":"2024-03-24T10:36:26.240567+0000","last_unstale":"2024-03-24T10:36:31.240704+0000","last_undegraded":"2024-03-24T10:36:31.240704+0000","last_fullsized":"2024-03-24T10:36:31.240704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240064+0000","last_change":"2024-03-24T10:36:30.255999+0000","last_active":"2024-03-24T10:36:31.240064+0000","last_peered":"2024-03-24T10:36:31.240064+0000","last_clean":"2024-03-24T10:36:31.240064+0000","last_became_active":"2024-03-24T10:36:30.255602+0000","last_became_peered":"2024-03-24T10:36:30.255602+0000","last_unstale":"2024-03-24T10:36:31.240064+0000","last_undegraded":"2024-03-24T10:36:31.240064+0000","last_fullsized":"2024-03-24T10:36:31.240064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978234+0000","last_change":"2024-03-24T10:36:25.221818+0000","last_active":"2024-03-24T10:36:31.978234+0000","last_peered":"2024-03-24T10:36:31.978234+0000","last_clean":"2024-03-24T10:36:31.978234+0000","last_became_active":"2024-03-24T10:36:25.221527+0000","last_became_peered":"2024-03-24T10:36:25.221527+0000","last_unstale":"2024-03-24T10:36:31.978234+0000","last_undegraded":"2024-03-24T10:36:31.978234+0000","last_fullsized":"2024-03-24T10:36:31.978234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240821+0000","last_change":"2024-03-24T10:36:26.232930+0000","last_active":"2024-03-24T10:36:31.240821+0000","last_peered":"2024-03-24T10:36:31.240821+0000","last_clean":"2024-03-24T10:36:31.240821+0000","last_became_active":"2024-03-24T10:36:26.232665+0000","last_became_peered":"2024-03-24T10:36:26.232665+0000","last_unstale":"2024-03-24T10:36:31.240821+0000","last_undegraded":"2024-03-24T10:36:31.240821+0000","last_fullsized":"2024-03-24T10:36:31.240821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239844+0000","last_change":"2024-03-24T10:36:30.251201+0000","last_active":"2024-03-24T10:36:31.239844+0000","last_peered":"2024-03-24T10:36:31.239844+0000","last_clean":"2024-03-24T10:36:31.239844+0000","last_became_active":"2024-03-24T10:36:30.250845+0000","last_became_peered":"2024-03-24T10:36:30.250845+0000","last_unstale":"2024-03-24T10:36:31.239844+0000","last_undegraded":"2024-03-24T10:36:31.239844+0000","last_fullsized":"2024-03-24T10:36:31.239844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:15.088511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977560+0000","last_change":"2024-03-24T10:36:26.233671+0000","last_active":"2024-03-24T10:36:31.977560+0000","last_peered":"2024-03-24T10:36:31.977560+0000","last_clean":"2024-03-24T10:36:31.977560+0000","last_became_active":"2024-03-24T10:36:26.233382+0000","last_became_peered":"2024-03-24T10:36:26.233382+0000","last_unstale":"2024-03-24T10:36:31.977560+0000","last_undegraded":"2024-03-24T10:36:31.977560+0000","last_fullsized":"2024-03-24T10:36:31.977560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978239+0000","last_change":"2024-03-24T10:36:25.221318+0000","last_active":"2024-03-24T10:36:31.978239+0000","last_peered":"2024-03-24T10:36:31.978239+0000","last_clean":"2024-03-24T10:36:31.978239+0000","last_became_active":"2024-03-24T10:36:25.220530+0000","last_became_peered":"2024-03-24T10:36:25.220530+0000","last_unstale":"2024-03-24T10:36:31.978239+0000","last_undegraded":"2024-03-24T10:36:31.978239+0000","last_fullsized":"2024-03-24T10:36:31.978239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240532+0000","last_change":"2024-03-24T10:36:30.257835+0000","last_active":"2024-03-24T10:36:31.240532+0000","last_peered":"2024-03-24T10:36:31.240532+0000","last_clean":"2024-03-24T10:36:31.240532+0000","last_became_active":"2024-03-24T10:36:30.257484+0000","last_became_peered":"2024-03-24T10:36:30.257484+0000","last_unstale":"2024-03-24T10:36:31.240532+0000","last_undegraded":"2024-03-24T10:36:31.240532+0000","last_fullsized":"2024-03-24T10:36:31.240532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240057+0000","last_change":"2024-03-24T10:36:26.228855+0000","last_active":"2024-03-24T10:36:31.240057+0000","last_peered":"2024-03-24T10:36:31.240057+0000","last_clean":"2024-03-24T10:36:31.240057+0000","last_became_active":"2024-03-24T10:36:26.228590+0000","last_became_peered":"2024-03-24T10:36:26.228590+0000","last_unstale":"2024-03-24T10:36:31.240057+0000","last_undegraded":"2024-03-24T10:36:31.240057+0000","last_fullsized":"2024-03-24T10:36:31.240057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978913+0000","last_change":"2024-03-24T10:36:25.217987+0000","last_active":"2024-03-24T10:36:31.978913+0000","last_peered":"2024-03-24T10:36:31.978913+0000","last_clean":"2024-03-24T10:36:31.978913+0000","last_became_active":"2024-03-24T10:36:25.217693+0000","last_became_peered":"2024-03-24T10:36:25.217693+0000","last_unstale":"2024-03-24T10:36:31.978913+0000","last_undegraded":"2024-03-24T10:36:31.978913+0000","last_fullsized":"2024-03-24T10:36:31.978913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240063+0000","last_change":"2024-03-24T10:36:30.255718+0000","last_active":"2024-03-24T10:36:31.240063+0000","last_peered":"2024-03-24T10:36:31.240063+0000","last_clean":"2024-03-24T10:36:31.240063+0000","last_became_active":"2024-03-24T10:36:30.255368+0000","last_became_peered":"2024-03-24T10:36:30.255368+0000","last_unstale":"2024-03-24T10:36:31.240063+0000","last_undegraded":"2024-03-24T10:36:31.240063+0000","last_fullsized":"2024-03-24T10:36:31.240063+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240629+0000","last_change":"2024-03-24T10:36:26.219340+0000","last_active":"2024-03-24T10:36:31.240629+0000","last_peered":"2024-03-24T10:36:31.240629+0000","last_clean":"2024-03-24T10:36:31.240629+0000","last_became_active":"2024-03-24T10:36:26.219047+0000","last_became_peered":"2024-03-24T10:36:26.219047+0000","last_unstale":"2024-03-24T10:36:31.240629+0000","last_undegraded":"2024-03-24T10:36:31.240629+0000","last_fullsized":"2024-03-24T10:36:31.240629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978316+0000","last_change":"2024-03-24T10:36:25.218156+0000","last_active":"2024-03-24T10:36:31.978316+0000","last_peered":"2024-03-24T10:36:31.978316+0000","last_clean":"2024-03-24T10:36:31.978316+0000","last_became_active":"2024-03-24T10:36:25.217886+0000","last_became_peered":"2024-03-24T10:36:25.217886+0000","last_unstale":"2024-03-24T10:36:31.978316+0000","last_undegraded":"2024-03-24T10:36:31.978316+0000","last_fullsized":"2024-03-24T10:36:31.978316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979111+0000","last_change":"2024-03-24T10:36:30.289797+0000","last_active":"2024-03-24T10:36:31.979111+0000","last_peered":"2024-03-24T10:36:31.979111+0000","last_clean":"2024-03-24T10:36:31.979111+0000","last_became_active":"2024-03-24T10:36:30.288673+0000","last_became_peered":"2024-03-24T10:36:30.288673+0000","last_unstale":"2024-03-24T10:36:31.979111+0000","last_undegraded":"2024-03-24T10:36:31.979111+0000","last_fullsized":"2024-03-24T10:36:31.979111+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240174+0000","last_change":"2024-03-24T10:36:26.216354+0000","last_active":"2024-03-24T10:36:31.240174+0000","last_peered":"2024-03-24T10:36:31.240174+0000","last_clean":"2024-03-24T10:36:31.240174+0000","last_became_active":"2024-03-24T10:36:26.215438+0000","last_became_peered":"2024-03-24T10:36:26.215438+0000","last_unstale":"2024-03-24T10:36:31.240174+0000","last_undegraded":"2024-03-24T10:36:31.240174+0000","last_fullsized":"2024-03-24T10:36:31.240174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:47:16.583659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:25.219905+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:25.219621+0000","last_became_peered":"2024-03-24T10:36:25.219621+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240448+0000","last_change":"2024-03-24T10:36:30.258214+0000","last_active":"2024-03-24T10:36:31.240448+0000","last_peered":"2024-03-24T10:36:31.240448+0000","last_clean":"2024-03-24T10:36:31.240448+0000","last_became_active":"2024-03-24T10:36:30.257701+0000","last_became_peered":"2024-03-24T10:36:30.257701+0000","last_unstale":"2024-03-24T10:36:31.240448+0000","last_undegraded":"2024-03-24T10:36:31.240448+0000","last_fullsized":"2024-03-24T10:36:31.240448+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978555+0000","last_change":"2024-03-24T10:36:26.228673+0000","last_active":"2024-03-24T10:36:31.978555+0000","last_peered":"2024-03-24T10:36:31.978555+0000","last_clean":"2024-03-24T10:36:31.978555+0000","last_became_active":"2024-03-24T10:36:26.228223+0000","last_became_peered":"2024-03-24T10:36:26.228223+0000","last_unstale":"2024-03-24T10:36:31.978555+0000","last_undegraded":"2024-03-24T10:36:31.978555+0000","last_fullsized":"2024-03-24T10:36:31.978555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978776+0000","last_change":"2024-03-24T10:36:25.218606+0000","last_active":"2024-03-24T10:36:31.978776+0000","last_peered":"2024-03-24T10:36:31.978776+0000","last_clean":"2024-03-24T10:36:31.978776+0000","last_became_active":"2024-03-24T10:36:25.218305+0000","last_became_peered":"2024-03-24T10:36:25.218305+0000","last_unstale":"2024-03-24T10:36:31.978776+0000","last_undegraded":"2024-03-24T10:36:31.978776+0000","last_fullsized":"2024-03-24T10:36:31.978776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239964+0000","last_change":"2024-03-24T10:36:30.291483+0000","last_active":"2024-03-24T10:36:31.239964+0000","last_peered":"2024-03-24T10:36:31.239964+0000","last_clean":"2024-03-24T10:36:31.239964+0000","last_became_active":"2024-03-24T10:36:30.291163+0000","last_became_peered":"2024-03-24T10:36:30.291163+0000","last_unstale":"2024-03-24T10:36:31.239964+0000","last_undegraded":"2024-03-24T10:36:31.239964+0000","last_fullsized":"2024-03-24T10:36:31.239964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240422+0000","last_change":"2024-03-24T10:36:26.234337+0000","last_active":"2024-03-24T10:36:31.240422+0000","last_peered":"2024-03-24T10:36:31.240422+0000","last_clean":"2024-03-24T10:36:31.240422+0000","last_became_active":"2024-03-24T10:36:26.234055+0000","last_became_peered":"2024-03-24T10:36:26.234055+0000","last_unstale":"2024-03-24T10:36:31.240422+0000","last_undegraded":"2024-03-24T10:36:31.240422+0000","last_fullsized":"2024-03-24T10:36:31.240422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979094+0000","last_change":"2024-03-24T10:36:25.216567+0000","last_active":"2024-03-24T10:36:31.979094+0000","last_peered":"2024-03-24T10:36:31.979094+0000","last_clean":"2024-03-24T10:36:31.979094+0000","last_became_active":"2024-03-24T10:36:25.216217+0000","last_became_peered":"2024-03-24T10:36:25.216217+0000","last_unstale":"2024-03-24T10:36:31.979094+0000","last_undegraded":"2024-03-24T10:36:31.979094+0000","last_fullsized":"2024-03-24T10:36:31.979094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239785+0000","last_change":"2024-03-24T10:36:30.292210+0000","last_active":"2024-03-24T10:36:31.239785+0000","last_peered":"2024-03-24T10:36:31.239785+0000","last_clean":"2024-03-24T10:36:31.239785+0000","last_became_active":"2024-03-24T10:36:30.291693+0000","last_became_peered":"2024-03-24T10:36:30.291693+0000","last_unstale":"2024-03-24T10:36:31.239785+0000","last_undegraded":"2024-03-24T10:36:31.239785+0000","last_fullsized":"2024-03-24T10:36:31.239785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978627+0000","last_change":"2024-03-24T10:36:26.216940+0000","last_active":"2024-03-24T10:36:31.978627+0000","last_peered":"2024-03-24T10:36:31.978627+0000","last_clean":"2024-03-24T10:36:31.978627+0000","last_became_active":"2024-03-24T10:36:26.216516+0000","last_became_peered":"2024-03-24T10:36:26.216516+0000","last_unstale":"2024-03-24T10:36:31.978627+0000","last_undegraded":"2024-03-24T10:36:31.978627+0000","last_fullsized":"2024-03-24T10:36:31.978627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978689+0000","last_change":"2024-03-24T10:36:25.220871+0000","last_active":"2024-03-24T10:36:31.978689+0000","last_peered":"2024-03-24T10:36:31.978689+0000","last_clean":"2024-03-24T10:36:31.978689+0000","last_became_active":"2024-03-24T10:36:25.220566+0000","last_became_peered":"2024-03-24T10:36:25.220566+0000","last_unstale":"2024-03-24T10:36:31.978689+0000","last_undegraded":"2024-03-24T10:36:31.978689+0000","last_fullsized":"2024-03-24T10:36:31.978689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:11.467800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978512+0000","last_change":"2024-03-24T10:36:30.287965+0000","last_active":"2024-03-24T10:36:31.978512+0000","last_peered":"2024-03-24T10:36:31.978512+0000","last_clean":"2024-03-24T10:36:31.978512+0000","last_became_active":"2024-03-24T10:36:30.287151+0000","last_became_peered":"2024-03-24T10:36:30.287151+0000","last_unstale":"2024-03-24T10:36:31.978512+0000","last_undegraded":"2024-03-24T10:36:31.978512+0000","last_fullsized":"2024-03-24T10:36:31.978512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:42.603073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240890+0000","last_change":"2024-03-24T10:36:26.228488+0000","last_active":"2024-03-24T10:36:31.240890+0000","last_peered":"2024-03-24T10:36:31.240890+0000","last_clean":"2024-03-24T10:36:31.240890+0000","last_became_active":"2024-03-24T10:36:26.228001+0000","last_became_peered":"2024-03-24T10:36:26.228001+0000","last_unstale":"2024-03-24T10:36:31.240890+0000","last_undegraded":"2024-03-24T10:36:31.240890+0000","last_fullsized":"2024-03-24T10:36:31.240890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978655+0000","last_change":"2024-03-24T10:36:25.213196+0000","last_active":"2024-03-24T10:36:31.978655+0000","last_peered":"2024-03-24T10:36:31.978655+0000","last_clean":"2024-03-24T10:36:31.978655+0000","last_became_active":"2024-03-24T10:36:25.212908+0000","last_became_peered":"2024-03-24T10:36:25.212908+0000","last_unstale":"2024-03-24T10:36:31.978655+0000","last_undegraded":"2024-03-24T10:36:31.978655+0000","last_fullsized":"2024-03-24T10:36:31.978655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977909+0000","last_change":"2024-03-24T10:36:30.257971+0000","last_active":"2024-03-24T10:36:31.977909+0000","last_peered":"2024-03-24T10:36:31.977909+0000","last_clean":"2024-03-24T10:36:31.977909+0000","last_became_active":"2024-03-24T10:36:30.257595+0000","last_became_peered":"2024-03-24T10:36:30.257595+0000","last_unstale":"2024-03-24T10:36:31.977909+0000","last_undegraded":"2024-03-24T10:36:31.977909+0000","last_fullsized":"2024-03-24T10:36:31.977909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240167+0000","last_change":"2024-03-24T10:36:26.230507+0000","last_active":"2024-03-24T10:36:31.240167+0000","last_peered":"2024-03-24T10:36:31.240167+0000","last_clean":"2024-03-24T10:36:31.240167+0000","last_became_active":"2024-03-24T10:36:26.230065+0000","last_became_peered":"2024-03-24T10:36:26.230065+0000","last_unstale":"2024-03-24T10:36:31.240167+0000","last_undegraded":"2024-03-24T10:36:31.240167+0000","last_fullsized":"2024-03-24T10:36:31.240167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240522+0000","last_change":"2024-03-24T10:36:25.215977+0000","last_active":"2024-03-24T10:36:31.240522+0000","last_peered":"2024-03-24T10:36:31.240522+0000","last_clean":"2024-03-24T10:36:31.240522+0000","last_became_active":"2024-03-24T10:36:25.215688+0000","last_became_peered":"2024-03-24T10:36:25.215688+0000","last_unstale":"2024-03-24T10:36:31.240522+0000","last_undegraded":"2024-03-24T10:36:31.240522+0000","last_fullsized":"2024-03-24T10:36:31.240522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:51:50.711847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978606+0000","last_change":"2024-03-24T10:36:30.255099+0000","last_active":"2024-03-24T10:36:31.978606+0000","last_peered":"2024-03-24T10:36:31.978606+0000","last_clean":"2024-03-24T10:36:31.978606+0000","last_became_active":"2024-03-24T10:36:30.254701+0000","last_became_peered":"2024-03-24T10:36:30.254701+0000","last_unstale":"2024-03-24T10:36:31.978606+0000","last_undegraded":"2024-03-24T10:36:31.978606+0000","last_fullsized":"2024-03-24T10:36:31.978606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977951+0000","last_change":"2024-03-24T10:36:26.218799+0000","last_active":"2024-03-24T10:36:31.977951+0000","last_peered":"2024-03-24T10:36:31.977951+0000","last_clean":"2024-03-24T10:36:31.977951+0000","last_became_active":"2024-03-24T10:36:26.218417+0000","last_became_peered":"2024-03-24T10:36:26.218417+0000","last_unstale":"2024-03-24T10:36:31.977951+0000","last_undegraded":"2024-03-24T10:36:31.977951+0000","last_fullsized":"2024-03-24T10:36:31.977951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638115+0000","last_change":"2024-03-24T10:36:25.215346+0000","last_active":"2024-03-24T10:36:31.638115+0000","last_peered":"2024-03-24T10:36:31.638115+0000","last_clean":"2024-03-24T10:36:31.638115+0000","last_became_active":"2024-03-24T10:36:25.215072+0000","last_became_peered":"2024-03-24T10:36:25.215072+0000","last_unstale":"2024-03-24T10:36:31.638115+0000","last_undegraded":"2024-03-24T10:36:31.638115+0000","last_fullsized":"2024-03-24T10:36:31.638115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979217+0000","last_change":"2024-03-24T10:36:30.258147+0000","last_active":"2024-03-24T10:36:31.979217+0000","last_peered":"2024-03-24T10:36:31.979217+0000","last_clean":"2024-03-24T10:36:31.979217+0000","last_became_active":"2024-03-24T10:36:30.257704+0000","last_became_peered":"2024-03-24T10:36:30.257704+0000","last_unstale":"2024-03-24T10:36:31.979217+0000","last_undegraded":"2024-03-24T10:36:31.979217+0000","last_fullsized":"2024-03-24T10:36:31.979217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977926+0000","last_change":"2024-03-24T10:36:26.235288+0000","last_active":"2024-03-24T10:36:31.977926+0000","last_peered":"2024-03-24T10:36:31.977926+0000","last_clean":"2024-03-24T10:36:31.977926+0000","last_became_active":"2024-03-24T10:36:26.235008+0000","last_became_peered":"2024-03-24T10:36:26.235008+0000","last_unstale":"2024-03-24T10:36:31.977926+0000","last_undegraded":"2024-03-24T10:36:31.977926+0000","last_fullsized":"2024-03-24T10:36:31.977926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:56:34.251094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978361+0000","last_change":"2024-03-24T10:36:25.223252+0000","last_active":"2024-03-24T10:36:31.978361+0000","last_peered":"2024-03-24T10:36:31.978361+0000","last_clean":"2024-03-24T10:36:31.978361+0000","last_became_active":"2024-03-24T10:36:25.222927+0000","last_became_peered":"2024-03-24T10:36:25.222927+0000","last_unstale":"2024-03-24T10:36:31.978361+0000","last_undegraded":"2024-03-24T10:36:31.978361+0000","last_fullsized":"2024-03-24T10:36:31.978361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978487+0000","last_change":"2024-03-24T10:36:30.287525+0000","last_active":"2024-03-24T10:36:31.978487+0000","last_peered":"2024-03-24T10:36:31.978487+0000","last_clean":"2024-03-24T10:36:31.978487+0000","last_became_active":"2024-03-24T10:36:30.287145+0000","last_became_peered":"2024-03-24T10:36:30.287145+0000","last_unstale":"2024-03-24T10:36:31.978487+0000","last_undegraded":"2024-03-24T10:36:31.978487+0000","last_fullsized":"2024-03-24T10:36:31.978487+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:26.946083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239931+0000","last_change":"2024-03-24T10:36:26.245809+0000","last_active":"2024-03-24T10:36:31.239931+0000","last_peered":"2024-03-24T10:36:31.239931+0000","last_clean":"2024-03-24T10:36:31.239931+0000","last_became_active":"2024-03-24T10:36:26.245498+0000","last_became_peered":"2024-03-24T10:36:26.245498+0000","last_unstale":"2024-03-24T10:36:31.239931+0000","last_undegraded":"2024-03-24T10:36:31.239931+0000","last_fullsized":"2024-03-24T10:36:31.239931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240567+0000","last_change":"2024-03-24T10:36:25.216299+0000","last_active":"2024-03-24T10:36:31.240567+0000","last_peered":"2024-03-24T10:36:31.240567+0000","last_clean":"2024-03-24T10:36:31.240567+0000","last_became_active":"2024-03-24T10:36:25.215751+0000","last_became_peered":"2024-03-24T10:36:25.215751+0000","last_unstale":"2024-03-24T10:36:31.240567+0000","last_undegraded":"2024-03-24T10:36:31.240567+0000","last_fullsized":"2024-03-24T10:36:31.240567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978454+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:36:31.978454+0000","last_peered":"2024-03-24T10:36:31.978454+0000","last_clean":"2024-03-24T10:36:31.978454+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:36:31.978454+0000","last_undegraded":"2024-03-24T10:36:31.978454+0000","last_fullsized":"2024-03-24T10:36:31.978454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977877+0000","last_change":"2024-03-24T10:36:30.288784+0000","last_active":"2024-03-24T10:36:31.977877+0000","last_peered":"2024-03-24T10:36:31.977877+0000","last_clean":"2024-03-24T10:36:31.977877+0000","last_became_active":"2024-03-24T10:36:30.288412+0000","last_became_peered":"2024-03-24T10:36:30.288412+0000","last_unstale":"2024-03-24T10:36:31.977877+0000","last_undegraded":"2024-03-24T10:36:31.977877+0000","last_fullsized":"2024-03-24T10:36:31.977877+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:07:01.419825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978384+0000","last_change":"2024-03-24T10:36:26.245642+0000","last_active":"2024-03-24T10:36:31.978384+0000","last_peered":"2024-03-24T10:36:31.978384+0000","last_clean":"2024-03-24T10:36:31.978384+0000","last_became_active":"2024-03-24T10:36:26.245341+0000","last_became_peered":"2024-03-24T10:36:26.245341+0000","last_unstale":"2024-03-24T10:36:31.978384+0000","last_undegraded":"2024-03-24T10:36:31.978384+0000","last_fullsized":"2024-03-24T10:36:31.978384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638364+0000","last_change":"2024-03-24T10:36:25.220827+0000","last_active":"2024-03-24T10:36:31.638364+0000","last_peered":"2024-03-24T10:36:31.638364+0000","last_clean":"2024-03-24T10:36:31.638364+0000","last_became_active":"2024-03-24T10:36:25.220515+0000","last_became_peered":"2024-03-24T10:36:25.220515+0000","last_unstale":"2024-03-24T10:36:31.638364+0000","last_undegraded":"2024-03-24T10:36:31.638364+0000","last_fullsized":"2024-03-24T10:36:31.638364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977666+0000","last_change":"2024-03-24T10:36:30.288795+0000","last_active":"2024-03-24T10:36:31.977666+0000","last_peered":"2024-03-24T10:36:31.977666+0000","last_clean":"2024-03-24T10:36:31.977666+0000","last_became_active":"2024-03-24T10:36:30.288440+0000","last_became_peered":"2024-03-24T10:36:30.288440+0000","last_unstale":"2024-03-24T10:36:31.977666+0000","last_undegraded":"2024-03-24T10:36:31.977666+0000","last_fullsized":"2024-03-24T10:36:31.977666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:29.777475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240779+0000","last_change":"2024-03-24T10:36:26.228495+0000","last_active":"2024-03-24T10:36:31.240779+0000","last_peered":"2024-03-24T10:36:31.240779+0000","last_clean":"2024-03-24T10:36:31.240779+0000","last_became_active":"2024-03-24T10:36:26.227905+0000","last_became_peered":"2024-03-24T10:36:26.227905+0000","last_unstale":"2024-03-24T10:36:31.240779+0000","last_undegraded":"2024-03-24T10:36:31.240779+0000","last_fullsized":"2024-03-24T10:36:31.240779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978754+0000","last_change":"2024-03-24T10:36:25.217156+0000","last_active":"2024-03-24T10:36:31.978754+0000","last_peered":"2024-03-24T10:36:31.978754+0000","last_clean":"2024-03-24T10:36:31.978754+0000","last_became_active":"2024-03-24T10:36:25.216896+0000","last_became_peered":"2024-03-24T10:36:25.216896+0000","last_unstale":"2024-03-24T10:36:31.978754+0000","last_undegraded":"2024-03-24T10:36:31.978754+0000","last_fullsized":"2024-03-24T10:36:31.978754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978225+0000","last_change":"2024-03-24T10:36:30.260197+0000","last_active":"2024-03-24T10:36:31.978225+0000","last_peered":"2024-03-24T10:36:31.978225+0000","last_clean":"2024-03-24T10:36:31.978225+0000","last_became_active":"2024-03-24T10:36:30.259827+0000","last_became_peered":"2024-03-24T10:36:30.259827+0000","last_unstale":"2024-03-24T10:36:31.978225+0000","last_undegraded":"2024-03-24T10:36:31.978225+0000","last_fullsized":"2024-03-24T10:36:31.978225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978711+0000","last_change":"2024-03-24T10:36:26.236212+0000","last_active":"2024-03-24T10:36:31.978711+0000","last_peered":"2024-03-24T10:36:31.978711+0000","last_clean":"2024-03-24T10:36:31.978711+0000","last_became_active":"2024-03-24T10:36:26.235669+0000","last_became_peered":"2024-03-24T10:36:26.235669+0000","last_unstale":"2024-03-24T10:36:31.978711+0000","last_undegraded":"2024-03-24T10:36:31.978711+0000","last_fullsized":"2024-03-24T10:36:31.978711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:22.915113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638384+0000","last_change":"2024-03-24T10:36:25.219420+0000","last_active":"2024-03-24T10:36:31.638384+0000","last_peered":"2024-03-24T10:36:31.638384+0000","last_clean":"2024-03-24T10:36:31.638384+0000","last_became_active":"2024-03-24T10:36:25.218854+0000","last_became_peered":"2024-03-24T10:36:25.218854+0000","last_unstale":"2024-03-24T10:36:31.638384+0000","last_undegraded":"2024-03-24T10:36:31.638384+0000","last_fullsized":"2024-03-24T10:36:31.638384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239363+0000","last_change":"2024-03-24T10:36:30.287411+0000","last_active":"2024-03-24T10:36:31.239363+0000","last_peered":"2024-03-24T10:36:31.239363+0000","last_clean":"2024-03-24T10:36:31.239363+0000","last_became_active":"2024-03-24T10:36:30.286957+0000","last_became_peered":"2024-03-24T10:36:30.286957+0000","last_unstale":"2024-03-24T10:36:31.239363+0000","last_undegraded":"2024-03-24T10:36:31.239363+0000","last_fullsized":"2024-03-24T10:36:31.239363+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:51:26.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978539+0000","last_change":"2024-03-24T10:36:26.236702+0000","last_active":"2024-03-24T10:36:31.978539+0000","last_peered":"2024-03-24T10:36:31.978539+0000","last_clean":"2024-03-24T10:36:31.978539+0000","last_became_active":"2024-03-24T10:36:26.236444+0000","last_became_peered":"2024-03-24T10:36:26.236444+0000","last_unstale":"2024-03-24T10:36:31.978539+0000","last_undegraded":"2024-03-24T10:36:31.978539+0000","last_fullsized":"2024-03-24T10:36:31.978539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240722+0000","last_change":"2024-03-24T10:36:25.213103+0000","last_active":"2024-03-24T10:36:31.240722+0000","last_peered":"2024-03-24T10:36:31.240722+0000","last_clean":"2024-03-24T10:36:31.240722+0000","last_became_active":"2024-03-24T10:36:25.212568+0000","last_became_peered":"2024-03-24T10:36:25.212568+0000","last_unstale":"2024-03-24T10:36:31.240722+0000","last_undegraded":"2024-03-24T10:36:31.240722+0000","last_fullsized":"2024-03-24T10:36:31.240722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239802+0000","last_change":"2024-03-24T10:36:30.257883+0000","last_active":"2024-03-24T10:36:31.239802+0000","last_peered":"2024-03-24T10:36:31.239802+0000","last_clean":"2024-03-24T10:36:31.239802+0000","last_became_active":"2024-03-24T10:36:30.257543+0000","last_became_peered":"2024-03-24T10:36:30.257543+0000","last_unstale":"2024-03-24T10:36:31.239802+0000","last_undegraded":"2024-03-24T10:36:31.239802+0000","last_fullsized":"2024-03-24T10:36:31.239802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:25.370328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978339+0000","last_change":"2024-03-24T10:36:26.235416+0000","last_active":"2024-03-24T10:36:31.978339+0000","last_peered":"2024-03-24T10:36:31.978339+0000","last_clean":"2024-03-24T10:36:31.978339+0000","last_became_active":"2024-03-24T10:36:26.235039+0000","last_became_peered":"2024-03-24T10:36:26.235039+0000","last_unstale":"2024-03-24T10:36:31.978339+0000","last_undegraded":"2024-03-24T10:36:31.978339+0000","last_fullsized":"2024-03-24T10:36:31.978339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638000+0000","last_change":"2024-03-24T10:36:25.215430+0000","last_active":"2024-03-24T10:36:31.638000+0000","last_peered":"2024-03-24T10:36:31.638000+0000","last_clean":"2024-03-24T10:36:31.638000+0000","last_became_active":"2024-03-24T10:36:25.215118+0000","last_became_peered":"2024-03-24T10:36:25.215118+0000","last_unstale":"2024-03-24T10:36:31.638000+0000","last_undegraded":"2024-03-24T10:36:31.638000+0000","last_fullsized":"2024-03-24T10:36:31.638000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978465+0000","last_change":"2024-03-24T10:36:30.252499+0000","last_active":"2024-03-24T10:36:31.978465+0000","last_peered":"2024-03-24T10:36:31.978465+0000","last_clean":"2024-03-24T10:36:31.978465+0000","last_became_active":"2024-03-24T10:36:30.252134+0000","last_became_peered":"2024-03-24T10:36:30.252134+0000","last_unstale":"2024-03-24T10:36:31.978465+0000","last_undegraded":"2024-03-24T10:36:31.978465+0000","last_fullsized":"2024-03-24T10:36:31.978465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:21.009853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977517+0000","last_change":"2024-03-24T10:36:26.226532+0000","last_active":"2024-03-24T10:36:31.977517+0000","last_peered":"2024-03-24T10:36:31.977517+0000","last_clean":"2024-03-24T10:36:31.977517+0000","last_became_active":"2024-03-24T10:36:26.226220+0000","last_became_peered":"2024-03-24T10:36:26.226220+0000","last_unstale":"2024-03-24T10:36:31.977517+0000","last_undegraded":"2024-03-24T10:36:31.977517+0000","last_fullsized":"2024-03-24T10:36:31.977517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977582+0000","last_change":"2024-03-24T10:36:25.216401+0000","last_active":"2024-03-24T10:36:31.977582+0000","last_peered":"2024-03-24T10:36:31.977582+0000","last_clean":"2024-03-24T10:36:31.977582+0000","last_became_active":"2024-03-24T10:36:25.216137+0000","last_became_peered":"2024-03-24T10:36:25.216137+0000","last_unstale":"2024-03-24T10:36:31.977582+0000","last_undegraded":"2024-03-24T10:36:31.977582+0000","last_fullsized":"2024-03-24T10:36:31.977582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240400+0000","last_change":"2024-03-24T10:36:30.287578+0000","last_active":"2024-03-24T10:36:31.240400+0000","last_peered":"2024-03-24T10:36:31.240400+0000","last_clean":"2024-03-24T10:36:31.240400+0000","last_became_active":"2024-03-24T10:36:30.287214+0000","last_became_peered":"2024-03-24T10:36:30.287214+0000","last_unstale":"2024-03-24T10:36:31.240400+0000","last_undegraded":"2024-03-24T10:36:31.240400+0000","last_fullsized":"2024-03-24T10:36:31.240400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:27:44.336084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978149+0000","last_change":"2024-03-24T10:36:26.235579+0000","last_active":"2024-03-24T10:36:31.978149+0000","last_peered":"2024-03-24T10:36:31.978149+0000","last_clean":"2024-03-24T10:36:31.978149+0000","last_became_active":"2024-03-24T10:36:26.234789+0000","last_became_peered":"2024-03-24T10:36:26.234789+0000","last_unstale":"2024-03-24T10:36:31.978149+0000","last_undegraded":"2024-03-24T10:36:31.978149+0000","last_fullsized":"2024-03-24T10:36:31.978149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240458+0000","last_change":"2024-03-24T10:36:25.213457+0000","last_active":"2024-03-24T10:36:31.240458+0000","last_peered":"2024-03-24T10:36:31.240458+0000","last_clean":"2024-03-24T10:36:31.240458+0000","last_became_active":"2024-03-24T10:36:25.213160+0000","last_became_peered":"2024-03-24T10:36:25.213160+0000","last_unstale":"2024-03-24T10:36:31.240458+0000","last_undegraded":"2024-03-24T10:36:31.240458+0000","last_fullsized":"2024-03-24T10:36:31.240458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:12:20.083780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240747+0000","last_change":"2024-03-24T10:36:30.287535+0000","last_active":"2024-03-24T10:36:31.240747+0000","last_peered":"2024-03-24T10:36:31.240747+0000","last_clean":"2024-03-24T10:36:31.240747+0000","last_became_active":"2024-03-24T10:36:30.287117+0000","last_became_peered":"2024-03-24T10:36:30.287117+0000","last_unstale":"2024-03-24T10:36:31.240747+0000","last_undegraded":"2024-03-24T10:36:31.240747+0000","last_fullsized":"2024-03-24T10:36:31.240747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:14:00.615471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978297+0000","last_change":"2024-03-24T10:36:26.236223+0000","last_active":"2024-03-24T10:36:31.978297+0000","last_peered":"2024-03-24T10:36:31.978297+0000","last_clean":"2024-03-24T10:36:31.978297+0000","last_became_active":"2024-03-24T10:36:26.235923+0000","last_became_peered":"2024-03-24T10:36:26.235923+0000","last_unstale":"2024-03-24T10:36:31.978297+0000","last_undegraded":"2024-03-24T10:36:31.978297+0000","last_fullsized":"2024-03-24T10:36:31.978297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978459+0000","last_change":"2024-03-24T10:36:25.209119+0000","last_active":"2024-03-24T10:36:31.978459+0000","last_peered":"2024-03-24T10:36:31.978459+0000","last_clean":"2024-03-24T10:36:31.978459+0000","last_became_active":"2024-03-24T10:36:25.208379+0000","last_became_peered":"2024-03-24T10:36:25.208379+0000","last_unstale":"2024-03-24T10:36:31.978459+0000","last_undegraded":"2024-03-24T10:36:31.978459+0000","last_fullsized":"2024-03-24T10:36:31.978459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240879+0000","last_change":"2024-03-24T10:36:30.288794+0000","last_active":"2024-03-24T10:36:31.240879+0000","last_peered":"2024-03-24T10:36:31.240879+0000","last_clean":"2024-03-24T10:36:31.240879+0000","last_became_active":"2024-03-24T10:36:30.288455+0000","last_became_peered":"2024-03-24T10:36:30.288455+0000","last_unstale":"2024-03-24T10:36:31.240879+0000","last_undegraded":"2024-03-24T10:36:31.240879+0000","last_fullsized":"2024-03-24T10:36:31.240879+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:19:44.040384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978280+0000","last_change":"2024-03-24T10:36:26.235572+0000","last_active":"2024-03-24T10:36:31.978280+0000","last_peered":"2024-03-24T10:36:31.978280+0000","last_clean":"2024-03-24T10:36:31.978280+0000","last_became_active":"2024-03-24T10:36:26.234988+0000","last_became_peered":"2024-03-24T10:36:26.234988+0000","last_unstale":"2024-03-24T10:36:31.978280+0000","last_undegraded":"2024-03-24T10:36:31.978280+0000","last_fullsized":"2024-03-24T10:36:31.978280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:35.680520+0000","last_change":"2024-03-24T10:36:25.218162+0000","last_active":"2024-03-24T10:36:35.680520+0000","last_peered":"2024-03-24T10:36:35.680520+0000","last_clean":"2024-03-24T10:36:35.680520+0000","last_became_active":"2024-03-24T10:36:25.217883+0000","last_became_peered":"2024-03-24T10:36:25.217883+0000","last_unstale":"2024-03-24T10:36:35.680520+0000","last_undegraded":"2024-03-24T10:36:35.680520+0000","last_fullsized":"2024-03-24T10:36:35.680520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:21:07.316618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978846+0000","last_change":"2024-03-24T10:36:30.257936+0000","last_active":"2024-03-24T10:36:31.978846+0000","last_peered":"2024-03-24T10:36:31.978846+0000","last_clean":"2024-03-24T10:36:31.978846+0000","last_became_active":"2024-03-24T10:36:30.257563+0000","last_became_peered":"2024-03-24T10:36:30.257563+0000","last_unstale":"2024-03-24T10:36:31.978846+0000","last_undegraded":"2024-03-24T10:36:31.978846+0000","last_fullsized":"2024-03-24T10:36:31.978846+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240985+0000","last_change":"2024-03-24T10:36:26.231768+0000","last_active":"2024-03-24T10:36:31.240985+0000","last_peered":"2024-03-24T10:36:31.240985+0000","last_clean":"2024-03-24T10:36:31.240985+0000","last_became_active":"2024-03-24T10:36:26.231505+0000","last_became_peered":"2024-03-24T10:36:26.231505+0000","last_unstale":"2024-03-24T10:36:31.240985+0000","last_undegraded":"2024-03-24T10:36:31.240985+0000","last_fullsized":"2024-03-24T10:36:31.240985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:23:12.471736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978654+0000","last_change":"2024-03-24T10:36:25.220658+0000","last_active":"2024-03-24T10:36:31.978654+0000","last_peered":"2024-03-24T10:36:31.978654+0000","last_clean":"2024-03-24T10:36:31.978654+0000","last_became_active":"2024-03-24T10:36:25.220451+0000","last_became_peered":"2024-03-24T10:36:25.220451+0000","last_unstale":"2024-03-24T10:36:31.978654+0000","last_undegraded":"2024-03-24T10:36:31.978654+0000","last_fullsized":"2024-03-24T10:36:31.978654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240105+0000","last_change":"2024-03-24T10:36:30.255676+0000","last_active":"2024-03-24T10:36:31.240105+0000","last_peered":"2024-03-24T10:36:31.240105+0000","last_clean":"2024-03-24T10:36:31.240105+0000","last_became_active":"2024-03-24T10:36:30.255314+0000","last_became_peered":"2024-03-24T10:36:30.255314+0000","last_unstale":"2024-03-24T10:36:31.240105+0000","last_undegraded":"2024-03-24T10:36:31.240105+0000","last_fullsized":"2024-03-24T10:36:31.240105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:17.085271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978164+0000","last_change":"2024-03-24T10:36:26.240945+0000","last_active":"2024-03-24T10:36:31.978164+0000","last_peered":"2024-03-24T10:36:31.978164+0000","last_clean":"2024-03-24T10:36:31.978164+0000","last_became_active":"2024-03-24T10:36:26.240664+0000","last_became_peered":"2024-03-24T10:36:26.240664+0000","last_unstale":"2024-03-24T10:36:31.978164+0000","last_undegraded":"2024-03-24T10:36:31.978164+0000","last_fullsized":"2024-03-24T10:36:31.978164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240312+0000","last_change":"2024-03-24T10:36:25.215416+0000","last_active":"2024-03-24T10:36:31.240312+0000","last_peered":"2024-03-24T10:36:31.240312+0000","last_clean":"2024-03-24T10:36:31.240312+0000","last_became_active":"2024-03-24T10:36:25.215130+0000","last_became_peered":"2024-03-24T10:36:25.215130+0000","last_unstale":"2024-03-24T10:36:31.240312+0000","last_undegraded":"2024-03-24T10:36:31.240312+0000","last_fullsized":"2024-03-24T10:36:31.240312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:16.957840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240235+0000","last_change":"2024-03-24T10:36:30.258107+0000","last_active":"2024-03-24T10:36:31.240235+0000","last_peered":"2024-03-24T10:36:31.240235+0000","last_clean":"2024-03-24T10:36:31.240235+0000","last_became_active":"2024-03-24T10:36:30.257548+0000","last_became_peered":"2024-03-24T10:36:30.257548+0000","last_unstale":"2024-03-24T10:36:31.240235+0000","last_undegraded":"2024-03-24T10:36:31.240235+0000","last_fullsized":"2024-03-24T10:36:31.240235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:27:22.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240228+0000","last_change":"2024-03-24T10:36:26.238486+0000","last_active":"2024-03-24T10:36:31.240228+0000","last_peered":"2024-03-24T10:36:31.240228+0000","last_clean":"2024-03-24T10:36:31.240228+0000","last_became_active":"2024-03-24T10:36:26.237843+0000","last_became_peered":"2024-03-24T10:36:26.237843+0000","last_unstale":"2024-03-24T10:36:31.240228+0000","last_undegraded":"2024-03-24T10:36:31.240228+0000","last_fullsized":"2024-03-24T10:36:31.240228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978669+0000","last_change":"2024-03-24T10:36:25.220880+0000","last_active":"2024-03-24T10:36:31.978669+0000","last_peered":"2024-03-24T10:36:31.978669+0000","last_clean":"2024-03-24T10:36:31.978669+0000","last_became_active":"2024-03-24T10:36:25.220622+0000","last_became_peered":"2024-03-24T10:36:25.220622+0000","last_unstale":"2024-03-24T10:36:31.978669+0000","last_undegraded":"2024-03-24T10:36:31.978669+0000","last_fullsized":"2024-03-24T10:36:31.978669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:24:25.629091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239888+0000","last_change":"2024-03-24T10:36:30.291355+0000","last_active":"2024-03-24T10:36:31.239888+0000","last_peered":"2024-03-24T10:36:31.239888+0000","last_clean":"2024-03-24T10:36:31.239888+0000","last_became_active":"2024-03-24T10:36:30.290079+0000","last_became_peered":"2024-03-24T10:36:30.290079+0000","last_unstale":"2024-03-24T10:36:31.239888+0000","last_undegraded":"2024-03-24T10:36:31.239888+0000","last_fullsized":"2024-03-24T10:36:31.239888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:26:51.570024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978358+0000","last_change":"2024-03-24T10:36:30.290362+0000","last_active":"2024-03-24T10:36:31.978358+0000","last_peered":"2024-03-24T10:36:31.978358+0000","last_clean":"2024-03-24T10:36:31.978358+0000","last_became_active":"2024-03-24T10:36:30.289924+0000","last_became_peered":"2024-03-24T10:36:30.289924+0000","last_unstale":"2024-03-24T10:36:31.978358+0000","last_undegraded":"2024-03-24T10:36:31.978358+0000","last_fullsized":"2024-03-24T10:36:31.978358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:24.826960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978144+0000","last_change":"2024-03-24T10:36:26.223759+0000","last_active":"2024-03-24T10:36:31.978144+0000","last_peered":"2024-03-24T10:36:31.978144+0000","last_clean":"2024-03-24T10:36:31.978144+0000","last_became_active":"2024-03-24T10:36:26.223332+0000","last_became_peered":"2024-03-24T10:36:26.223332+0000","last_unstale":"2024-03-24T10:36:31.978144+0000","last_undegraded":"2024-03-24T10:36:31.978144+0000","last_fullsized":"2024-03-24T10:36:31.978144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239431+0000","last_change":"2024-03-24T10:36:25.211540+0000","last_active":"2024-03-24T10:36:31.239431+0000","last_peered":"2024-03-24T10:36:31.239431+0000","last_clean":"2024-03-24T10:36:31.239431+0000","last_became_active":"2024-03-24T10:36:25.211248+0000","last_became_peered":"2024-03-24T10:36:25.211248+0000","last_unstale":"2024-03-24T10:36:31.239431+0000","last_undegraded":"2024-03-24T10:36:31.239431+0000","last_fullsized":"2024-03-24T10:36:31.239431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:12:23.901898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977993+0000","last_change":"2024-03-24T10:36:30.254914+0000","last_active":"2024-03-24T10:36:31.977993+0000","last_peered":"2024-03-24T10:36:31.977993+0000","last_clean":"2024-03-24T10:36:31.977993+0000","last_became_active":"2024-03-24T10:36:30.254506+0000","last_became_peered":"2024-03-24T10:36:30.254506+0000","last_unstale":"2024-03-24T10:36:31.977993+0000","last_undegraded":"2024-03-24T10:36:31.977993+0000","last_fullsized":"2024-03-24T10:36:31.977993+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:04.765775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239911+0000","last_change":"2024-03-24T10:36:26.226712+0000","last_active":"2024-03-24T10:36:31.239911+0000","last_peered":"2024-03-24T10:36:31.239911+0000","last_clean":"2024-03-24T10:36:31.239911+0000","last_became_active":"2024-03-24T10:36:26.226434+0000","last_became_peered":"2024-03-24T10:36:26.226434+0000","last_unstale":"2024-03-24T10:36:31.239911+0000","last_undegraded":"2024-03-24T10:36:31.239911+0000","last_fullsized":"2024-03-24T10:36:31.239911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240043+0000","last_change":"2024-03-24T10:36:25.216508+0000","last_active":"2024-03-24T10:36:31.240043+0000","last_peered":"2024-03-24T10:36:31.240043+0000","last_clean":"2024-03-24T10:36:31.240043+0000","last_became_active":"2024-03-24T10:36:25.216249+0000","last_became_peered":"2024-03-24T10:36:25.216249+0000","last_unstale":"2024-03-24T10:36:31.240043+0000","last_undegraded":"2024-03-24T10:36:31.240043+0000","last_fullsized":"2024-03-24T10:36:31.240043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:05:34.052572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977716+0000","last_change":"2024-03-24T10:36:25.217255+0000","last_active":"2024-03-24T10:36:31.977716+0000","last_peered":"2024-03-24T10:36:31.977716+0000","last_clean":"2024-03-24T10:36:31.977716+0000","last_became_active":"2024-03-24T10:36:25.216974+0000","last_became_peered":"2024-03-24T10:36:25.216974+0000","last_unstale":"2024-03-24T10:36:31.977716+0000","last_undegraded":"2024-03-24T10:36:31.977716+0000","last_fullsized":"2024-03-24T10:36:31.977716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:53:11.627072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978369+0000","last_change":"2024-03-24T10:36:26.235283+0000","last_active":"2024-03-24T10:36:31.978369+0000","last_peered":"2024-03-24T10:36:31.978369+0000","last_clean":"2024-03-24T10:36:31.978369+0000","last_became_active":"2024-03-24T10:36:26.234957+0000","last_became_peered":"2024-03-24T10:36:26.234957+0000","last_unstale":"2024-03-24T10:36:31.978369+0000","last_undegraded":"2024-03-24T10:36:31.978369+0000","last_fullsized":"2024-03-24T10:36:31.978369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638315+0000","last_change":"2024-03-24T10:36:30.258066+0000","last_active":"2024-03-24T10:36:31.638315+0000","last_peered":"2024-03-24T10:36:31.638315+0000","last_clean":"2024-03-24T10:36:31.638315+0000","last_became_active":"2024-03-24T10:36:30.257721+0000","last_became_peered":"2024-03-24T10:36:30.257721+0000","last_unstale":"2024-03-24T10:36:31.638315+0000","last_undegraded":"2024-03-24T10:36:31.638315+0000","last_fullsized":"2024-03-24T10:36:31.638315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:48.645675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240710+0000","last_change":"2024-03-24T10:36:25.217924+0000","last_active":"2024-03-24T10:36:31.240710+0000","last_peered":"2024-03-24T10:36:31.240710+0000","last_clean":"2024-03-24T10:36:31.240710+0000","last_became_active":"2024-03-24T10:36:25.217653+0000","last_became_peered":"2024-03-24T10:36:25.217653+0000","last_unstale":"2024-03-24T10:36:31.240710+0000","last_undegraded":"2024-03-24T10:36:31.240710+0000","last_fullsized":"2024-03-24T10:36:31.240710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:24.191760+0000","last_clean_scrub_stamp":"2024-03-24T10:36:24.191760+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:21:41.967893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239946+0000","last_change":"2024-03-24T10:36:26.222302+0000","last_active":"2024-03-24T10:36:31.239946+0000","last_peered":"2024-03-24T10:36:31.239946+0000","last_clean":"2024-03-24T10:36:31.239946+0000","last_became_active":"2024-03-24T10:36:26.221621+0000","last_became_peered":"2024-03-24T10:36:26.221621+0000","last_unstale":"2024-03-24T10:36:31.239946+0000","last_undegraded":"2024-03-24T10:36:31.239946+0000","last_fullsized":"2024-03-24T10:36:31.239946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240272+0000","last_change":"2024-03-24T10:36:30.252503+0000","last_active":"2024-03-24T10:36:31.240272+0000","last_peered":"2024-03-24T10:36:31.240272+0000","last_clean":"2024-03-24T10:36:31.240272+0000","last_became_active":"2024-03-24T10:36:30.252117+0000","last_became_peered":"2024-03-24T10:36:30.252117+0000","last_unstale":"2024-03-24T10:36:31.240272+0000","last_undegraded":"2024-03-24T10:36:31.240272+0000","last_fullsized":"2024-03-24T10:36:31.240272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:29.226666+0000","last_clean_scrub_stamp":"2024-03-24T10:36:29.226666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:35:10.560451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977432+0000","last_change":"2024-03-24T10:36:26.227933+0000","last_active":"2024-03-24T10:36:31.977432+0000","last_peered":"2024-03-24T10:36:31.977432+0000","last_clean":"2024-03-24T10:36:31.977432+0000","last_became_active":"2024-03-24T10:36:26.227650+0000","last_became_peered":"2024-03-24T10:36:26.227650+0000","last_unstale":"2024-03-24T10:36:31.977432+0000","last_undegraded":"2024-03-24T10:36:31.977432+0000","last_fullsized":"2024-03-24T10:36:31.977432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638092+0000","last_change":"2024-03-24T10:36:26.240695+0000","last_active":"2024-03-24T10:36:31.638092+0000","last_peered":"2024-03-24T10:36:31.638092+0000","last_clean":"2024-03-24T10:36:31.638092+0000","last_became_active":"2024-03-24T10:36:26.240417+0000","last_became_peered":"2024-03-24T10:36:26.240417+0000","last_unstale":"2024-03-24T10:36:31.638092+0000","last_undegraded":"2024-03-24T10:36:31.638092+0000","last_fullsized":"2024-03-24T10:36:31.638092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:37:17.961776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240378+0000","last_change":"2024-03-24T10:36:26.242019+0000","last_active":"2024-03-24T10:36:31.240378+0000","last_peered":"2024-03-24T10:36:31.240378+0000","last_clean":"2024-03-24T10:36:31.240378+0000","last_became_active":"2024-03-24T10:36:26.241585+0000","last_became_peered":"2024-03-24T10:36:26.241585+0000","last_unstale":"2024-03-24T10:36:31.240378+0000","last_undegraded":"2024-03-24T10:36:31.240378+0000","last_fullsized":"2024-03-24T10:36:31.240378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978268+0000","last_change":"2024-03-24T10:36:26.228956+0000","last_active":"2024-03-24T10:36:31.978268+0000","last_peered":"2024-03-24T10:36:31.978268+0000","last_clean":"2024-03-24T10:36:31.978268+0000","last_became_active":"2024-03-24T10:36:26.228649+0000","last_became_peered":"2024-03-24T10:36:26.228649+0000","last_unstale":"2024-03-24T10:36:31.978268+0000","last_undegraded":"2024-03-24T10:36:31.978268+0000","last_fullsized":"2024-03-24T10:36:31.978268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:32:57.144863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240896+0000","last_change":"2024-03-24T10:36:26.230293+0000","last_active":"2024-03-24T10:36:31.240896+0000","last_peered":"2024-03-24T10:36:31.240896+0000","last_clean":"2024-03-24T10:36:31.240896+0000","last_became_active":"2024-03-24T10:36:26.229555+0000","last_became_peered":"2024-03-24T10:36:26.229555+0000","last_unstale":"2024-03-24T10:36:31.240896+0000","last_undegraded":"2024-03-24T10:36:31.240896+0000","last_fullsized":"2024-03-24T10:36:31.240896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:58:25.746505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978476+0000","last_change":"2024-03-24T10:36:26.222799+0000","last_active":"2024-03-24T10:36:31.978476+0000","last_peered":"2024-03-24T10:36:31.978476+0000","last_clean":"2024-03-24T10:36:31.978476+0000","last_became_active":"2024-03-24T10:36:26.221223+0000","last_became_peered":"2024-03-24T10:36:26.221223+0000","last_unstale":"2024-03-24T10:36:31.978476+0000","last_undegraded":"2024-03-24T10:36:31.978476+0000","last_fullsized":"2024-03-24T10:36:31.978476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978086+0000","last_change":"2024-03-24T10:36:26.226953+0000","last_active":"2024-03-24T10:36:31.978086+0000","last_peered":"2024-03-24T10:36:31.978086+0000","last_clean":"2024-03-24T10:36:31.978086+0000","last_became_active":"2024-03-24T10:36:26.226663+0000","last_became_peered":"2024-03-24T10:36:26.226663+0000","last_unstale":"2024-03-24T10:36:31.978086+0000","last_undegraded":"2024-03-24T10:36:31.978086+0000","last_fullsized":"2024-03-24T10:36:31.978086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240327+0000","last_change":"2024-03-24T10:36:26.229550+0000","last_active":"2024-03-24T10:36:31.240327+0000","last_peered":"2024-03-24T10:36:31.240327+0000","last_clean":"2024-03-24T10:36:31.240327+0000","last_became_active":"2024-03-24T10:36:26.229243+0000","last_became_peered":"2024-03-24T10:36:26.229243+0000","last_unstale":"2024-03-24T10:36:31.240327+0000","last_undegraded":"2024-03-24T10:36:31.240327+0000","last_fullsized":"2024-03-24T10:36:31.240327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239502+0000","last_change":"2024-03-24T10:36:26.228357+0000","last_active":"2024-03-24T10:36:31.239502+0000","last_peered":"2024-03-24T10:36:31.239502+0000","last_clean":"2024-03-24T10:36:31.239502+0000","last_became_active":"2024-03-24T10:36:26.228105+0000","last_became_peered":"2024-03-24T10:36:26.228105+0000","last_unstale":"2024-03-24T10:36:31.239502+0000","last_undegraded":"2024-03-24T10:36:31.239502+0000","last_fullsized":"2024-03-24T10:36:31.239502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:11:00.734804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240201+0000","last_change":"2024-03-24T10:36:26.230259+0000","last_active":"2024-03-24T10:36:31.240201+0000","last_peered":"2024-03-24T10:36:31.240201+0000","last_clean":"2024-03-24T10:36:31.240201+0000","last_became_active":"2024-03-24T10:36:26.229990+0000","last_became_peered":"2024-03-24T10:36:26.229990+0000","last_unstale":"2024-03-24T10:36:31.240201+0000","last_undegraded":"2024-03-24T10:36:31.240201+0000","last_fullsized":"2024-03-24T10:36:31.240201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:57:21.339357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240293+0000","last_change":"2024-03-24T10:36:26.242160+0000","last_active":"2024-03-24T10:36:31.240293+0000","last_peered":"2024-03-24T10:36:31.240293+0000","last_clean":"2024-03-24T10:36:31.240293+0000","last_became_active":"2024-03-24T10:36:26.241598+0000","last_became_peered":"2024-03-24T10:36:26.241598+0000","last_unstale":"2024-03-24T10:36:31.240293+0000","last_undegraded":"2024-03-24T10:36:31.240293+0000","last_fullsized":"2024-03-24T10:36:31.240293+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978044+0000","last_change":"2024-03-24T10:36:26.239300+0000","last_active":"2024-03-24T10:36:31.978044+0000","last_peered":"2024-03-24T10:36:31.978044+0000","last_clean":"2024-03-24T10:36:31.978044+0000","last_became_active":"2024-03-24T10:36:26.239004+0000","last_became_peered":"2024-03-24T10:36:26.239004+0000","last_unstale":"2024-03-24T10:36:31.978044+0000","last_undegraded":"2024-03-24T10:36:31.978044+0000","last_fullsized":"2024-03-24T10:36:31.978044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977873+0000","last_change":"2024-03-24T10:36:26.234784+0000","last_active":"2024-03-24T10:36:31.977873+0000","last_peered":"2024-03-24T10:36:31.977873+0000","last_clean":"2024-03-24T10:36:31.977873+0000","last_became_active":"2024-03-24T10:36:26.234304+0000","last_became_peered":"2024-03-24T10:36:26.234304+0000","last_unstale":"2024-03-24T10:36:31.977873+0000","last_undegraded":"2024-03-24T10:36:31.977873+0000","last_fullsized":"2024-03-24T10:36:31.977873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978675+0000","last_change":"2024-03-24T10:36:26.234967+0000","last_active":"2024-03-24T10:36:31.978675+0000","last_peered":"2024-03-24T10:36:31.978675+0000","last_clean":"2024-03-24T10:36:31.978675+0000","last_became_active":"2024-03-24T10:36:26.234619+0000","last_became_peered":"2024-03-24T10:36:26.234619+0000","last_unstale":"2024-03-24T10:36:31.978675+0000","last_undegraded":"2024-03-24T10:36:31.978675+0000","last_fullsized":"2024-03-24T10:36:31.978675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:46:13.054301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.638313+0000","last_change":"2024-03-24T10:36:26.218406+0000","last_active":"2024-03-24T10:36:31.638313+0000","last_peered":"2024-03-24T10:36:31.638313+0000","last_clean":"2024-03-24T10:36:31.638313+0000","last_became_active":"2024-03-24T10:36:26.218130+0000","last_became_peered":"2024-03-24T10:36:26.218130+0000","last_unstale":"2024-03-24T10:36:31.638313+0000","last_undegraded":"2024-03-24T10:36:31.638313+0000","last_fullsized":"2024-03-24T10:36:31.638313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240564+0000","last_change":"2024-03-24T10:36:26.241244+0000","last_active":"2024-03-24T10:36:31.240564+0000","last_peered":"2024-03-24T10:36:31.240564+0000","last_clean":"2024-03-24T10:36:31.240564+0000","last_became_active":"2024-03-24T10:36:26.240263+0000","last_became_peered":"2024-03-24T10:36:26.240263+0000","last_unstale":"2024-03-24T10:36:31.240564+0000","last_undegraded":"2024-03-24T10:36:31.240564+0000","last_fullsized":"2024-03-24T10:36:31.240564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:46:20.795989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239339+0000","last_change":"2024-03-24T10:36:26.233360+0000","last_active":"2024-03-24T10:36:31.239339+0000","last_peered":"2024-03-24T10:36:31.239339+0000","last_clean":"2024-03-24T10:36:31.239339+0000","last_became_active":"2024-03-24T10:36:26.232820+0000","last_became_peered":"2024-03-24T10:36:26.232820+0000","last_unstale":"2024-03-24T10:36:31.239339+0000","last_undegraded":"2024-03-24T10:36:31.239339+0000","last_fullsized":"2024-03-24T10:36:31.239339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978230+0000","last_change":"2024-03-24T10:36:26.229654+0000","last_active":"2024-03-24T10:36:31.978230+0000","last_peered":"2024-03-24T10:36:31.978230+0000","last_clean":"2024-03-24T10:36:31.978230+0000","last_became_active":"2024-03-24T10:36:26.229360+0000","last_became_peered":"2024-03-24T10:36:26.229360+0000","last_unstale":"2024-03-24T10:36:31.978230+0000","last_undegraded":"2024-03-24T10:36:31.978230+0000","last_fullsized":"2024-03-24T10:36:31.978230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:10:28.296878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978201+0000","last_change":"2024-03-24T10:36:26.232307+0000","last_active":"2024-03-24T10:36:31.978201+0000","last_peered":"2024-03-24T10:36:31.978201+0000","last_clean":"2024-03-24T10:36:31.978201+0000","last_became_active":"2024-03-24T10:36:26.232003+0000","last_became_peered":"2024-03-24T10:36:26.232003+0000","last_unstale":"2024-03-24T10:36:31.978201+0000","last_undegraded":"2024-03-24T10:36:31.978201+0000","last_fullsized":"2024-03-24T10:36:31.978201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:04:44.614704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240018+0000","last_change":"2024-03-24T10:36:26.227231+0000","last_active":"2024-03-24T10:36:31.240018+0000","last_peered":"2024-03-24T10:36:31.240018+0000","last_clean":"2024-03-24T10:36:31.240018+0000","last_became_active":"2024-03-24T10:36:26.225847+0000","last_became_peered":"2024-03-24T10:36:26.225847+0000","last_unstale":"2024-03-24T10:36:31.240018+0000","last_undegraded":"2024-03-24T10:36:31.240018+0000","last_fullsized":"2024-03-24T10:36:31.240018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240927+0000","last_change":"2024-03-24T10:36:26.232739+0000","last_active":"2024-03-24T10:36:31.240927+0000","last_peered":"2024-03-24T10:36:31.240927+0000","last_clean":"2024-03-24T10:36:31.240927+0000","last_became_active":"2024-03-24T10:36:26.231159+0000","last_became_peered":"2024-03-24T10:36:26.231159+0000","last_unstale":"2024-03-24T10:36:31.240927+0000","last_undegraded":"2024-03-24T10:36:31.240927+0000","last_fullsized":"2024-03-24T10:36:31.240927+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:23:03.262945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.977892+0000","last_change":"2024-03-24T10:36:26.244230+0000","last_active":"2024-03-24T10:36:31.977892+0000","last_peered":"2024-03-24T10:36:31.977892+0000","last_clean":"2024-03-24T10:36:31.977892+0000","last_became_active":"2024-03-24T10:36:26.243918+0000","last_became_peered":"2024-03-24T10:36:26.243918+0000","last_unstale":"2024-03-24T10:36:31.977892+0000","last_undegraded":"2024-03-24T10:36:31.977892+0000","last_fullsized":"2024-03-24T10:36:31.977892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:53:27.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978041+0000","last_change":"2024-03-24T10:36:26.244721+0000","last_active":"2024-03-24T10:36:31.978041+0000","last_peered":"2024-03-24T10:36:31.978041+0000","last_clean":"2024-03-24T10:36:31.978041+0000","last_became_active":"2024-03-24T10:36:26.244427+0000","last_became_peered":"2024-03-24T10:36:26.244427+0000","last_unstale":"2024-03-24T10:36:31.978041+0000","last_undegraded":"2024-03-24T10:36:31.978041+0000","last_fullsized":"2024-03-24T10:36:31.978041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:58:43.610719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978616+0000","last_change":"2024-03-24T10:36:26.242508+0000","last_active":"2024-03-24T10:36:31.978616+0000","last_peered":"2024-03-24T10:36:31.978616+0000","last_clean":"2024-03-24T10:36:31.978616+0000","last_became_active":"2024-03-24T10:36:26.242179+0000","last_became_peered":"2024-03-24T10:36:26.242179+0000","last_unstale":"2024-03-24T10:36:31.978616+0000","last_undegraded":"2024-03-24T10:36:31.978616+0000","last_fullsized":"2024-03-24T10:36:31.978616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:31:38.572103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.239819+0000","last_change":"2024-03-24T10:36:26.235232+0000","last_active":"2024-03-24T10:36:31.239819+0000","last_peered":"2024-03-24T10:36:31.239819+0000","last_clean":"2024-03-24T10:36:31.239819+0000","last_became_active":"2024-03-24T10:36:26.234954+0000","last_became_peered":"2024-03-24T10:36:26.234954+0000","last_unstale":"2024-03-24T10:36:31.239819+0000","last_undegraded":"2024-03-24T10:36:31.239819+0000","last_fullsized":"2024-03-24T10:36:31.239819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:04:44.715418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978320+0000","last_change":"2024-03-24T10:36:26.235229+0000","last_active":"2024-03-24T10:36:31.978320+0000","last_peered":"2024-03-24T10:36:31.978320+0000","last_clean":"2024-03-24T10:36:31.978320+0000","last_became_active":"2024-03-24T10:36:26.234686+0000","last_became_peered":"2024-03-24T10:36:26.234686+0000","last_unstale":"2024-03-24T10:36:31.978320+0000","last_undegraded":"2024-03-24T10:36:31.978320+0000","last_fullsized":"2024-03-24T10:36:31.978320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:24:18.604629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240402+0000","last_change":"2024-03-24T10:36:26.242391+0000","last_active":"2024-03-24T10:36:31.240402+0000","last_peered":"2024-03-24T10:36:31.240402+0000","last_clean":"2024-03-24T10:36:31.240402+0000","last_became_active":"2024-03-24T10:36:26.241891+0000","last_became_peered":"2024-03-24T10:36:26.241891+0000","last_unstale":"2024-03-24T10:36:31.240402+0000","last_undegraded":"2024-03-24T10:36:31.240402+0000","last_fullsized":"2024-03-24T10:36:31.240402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:57.388855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978072+0000","last_change":"2024-03-24T10:36:26.224899+0000","last_active":"2024-03-24T10:36:31.978072+0000","last_peered":"2024-03-24T10:36:31.978072+0000","last_clean":"2024-03-24T10:36:31.978072+0000","last_became_active":"2024-03-24T10:36:26.224612+0000","last_became_peered":"2024-03-24T10:36:26.224612+0000","last_unstale":"2024-03-24T10:36:31.978072+0000","last_undegraded":"2024-03-24T10:36:31.978072+0000","last_fullsized":"2024-03-24T10:36:31.978072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:20:11.057540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.240698+0000","last_change":"2024-03-24T10:36:26.241713+0000","last_active":"2024-03-24T10:36:31.240698+0000","last_peered":"2024-03-24T10:36:31.240698+0000","last_clean":"2024-03-24T10:36:31.240698+0000","last_became_active":"2024-03-24T10:36:26.241441+0000","last_became_peered":"2024-03-24T10:36:26.241441+0000","last_unstale":"2024-03-24T10:36:31.240698+0000","last_undegraded":"2024-03-24T10:36:31.240698+0000","last_fullsized":"2024-03-24T10:36:31.240698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:15.623287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978166+0000","last_change":"2024-03-24T10:36:26.229024+0000","last_active":"2024-03-24T10:36:31.978166+0000","last_peered":"2024-03-24T10:36:31.978166+0000","last_clean":"2024-03-24T10:36:31.978166+0000","last_became_active":"2024-03-24T10:36:26.228715+0000","last_became_peered":"2024-03-24T10:36:26.228715+0000","last_unstale":"2024-03-24T10:36:31.978166+0000","last_undegraded":"2024-03-24T10:36:31.978166+0000","last_fullsized":"2024-03-24T10:36:31.978166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:22:38.840017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.979045+0000","last_change":"2024-03-24T10:36:26.226685+0000","last_active":"2024-03-24T10:36:31.979045+0000","last_peered":"2024-03-24T10:36:31.979045+0000","last_clean":"2024-03-24T10:36:31.979045+0000","last_became_active":"2024-03-24T10:36:26.226405+0000","last_became_peered":"2024-03-24T10:36:26.226405+0000","last_unstale":"2024-03-24T10:36:31.979045+0000","last_undegraded":"2024-03-24T10:36:31.979045+0000","last_fullsized":"2024-03-24T10:36:31.979045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:15:07.566234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-03-24T10:36:31.978516+0000","last_change":"2024-03-24T10:36:26.234917+0000","last_active":"2024-03-24T10:36:31.978516+0000","last_peered":"2024-03-24T10:36:31.978516+0000","last_clean":"2024-03-24T10:36:31.978516+0000","last_became_active":"2024-03-24T10:36:26.234583+0000","last_became_peered":"2024-03-24T10:36:26.234583+0000","last_unstale":"2024-03-24T10:36:31.978516+0000","last_undegraded":"2024-03-24T10:36:31.978516+0000","last_fullsized":"2024-03-24T10:36:31.978516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:25.195696+0000","last_clean_scrub_stamp":"2024-03-24T10:36:25.195696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:25:16.978883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:36:53.930 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-24T10:36:53.931 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-24T10:36:53.931 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-24T10:36:53.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-24T10:36:54.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.064+0000 7f1d85847640 1 Processor -- start 2024-03-24T10:36:54.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.064+0000 7f1d85847640 1 -- start start 2024-03-24T10:36:54.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d85847640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d8015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d85847640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1d800d4930 0x7f1d800d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d85847640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d800d4e50 con 0x7f1d800d2280 2024-03-24T10:36:54.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d85847640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1d800cf790 con 0x7f1d800d4930 2024-03-24T10:36:54.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d85847640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1d800cfa70 con 0x7f1d8015e170 2024-03-24T10:36:54.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d7f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1d800d2280 0x7f1d800d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37734/0 (socket says 172.21.15.72:37734) 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d7f7fe640 1 -- 172.21.15.72:0/3615952203 learned_addr learned my addr 172.21.15.72:0/3615952203 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d767fc640 1 --2- 172.21.15.72:0/3615952203 >> v2:172.21.15.79:3300/0 conn(0x7f1d800d4930 0x7f1d800d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.065+0000 7f1d7effd640 1 --2- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d8015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.066+0000 7f1d7e7fc640 1 -- 172.21.15.72:0/3615952203 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2776874827 0 0) 0x7f1d800d4e50 con 0x7f1d800d2280 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.066+0000 7f1d767fc640 1 -- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 msgr2=0x7f1d8015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.066+0000 7f1d767fc640 1 --2- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d8015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.066+0000 7f1d767fc640 1 -- 172.21.15.72:0/3615952203 >> v1:172.21.15.72:6789/0 conn(0x7f1d800d2280 legacy=0x7f1d800d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.066+0000 7f1d767fc640 1 -- 172.21.15.72:0/3615952203 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d800cfd50 con 0x7f1d800d4930 2024-03-24T10:36:54.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.066+0000 7f1d767fc640 1 --2- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d4930 0x7f1d800d1d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d680097a0 tx=0x7f1d6802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c39b81bb1e7f7e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d7e7fc640 1 -- 172.21.15.72:0/3615952203 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6802e070 con 0x7f1d800d4930 2024-03-24T10:36:54.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d7e7fc640 1 -- 172.21.15.72:0/3615952203 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d680315a0 con 0x7f1d800d4930 2024-03-24T10:36:54.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d7e7fc640 1 -- 172.21.15.72:0/3615952203 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68031930 con 0x7f1d800d4930 2024-03-24T10:36:54.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 -- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d4930 msgr2=0x7f1d800d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 --2- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d4930 0x7f1d800d1d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d680097a0 tx=0x7f1d6802b840 comp rx=0 tx=0).stop 2024-03-24T10:36:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 -- 172.21.15.72:0/3615952203 shutdown_connections 2024-03-24T10:36:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 --2- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d4930 0x7f1d800d1d40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 --2- 172.21.15.72:0/3615952203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d8015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 -- 172.21.15.72:0/3615952203 >> 172.21.15.72:0/3615952203 conn(0x7f1d8009d310 msgr2=0x7f1d800d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 -- 172.21.15.72:0/3615952203 shutdown_connections 2024-03-24T10:36:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.067+0000 7f1d85847640 1 -- 172.21.15.72:0/3615952203 wait complete. 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.068+0000 7f1d85847640 1 Processor -- start 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 -- start start 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d2280 0x7f1d800cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 0x7f1d801f71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d800cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1d800a0580 con 0x7f1d800d4930 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d800cb570 con 0x7f1d800d2280 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d85847640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1d801f7720 con 0x7f1d8015e170 2024-03-24T10:36:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d767fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 0x7f1d801f71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d767fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 0x7f1d801f71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51616/0 (socket says 172.21.15.72:51616) 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d767fc640 1 -- 172.21.15.72:0/215645893 learned_addr learned my addr 172.21.15.72:0/215645893 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d7f7fe640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d800cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.069+0000 7f1d7effd640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d2280 0x7f1d800cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d767fc640 1 -- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 msgr2=0x7f1d800cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d767fc640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d800cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d767fc640 1 -- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d2280 msgr2=0x7f1d800cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d767fc640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d2280 0x7f1d800cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d767fc640 1 -- 172.21.15.72:0/215645893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d68009400 con 0x7f1d800d4930 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d767fc640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 0x7f1d801f71e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d68034040 tx=0x7f1d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68032840 con 0x7f1d800d4930 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d680329a0 con 0x7f1d800d4930 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68032d50 con 0x7f1d800d4930 2024-03-24T10:36:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8009dc80 con 0x7f1d800d4930 2024-03-24T10:36:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.070+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d801f7a50 con 0x7f1d800d4930 2024-03-24T10:36:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.071+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d800b34a0 con 0x7f1d800d4930 2024-03-24T10:36:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.071+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1d6803b3f0 con 0x7f1d800d4930 2024-03-24T10:36:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.072+0000 7f1d7cff9640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1d6006b810 0x7f1d6006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.072+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d680ac280 con 0x7f1d800d4930 2024-03-24T10:36:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.072+0000 7f1d7effd640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1d6006b810 0x7f1d6006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.072+0000 7f1d7effd640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1d6006b810 0x7f1d6006dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009b40 tx=0x7f1d70009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.076+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1d68076aa0 con 0x7f1d800d4930 2024-03-24T10:36:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.285+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d800a1ef0 con 0x7f1d800d4930 2024-03-24T10:36:54.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.286+0000 7f1d7cff9640 1 -- 172.21.15.72:0/215645893 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1d6807a160 con 0x7f1d800d4930 2024-03-24T10:36:54.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:54.287 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-24T10:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1d6006b810 msgr2=0x7f1d6006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1d6006b810 0x7f1d6006dcd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009b40 tx=0x7f1d70009190 comp rx=0 tx=0).stop 2024-03-24T10:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 msgr2=0x7f1d801f71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 0x7f1d801f71e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d68034040 tx=0x7f1d680046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 shutdown_connections 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1d6006b810 0x7f1d6006dcd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1d8015e170 0x7f1d800cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d800d4930 0x7f1d801f71e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 --2- 172.21.15.72:0/215645893 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d800d2280 0x7f1d800cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 >> 172.21.15.72:0/215645893 conn(0x7f1d8009d310 msgr2=0x7f1d800b3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 shutdown_connections 2024-03-24T10:36:54.290 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.288+0000 7f1d85847640 1 -- 172.21.15.72:0/215645893 wait complete. 2024-03-24T10:36:54.300 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-24T10:36:54.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.400+0000 7efc668df640 1 Processor -- start 2024-03-24T10:36:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.400+0000 7efc668df640 1 -- start start 2024-03-24T10:36:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc668df640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc6015e640 0x7efc600b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc668df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 0x7efc600d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc668df640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc600b3690 con 0x7efc600d0830 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc668df640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efc6006c6e0 con 0x7efc6015e640 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc668df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efc600b30d0 con 0x7efc600cfe70 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc5f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 0x7efc600d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc5ffff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efc6015e640 0x7efc600b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc5f7fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 0x7efc600d02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36276/0 (socket says 172.21.15.72:36276) 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.401+0000 7efc5f7fe640 1 -- 172.21.15.72:0/263894568 learned_addr learned my addr 172.21.15.72:0/263894568 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.402+0000 7efc5ffff640 1 -- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 msgr2=0x7efc600d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.402+0000 7efc5ffff640 1 --2- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 0x7efc600d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.402+0000 7efc5ffff640 1 -- 172.21.15.72:0/263894568 >> v1:172.21.15.79:6789/0 conn(0x7efc600d0830 legacy=0x7efc600ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.402+0000 7efc5ffff640 1 -- 172.21.15.72:0/263894568 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc600b33b0 con 0x7efc6015e640 2024-03-24T10:36:54.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.402+0000 7efc5f7fe640 1 --2- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 0x7efc600d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.402+0000 7efc5ffff640 1 --2- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6015e640 0x7efc600b2a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc500097a0 tx=0x7efc5002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1358ffb92295ebf9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc5effd640 1 -- 172.21.15.72:0/263894568 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5002f050 con 0x7efc6015e640 2024-03-24T10:36:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc5effd640 1 -- 172.21.15.72:0/263894568 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc50031700 con 0x7efc6015e640 2024-03-24T10:36:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc5effd640 1 -- 172.21.15.72:0/263894568 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc50031a90 con 0x7efc6015e640 2024-03-24T10:36:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 -- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6015e640 msgr2=0x7efc600b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 --2- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6015e640 0x7efc600b2a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efc500097a0 tx=0x7efc5002b7a0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 -- 172.21.15.72:0/263894568 shutdown_connections 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 --2- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc600cfe70 0x7efc600d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 --2- 172.21.15.72:0/263894568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc6015e640 0x7efc600b2a70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 -- 172.21.15.72:0/263894568 >> 172.21.15.72:0/263894568 conn(0x7efc600d1d50 msgr2=0x7efc600d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 -- 172.21.15.72:0/263894568 shutdown_connections 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.403+0000 7efc668df640 1 -- 172.21.15.72:0/263894568 wait complete. 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.404+0000 7efc668df640 1 Processor -- start 2024-03-24T10:36:54.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 -- start start 2024-03-24T10:36:54.409 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600cfe70 0x7efc6015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 0x7efc600c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc6015e640 0x7efc600c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efc600ca9b0 con 0x7efc600d0830 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efc600cac90 con 0x7efc600cfe70 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc668df640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efc600caf70 con 0x7efc6015e640 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc5f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 0x7efc600c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc5f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 0x7efc600c61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51624/0 (socket says 172.21.15.72:51624) 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc5f7fe640 1 -- 172.21.15.72:0/2786578320 learned_addr learned my addr 172.21.15.72:0/2786578320 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc64e7c640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc6015e640 0x7efc600c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.405+0000 7efc5ffff640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600cfe70 0x7efc6015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5f7fe640 1 -- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc6015e640 msgr2=0x7efc600c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5f7fe640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc6015e640 0x7efc600c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.410 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5f7fe640 1 -- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600cfe70 msgr2=0x7efc6015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5f7fe640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600cfe70 0x7efc6015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5f7fe640 1 -- 172.21.15.72:0/2786578320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc540094d0 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5f7fe640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 0x7efc600c61c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc5400e9d0 tx=0x7efc5400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5400ca60 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5400cbc0 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc50009400 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc54013470 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.406+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc600cb530 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.407+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc6009fe20 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.407+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efc540135d0 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.408+0000 7efc5cff9640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc4c06b810 0x7efc4c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.408+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc5408a7a0 con 0x7efc600d0830 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.408+0000 7efc5ffff640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc4c06b810 0x7efc4c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.408+0000 7efc5ffff640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc4c06b810 0x7efc4c06dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc50035000 tx=0x7efc50008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.412+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efc54054f30 con 0x7efc600d0830 2024-03-24T10:36:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.585+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc600cbfe0 con 0x7efc600d0830 2024-03-24T10:36:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.587+0000 7efc5cff9640 1 -- 172.21.15.72:0/2786578320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7efc540585f0 con 0x7efc600d0830 2024-03-24T10:36:54.587 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:54.587 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:54.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.588+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc4c06b810 msgr2=0x7efc4c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.588+0000 7efc668df640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc4c06b810 0x7efc4c06dcd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efc50035000 tx=0x7efc50008030 comp rx=0 tx=0).stop 2024-03-24T10:36:54.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.588+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 msgr2=0x7efc600c61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.588+0000 7efc668df640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 0x7efc600c61c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc5400e9d0 tx=0x7efc5400ee90 comp rx=0 tx=0).stop 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 shutdown_connections 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc4c06b810 0x7efc4c06dcd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efc6015e640 0x7efc600c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efc600d0830 0x7efc600c61c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 --2- 172.21.15.72:0/2786578320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efc600cfe70 0x7efc6015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 >> 172.21.15.72:0/2786578320 conn(0x7efc600d1d50 msgr2=0x7efc600b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 shutdown_connections 2024-03-24T10:36:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.589+0000 7efc668df640 1 -- 172.21.15.72:0/2786578320 wait complete. 2024-03-24T10:36:54.600 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:36:54.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:36:54.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.704+0000 7f030904d640 1 Processor -- start 2024-03-24T10:36:54.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.704+0000 7f030904d640 1 -- start start 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030904d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f03040b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030904d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03040b30f0 con 0x7f030406e8d0 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030904d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03040b33d0 con 0x7f030415f440 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030904d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f03040b48a0 con 0x7f030406ecb0 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f0302d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f030406e8d0 0x7f03040b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37740/0 (socket says 172.21.15.72:37740) 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f0302d9d640 1 -- 172.21.15.72:0/3459554145 learned_addr learned my addr 172.21.15.72:0/3459554145 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f02fa59c640 1 --2- 172.21.15.72:0/3459554145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f03040b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675889161 0 0) 0x7f03040b30f0 con 0x7f030406e8d0 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02f0003520 con 0x7f030406e8d0 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655869171 0 0) 0x7f03040b33d0 con 0x7f030415f440 2024-03-24T10:36:54.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03040b30f0 con 0x7f030415f440 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f02fa59c640 1 -- 172.21.15.72:0/3459554145 >> v1:172.21.15.79:6789/0 conn(0x7f030415f440 legacy=0x7f0304144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f02fa59c640 1 -- 172.21.15.72:0/3459554145 >> v1:172.21.15.72:6789/0 conn(0x7f030406e8d0 legacy=0x7f03040b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.705+0000 7f02fa59c640 1 -- 172.21.15.72:0/3459554145 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03040b36b0 con 0x7f030406ecb0 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.706+0000 7f02fa59c640 1 --2- 172.21.15.72:0/3459554145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f03040b2b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0097d0 tx=0x7f02ec02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6759d3acd7820f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.706+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec031890 con 0x7f030406ecb0 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.706+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec0319f0 con 0x7f030406ecb0 2024-03-24T10:36:54.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.706+0000 7f030259c640 1 -- 172.21.15.72:0/3459554145 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec031d80 con 0x7f030406ecb0 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 -- 172.21.15.72:0/3459554145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 msgr2=0x7f03040b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 --2- 172.21.15.72:0/3459554145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f03040b2b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0097d0 tx=0x7f02ec02b930 comp rx=0 tx=0).stop 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 -- 172.21.15.72:0/3459554145 shutdown_connections 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 --2- 172.21.15.72:0/3459554145 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f03040b2b10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 -- 172.21.15.72:0/3459554145 >> 172.21.15.72:0/3459554145 conn(0x7f03040b1810 msgr2=0x7f03040b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 -- 172.21.15.72:0/3459554145 shutdown_connections 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.707+0000 7f030904d640 1 -- 172.21.15.72:0/3459554145 wait complete. 2024-03-24T10:36:54.709 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.708+0000 7f030904d640 1 Processor -- start 2024-03-24T10:36:54.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.708+0000 7f030904d640 1 -- start start 2024-03-24T10:36:54.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030904d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f030406e8d0 0x7f030413baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030904d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f030413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030904d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 0x7f0304070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030904d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f030413db50 con 0x7f030415f440 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030904d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f030415a7e0 con 0x7f030406e8d0 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030904d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f03040ced00 con 0x7f030406ecb0 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030359e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 0x7f0304070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030359e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 0x7f0304070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51634/0 (socket says 172.21.15.72:51634) 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f030359e640 1 -- 172.21.15.72:0/2350743934 learned_addr learned my addr 172.21.15.72:0/2350743934 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f0302d9d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f030406e8d0 0x7f030413baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.709+0000 7f02fa59c640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f030413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030359e640 1 -- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 msgr2=0x7f030413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030359e640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f030413dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030359e640 1 -- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f030406e8d0 msgr2=0x7f030413baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.713 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030359e640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f030406e8d0 0x7f030413baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030359e640 1 -- 172.21.15.72:0/2350743934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02ec009400 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030359e640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 0x7f0304070d40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c6e0 tx=0x7f02fc00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc003b70 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02fc003cd0 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03040cefe0 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02fc0052d0 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.710+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030413d7e0 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.711+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030413d360 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.711+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f02fc005430 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.712+0000 7f02fbfff640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f02e406b810 0x7f02e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.712+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02fc08a1f0 con 0x7f030415f440 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.712+0000 7f0302d9d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f02e406b810 0x7f02e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:54.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.712+0000 7f0302d9d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f02e406b810 0x7f02e406dcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02f40011e0 tx=0x7f02f4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:54.716 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.716+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f030413d360 con 0x7f030415f440 2024-03-24T10:36:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.885+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f030413d360 con 0x7f030415f440 2024-03-24T10:36:54.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.886+0000 7f02fbfff640 1 -- 172.21.15.72:0/2350743934 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f030413d360 con 0x7f030415f440 2024-03-24T10:36:54.886 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:36:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f02e406b810 msgr2=0x7f02e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f02e406b810 0x7f02e406dcd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f02f40011e0 tx=0x7f02f4007d30 comp rx=0 tx=0).stop 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 msgr2=0x7f0304070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 0x7f0304070d40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00c6e0 tx=0x7f02fc00cba0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 shutdown_connections 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f02e406b810 0x7f02e406dcd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f030415f440 0x7f0304070d40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f030406ecb0 0x7f030413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 --2- 172.21.15.72:0/2350743934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f030406e8d0 0x7f030413baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 >> 172.21.15.72:0/2350743934 conn(0x7f03040b1810 msgr2=0x7f0304143e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 shutdown_connections 2024-03-24T10:36:54.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:54.888+0000 7f030904d640 1 -- 172.21.15.72:0/2350743934 wait complete. 2024-03-24T10:36:54.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:36:55.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 Processor -- start 2024-03-24T10:36:55.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 -- start start 2024-03-24T10:36:55.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d1815e250 0x7f8d180d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d180d2b30 0x7f8d180b4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d180b3270 con 0x7f8d180d4960 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8d1815e630 con 0x7f8d180d2b30 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.003+0000 7f8d1d8e1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8d180b34c0 con 0x7f8d1815e250 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d177fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d180d2b30 0x7f8d180b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d16ffd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d1815e250 0x7f8d180d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d167fc640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8d180d4960 0x7f8d180d2420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37752/0 (socket says 172.21.15.72:37752) 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d167fc640 1 -- 172.21.15.72:0/4285663583 learned_addr learned my addr 172.21.15.72:0/4285663583 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d16ffd640 1 -- 172.21.15.72:0/4285663583 >> v2:172.21.15.72:3300/0 conn(0x7f8d180d2b30 msgr2=0x7f8d180b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d16ffd640 1 --2- 172.21.15.72:0/4285663583 >> v2:172.21.15.72:3300/0 conn(0x7f8d180d2b30 0x7f8d180b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d16ffd640 1 -- 172.21.15.72:0/4285663583 >> v1:172.21.15.72:6789/0 conn(0x7f8d180d4960 legacy=0x7f8d180d2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d16ffd640 1 -- 172.21.15.72:0/4285663583 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d180b37a0 con 0x7f8d1815e250 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d15ffb640 1 -- 172.21.15.72:0/4285663583 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260867445 0 0) 0x7f8d180b3270 con 0x7f8d180d4960 2024-03-24T10:36:55.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.004+0000 7f8d177fe640 1 --2- 172.21.15.72:0/4285663583 >> v2:172.21.15.72:3300/0 conn(0x7f8d180d2b30 0x7f8d180b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d16ffd640 1 --2- 172.21.15.72:0/4285663583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180d0e80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d1808c620 tx=0x7f8d0802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15886f1b0a4d957 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d15ffb640 1 -- 172.21.15.72:0/4285663583 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0802e070 con 0x7f8d1815e250 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d15ffb640 1 -- 172.21.15.72:0/4285663583 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d080315a0 con 0x7f8d1815e250 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d15ffb640 1 -- 172.21.15.72:0/4285663583 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08031930 con 0x7f8d1815e250 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/4285663583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 msgr2=0x7f8d180d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/4285663583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180d0e80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8d1808c620 tx=0x7f8d0802b840 comp rx=0 tx=0).stop 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/4285663583 shutdown_connections 2024-03-24T10:36:55.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/4285663583 >> v2:172.21.15.72:3300/0 conn(0x7f8d180d2b30 0x7f8d180b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/4285663583 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180d0e80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/4285663583 >> 172.21.15.72:0/4285663583 conn(0x7f8d180d3e40 msgr2=0x7f8d180d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/4285663583 shutdown_connections 2024-03-24T10:36:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.005+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/4285663583 wait complete. 2024-03-24T10:36:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.007+0000 7f8d1d8e1640 1 Processor -- start 2024-03-24T10:36:55.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.007+0000 7f8d1d8e1640 1 -- start start 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.007+0000 7f8d1d8e1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d180d2b30 0x7f8d181f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.007+0000 7f8d1d8e1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 0x7f8d180c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.007+0000 7f8d1d8e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d1d8e1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d18152da0 con 0x7f8d180d4960 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d1d8e1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181f3430 con 0x7f8d1815e250 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d1d8e1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8d180c8ee0 con 0x7f8d180d2b30 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 0x7f8d180c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d177fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d16ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d180d2b30 0x7f8d181f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 0x7f8d180c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51648/0 (socket says 172.21.15.72:51648) 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 -- 172.21.15.72:0/3022353351 learned_addr learned my addr 172.21.15.72:0/3022353351 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 -- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d180d2b30 msgr2=0x7f8d181f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d180d2b30 0x7f8d181f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 -- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 msgr2=0x7f8d180caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 -- 172.21.15.72:0/3022353351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d10009a70 con 0x7f8d180d4960 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d177fe640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d167fc640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 0x7f8d180c9f80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c4a0 tx=0x7f8d0c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0074e0 con 0x7f8d180d4960 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0c007640 con 0x7f8d180d4960 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d08009400 con 0x7f8d180d4960 2024-03-24T10:36:55.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c004a00 con 0x7f8d180d4960 2024-03-24T10:36:55.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.008+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d180c94a0 con 0x7f8d180d4960 2024-03-24T10:36:55.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.009+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1804f470 con 0x7f8d180d4960 2024-03-24T10:36:55.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.010+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8d0c004b60 con 0x7f8d180d4960 2024-03-24T10:36:55.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.010+0000 7f8cfffff640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d0406b810 0x7f8d0406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.010+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d0c089990 con 0x7f8d180d4960 2024-03-24T10:36:55.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.010+0000 7f8d16ffd640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d0406b810 0x7f8d0406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.011+0000 7f8d16ffd640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d0406b810 0x7f8d0406dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d08036000 tx=0x7f8d0803e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.014+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8d0c054120 con 0x7f8d180d4960 2024-03-24T10:36:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.184+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d180d0e80 con 0x7f8d180d4960 2024-03-24T10:36:55.185 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.184+0000 7f8cfffff640 1 -- 172.21.15.72:0/3022353351 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f8d0c0577e0 con 0x7f8d180d4960 2024-03-24T10:36:55.185 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d0406b810 msgr2=0x7f8d0406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d0406b810 0x7f8d0406dcd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8d08036000 tx=0x7f8d0803e040 comp rx=0 tx=0).stop 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 msgr2=0x7f8d180c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 0x7f8d180c9f80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c00c4a0 tx=0x7f8d0c00c960 comp rx=0 tx=0).stop 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 shutdown_connections 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d0406b810 0x7f8d0406dcd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1815e250 0x7f8d180caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.187 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d180d4960 0x7f8d180c9f80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 --2- 172.21.15.72:0/3022353351 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d180d2b30 0x7f8d181f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 >> 172.21.15.72:0/3022353351 conn(0x7f8d180d3e40 msgr2=0x7f8d180d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 shutdown_connections 2024-03-24T10:36:55.188 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.186+0000 7f8d1d8e1640 1 -- 172.21.15.72:0/3022353351 wait complete. 2024-03-24T10:36:55.198 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:36:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.300+0000 7f88c2fa1640 1 Processor -- start 2024-03-24T10:36:55.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.300+0000 7f88c2fa1640 1 -- start start 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c2fa1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c2fa1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88bc0c5e60 0x7f88bc0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c2fa1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88bc0d0bb0 con 0x7f88bc15bfd0 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c2fa1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f88bc0cd3a0 con 0x7f88bc0c5e60 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c2fa1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc15c3b0 con 0x7f88bc0d0210 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c153e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88bc0c5e60 0x7f88bc0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c0d3d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f88bc15bfd0 0x7f88bc0cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37760/0 (socket says 172.21.15.72:37760) 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88c0d3d640 1 -- 172.21.15.72:0/1631054328 learned_addr learned my addr 172.21.15.72:0/1631054328 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.301+0000 7f88bbfff640 1 --2- 172.21.15.72:0/1631054328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88bb7fe640 1 -- 172.21.15.72:0/1631054328 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685765767 0 0) 0x7f88bc0d0bb0 con 0x7f88bc15bfd0 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88bb7fe640 1 -- 172.21.15.72:0/1631054328 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88a4003520 con 0x7f88bc15bfd0 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88c153e640 1 -- 172.21.15.72:0/1631054328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 msgr2=0x7f88bc0d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88c153e640 1 --2- 172.21.15.72:0/1631054328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88c153e640 1 -- 172.21.15.72:0/1631054328 >> v1:172.21.15.72:6789/0 conn(0x7f88bc15bfd0 legacy=0x7f88bc0cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88c153e640 1 -- 172.21.15.72:0/1631054328 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc0cd640 con 0x7f88bc0c5e60 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.302+0000 7f88c153e640 1 --2- 172.21.15.72:0/1631054328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc0c5e60 0x7f88bc0c62d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d90 tx=0x7f88b402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefd4b9972eacbae server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88bb7fe640 1 -- 172.21.15.72:0/1631054328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b402cbc0 con 0x7f88bc0c5e60 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88bb7fe640 1 -- 172.21.15.72:0/1631054328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b402cd20 con 0x7f88bc0c5e60 2024-03-24T10:36:55.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88bb7fe640 1 -- 172.21.15.72:0/1631054328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4034660 con 0x7f88bc0c5e60 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 -- 172.21.15.72:0/1631054328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc0c5e60 msgr2=0x7f88bc0c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/1631054328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc0c5e60 0x7f88bc0c62d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d90 tx=0x7f88b402be10 comp rx=0 tx=0).stop 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 -- 172.21.15.72:0/1631054328 shutdown_connections 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/1631054328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc0c5e60 0x7f88bc0c62d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/1631054328 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 -- 172.21.15.72:0/1631054328 >> 172.21.15.72:0/1631054328 conn(0x7f88bc0d1c50 msgr2=0x7f88bc0d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 -- 172.21.15.72:0/1631054328 shutdown_connections 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.303+0000 7f88c2fa1640 1 -- 172.21.15.72:0/1631054328 wait complete. 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.304+0000 7f88c2fa1640 1 Processor -- start 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.304+0000 7f88c2fa1640 1 -- start start 2024-03-24T10:36:55.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c2fa1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88bc0c5e60 0x7f88bc1f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c2fa1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c2fa1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 0x7f88bc0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c2fa1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc0ca1d0 con 0x7f88bc15bfd0 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c2fa1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc0ca4b0 con 0x7f88bc0c5e60 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c2fa1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc0b64b0 con 0x7f88bc0d0210 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c153e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 0x7f88bc0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c153e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 0x7f88bc0c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51668/0 (socket says 172.21.15.72:51668) 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c153e640 1 -- 172.21.15.72:0/3633464115 learned_addr learned my addr 172.21.15.72:0/3633464115 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88c0d3d640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88bc0c5e60 0x7f88bc1f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.305+0000 7f88bbfff640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c153e640 1 -- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 msgr2=0x7f88bc0c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c153e640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c153e640 1 -- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88bc0c5e60 msgr2=0x7f88bc1f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c153e640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88bc0c5e60 0x7f88bc1f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c153e640 1 -- 172.21.15.72:0/3633464115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b4009a70 con 0x7f88bc15bfd0 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c153e640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 0x7f88bc0c72a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d90 tx=0x7f88b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4040650 con 0x7f88bc15bfd0 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b402ce90 con 0x7f88bc15bfd0 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88bc0b6790 con 0x7f88bc15bfd0 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b40409f0 con 0x7f88bc15bfd0 2024-03-24T10:36:55.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.306+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88bc0ca790 con 0x7f88bc15bfd0 2024-03-24T10:36:55.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.307+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88bc04f470 con 0x7f88bc15bfd0 2024-03-24T10:36:55.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.307+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f88b4040b50 con 0x7f88bc15bfd0 2024-03-24T10:36:55.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.308+0000 7f88b97fa640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88a806b810 0x7f88a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.308+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88b40ace90 con 0x7f88bc15bfd0 2024-03-24T10:36:55.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.308+0000 7f88c0d3d640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88a806b810 0x7f88a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.308+0000 7f88c0d3d640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88a806b810 0x7f88a806dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88ac005880 tx=0x7f88ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.312+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f88b40776b0 con 0x7f88bc15bfd0 2024-03-24T10:36:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.482+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f88bc0d0b60 con 0x7f88bc15bfd0 2024-03-24T10:36:55.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.483+0000 7f88b97fa640 1 -- 172.21.15.72:0/3633464115 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f88b4039020 con 0x7f88bc15bfd0 2024-03-24T10:36:55.484 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:36:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88a806b810 msgr2=0x7f88a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88a806b810 0x7f88a806dcd0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f88ac005880 tx=0x7f88ac009040 comp rx=0 tx=0).stop 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 msgr2=0x7f88bc0c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 0x7f88bc0c72a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d90 tx=0x7f88b4004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 shutdown_connections 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88a806b810 0x7f88a806dcd0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88bc15bfd0 0x7f88bc0c72a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88bc0d0210 0x7f88bc0c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 --2- 172.21.15.72:0/3633464115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88bc0c5e60 0x7f88bc1f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 >> 172.21.15.72:0/3633464115 conn(0x7f88bc0d1c50 msgr2=0x7f88bc0c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 shutdown_connections 2024-03-24T10:36:55.486 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.485+0000 7f88c2fa1640 1 -- 172.21.15.72:0/3633464115 wait complete. 2024-03-24T10:36:55.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:36:55.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:36:55.597 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:36:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.598+0000 7ff7f0cf4640 1 Processor -- start 2024-03-24T10:36:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.599+0000 7ff7f0cf4640 1 -- start start 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.599+0000 7ff7f0cf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d0f70 0x7ff7ec0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.599+0000 7ff7f0cf4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec0d4950 con 0x7ff7ec15e240 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.599+0000 7ff7f0cf4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec0b38c0 con 0x7ff7ec0d2b20 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.599+0000 7ff7f0cf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec0d2270 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7ea59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff7ec15e240 0x7ff7ec0d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37766/0 (socket says 172.21.15.72:37766) 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7ea59c640 1 -- 172.21.15.72:0/915267377 learned_addr learned my addr 172.21.15.72:0/915267377 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7e9d9b640 1 --1- 172.21.15.72:0/915267377 >> v1:172.21.15.79:6789/0 conn(0x7ff7ec0d2b20 0x7ff7ec0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:39504/0 (socket says 172.21.15.72:39504) 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7ead9d640 1 --2- 172.21.15.72:0/915267377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d0f70 0x7ff7ec0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 553598708 0 0) 0x7ff7ec0d4950 con 0x7ff7ec15e240 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d4003520 con 0x7ff7ec15e240 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182215658 0 0) 0x7ff7ec0b38c0 con 0x7ff7ec0d2b20 2024-03-24T10:36:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7ec0d4950 con 0x7ff7ec0d2b20 2024-03-24T10:36:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7ead9d640 1 -- 172.21.15.72:0/915267377 >> v1:172.21.15.79:6789/0 conn(0x7ff7ec0d2b20 legacy=0x7ff7ec0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7ead9d640 1 -- 172.21.15.72:0/915267377 >> v1:172.21.15.72:6789/0 conn(0x7ff7ec15e240 legacy=0x7ff7ec0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.602 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.600+0000 7ff7ead9d640 1 -- 172.21.15.72:0/915267377 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec0b3550 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.603 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.601+0000 7ff7ead9d640 1 --2- 172.21.15.72:0/915267377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d0f70 0x7ff7ec0cf150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097d0 tx=0x7ff7dc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9406ef9cd6a0fdc4 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.601+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc031800 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.601+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7dc031960 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.601+0000 7ff7e959a640 1 -- 172.21.15.72:0/915267377 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc031cf0 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.601+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/915267377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d0f70 msgr2=0x7ff7ec0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.601+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/915267377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d0f70 0x7ff7ec0cf150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0097d0 tx=0x7ff7dc02b8a0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.602+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/915267377 shutdown_connections 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.602+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/915267377 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d0f70 0x7ff7ec0cf150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.602+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/915267377 >> 172.21.15.72:0/915267377 conn(0x7ff7ec0d3e30 msgr2=0x7ff7ec0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.602+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/915267377 shutdown_connections 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.602+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/915267377 wait complete. 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.603+0000 7ff7f0cf4640 1 Processor -- start 2024-03-24T10:36:55.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.603+0000 7ff7f0cf4640 1 -- start start 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 0x7ff7ec14d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d2b20 0x7ff7ec0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7ec15e240 0x7ff7ec14b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0cbff0 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0cc2d0 con 0x7ff7ec15e240 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec0cc5b0 con 0x7ff7ec0d2b20 2024-03-24T10:36:55.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 0x7ff7ec14d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 0x7ff7ec14d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51680/0 (socket says 172.21.15.72:51680) 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 -- 172.21.15.72:0/2154893955 learned_addr learned my addr 172.21.15.72:0/2154893955 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ead9d640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7ec15e240 0x7ff7ec14b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7e9d9b640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d2b20 0x7ff7ec0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 -- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d2b20 msgr2=0x7ff7ec0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d2b20 0x7ff7ec0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 -- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7ec15e240 msgr2=0x7ff7ec14b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7ec15e240 0x7ff7ec14b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 -- 172.21.15.72:0/2154893955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc009400 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ead9d640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7ec15e240 0x7ff7ec14b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7ea59c640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 0x7ff7ec14d9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400cbc0 tx=0x7ff7e400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400ad40 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e4012400 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec0cc890 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.604+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40127b0 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.605+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec14def0 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.606+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec04f470 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.606+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff7e4007070 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.606+0000 7ff7daffd640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff7cc06b810 0x7ff7cc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.606+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff7e408a530 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.606+0000 7ff7e9d9b640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff7cc06b810 0x7ff7cc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.607+0000 7ff7e9d9b640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff7cc06b810 0x7ff7cc06dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0b9e90 tx=0x7ff7e0007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.611+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff7e4054c40 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.785+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff7ec0d1510 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.786 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.785+0000 7ff7daffd640 1 -- 172.21.15.72:0/2154893955 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7ff7e4058300 con 0x7ff7ec0d0f70 2024-03-24T10:36:55.786 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:55.787 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff7cc06b810 msgr2=0x7ff7cc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff7cc06b810 0x7ff7cc06dcd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec0b9e90 tx=0x7ff7e0007cf0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 msgr2=0x7ff7ec14d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 0x7ff7ec14d9b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400cbc0 tx=0x7ff7e400a430 comp rx=0 tx=0).stop 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 shutdown_connections 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff7cc06b810 0x7ff7cc06dcd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7ec15e240 0x7ff7ec14b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff7ec0d2b20 0x7ff7ec0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 --2- 172.21.15.72:0/2154893955 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7ec0d0f70 0x7ff7ec14d9b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 >> 172.21.15.72:0/2154893955 conn(0x7ff7ec0d3e30 msgr2=0x7ff7ec15d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 shutdown_connections 2024-03-24T10:36:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.787+0000 7ff7f0cf4640 1 -- 172.21.15.72:0/2154893955 wait complete. 2024-03-24T10:36:55.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.898+0000 7fbf11e9d640 1 Processor -- start 2024-03-24T10:36:55.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.898+0000 7fbf11e9d640 1 -- start start 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf11e9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf11e9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf0c0d4930 0x7fbf0c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf11e9d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0c0d4e50 con 0x7fbf0c0d2280 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf11e9d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbf0c0cf790 con 0x7fbf0c0d4930 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf11e9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0c0cfa70 con 0x7fbf0c15e170 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf0affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf0c0d4930 0x7fbf0c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf0affd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf0c0d4930 0x7fbf0c0d1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51690/0 (socket says 172.21.15.72:51690) 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf0affd640 1 -- 172.21.15.72:0/4271194577 learned_addr learned my addr 172.21.15.72:0/4271194577 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.899+0000 7fbf0b7fe640 1 --2- 172.21.15.72:0/4271194577 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.900+0000 7fbf0affd640 1 -- 172.21.15.72:0/4271194577 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 msgr2=0x7fbf0c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.900+0000 7fbf0affd640 1 --2- 172.21.15.72:0/4271194577 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.900+0000 7fbf0affd640 1 -- 172.21.15.72:0/4271194577 >> v1:172.21.15.79:6789/0 conn(0x7fbf0c0d2280 legacy=0x7fbf0c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.900+0000 7fbf0affd640 1 -- 172.21.15.72:0/4271194577 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c0cfd50 con 0x7fbf0c0d4930 2024-03-24T10:36:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.900+0000 7fbf0affd640 1 --2- 172.21.15.72:0/4271194577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c0d1d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009870 tx=0x7fbf0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4737b32216feeec server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.900+0000 7fbf0a7fc640 1 -- 172.21.15.72:0/4271194577 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00031640 con 0x7fbf0c0d4930 2024-03-24T10:36:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf0a7fc640 1 -- 172.21.15.72:0/4271194577 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf000317a0 con 0x7fbf0c0d4930 2024-03-24T10:36:55.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf0a7fc640 1 -- 172.21.15.72:0/4271194577 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00031b30 con 0x7fbf0c0d4930 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 -- 172.21.15.72:0/4271194577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d4930 msgr2=0x7fbf0c0d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/4271194577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c0d1d40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf00009870 tx=0x7fbf0002b8f0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 -- 172.21.15.72:0/4271194577 shutdown_connections 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/4271194577 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c0d1d40 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/4271194577 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 -- 172.21.15.72:0/4271194577 >> 172.21.15.72:0/4271194577 conn(0x7fbf0c09d310 msgr2=0x7fbf0c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 -- 172.21.15.72:0/4271194577 shutdown_connections 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.901+0000 7fbf11e9d640 1 -- 172.21.15.72:0/4271194577 wait complete. 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.902+0000 7fbf11e9d640 1 Processor -- start 2024-03-24T10:36:55.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.902+0000 7fbf11e9d640 1 -- start start 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf11e9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 0x7fbf0c0cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf11e9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf11e9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c0b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf11e9d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c14f980 con 0x7fbf0c0d2280 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf11e9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c0b8800 con 0x7fbf0c0d4930 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf11e9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbf0c0cb410 con 0x7fbf0c15e170 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 0x7fbf0c0cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 0x7fbf0c0cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51698/0 (socket says 172.21.15.72:51698) 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 -- 172.21.15.72:0/3102039688 learned_addr learned my addr 172.21.15.72:0/3102039688 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0bfff640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c0b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0affd640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 -- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 msgr2=0x7fbf0c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c0b1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 -- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf0c0d4930 msgr2=0x7fbf0c14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.903+0000 7fbf0b7fe640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbf0b7fe640 1 -- 172.21.15.72:0/3102039688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000094d0 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbf0b7fe640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 0x7fbf0c0cdd10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00e9b0 tx=0x7fbefc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc009670 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbefc00c9a0 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc00cd50 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c0b81b0 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.904+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c0cb6f0 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.905+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0c0a1ef0 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.905+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbefc013470 con 0x7fbf0c0d2280 2024-03-24T10:36:55.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.906+0000 7fbef3fff640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbef806b840 0x7fbef806dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:55.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.906+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbefc08a680 con 0x7fbf0c0d2280 2024-03-24T10:36:55.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.906+0000 7fbf0affd640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbef806b840 0x7fbef806dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:55.909 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.906+0000 7fbf0affd640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbef806b840 0x7fbef806dd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf00036000 tx=0x7fbf0003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:55.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:55.910+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbefc054e10 con 0x7fbf0c0d2280 2024-03-24T10:36:56.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.118+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf0c04f550 con 0x7fbf0c0d2280 2024-03-24T10:36:56.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.119+0000 7fbef3fff640 1 -- 172.21.15.72:0/3102039688 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7fbefc0584d0 con 0x7fbf0c0d2280 2024-03-24T10:36:56.119 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:56.119 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:36:56.120 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:36:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbef806b840 msgr2=0x7fbef806dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbef806b840 0x7fbef806dd00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbf00036000 tx=0x7fbf0003c040 comp rx=0 tx=0).stop 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 msgr2=0x7fbf0c0cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 0x7fbf0c0cdd10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00e9b0 tx=0x7fbefc00ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 shutdown_connections 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbef806b840 0x7fbef806dd00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf0c15e170 0x7fbf0c0b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf0c0d4930 0x7fbf0c14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 --2- 172.21.15.72:0/3102039688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf0c0d2280 0x7fbf0c0cdd10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 >> 172.21.15.72:0/3102039688 conn(0x7fbf0c09d310 msgr2=0x7fbf0c06cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 shutdown_connections 2024-03-24T10:36:56.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.121+0000 7fbf11e9d640 1 -- 172.21.15.72:0/3102039688 wait complete. 2024-03-24T10:36:56.133 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:56.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.232+0000 7f88b3f81640 1 Processor -- start 2024-03-24T10:36:56.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.233+0000 7f88b3f81640 1 -- start start 2024-03-24T10:36:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.233+0000 7f88b3f81640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88ac06d570 0x7f88ac071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.233+0000 7f88b3f81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.233+0000 7f88b3f81640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac0715f0 con 0x7f88ac0b2c20 2024-03-24T10:36:56.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.233+0000 7f88b3f81640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac071d90 con 0x7f88ac06d570 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.233+0000 7f88b3f81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0b4d80 con 0x7f88ac071050 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b151c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88ac06d570 0x7f88ac071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f88ac06d570 0x7f88ac071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53808/0 (socket says 172.21.15.72:53808) 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b151c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:36394/0 (socket says 172.21.15.72:36394) 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2194092220 learned_addr learned my addr 172.21.15.72:0/2194092220 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b251e640 1 --1- 172.21.15.72:0/2194092220 >> v1:172.21.15.79:6789/0 conn(0x7f88ac0b2c20 0x7f88ac0b30b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:39522/0 (socket says 172.21.15.72:39522) 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 msgr2=0x7f88ac06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 --2- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac06d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2194092220 >> v1:172.21.15.79:6789/0 conn(0x7f88ac0b2c20 legacy=0x7f88ac0b30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.235 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.234+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2194092220 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac06de90 con 0x7f88ac06d570 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b1d1d640 1 --2- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac071850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009e50 tx=0x7f88a402bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9f690242d0bc81e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b0d1b640 1 -- 172.21.15.72:0/2194092220 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a402cb90 con 0x7f88ac06d570 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b0d1b640 1 -- 172.21.15.72:0/2194092220 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a402ccf0 con 0x7f88ac06d570 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b0d1b640 1 -- 172.21.15.72:0/2194092220 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4034610 con 0x7f88ac06d570 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 -- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 msgr2=0x7f88ac071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac071850 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f88a4009e50 tx=0x7f88a402bff0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 -- 172.21.15.72:0/2194092220 shutdown_connections 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac06d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2194092220 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac071850 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 -- 172.21.15.72:0/2194092220 >> 172.21.15.72:0/2194092220 conn(0x7f88ac0b1920 msgr2=0x7f88ac0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 -- 172.21.15.72:0/2194092220 shutdown_connections 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.235+0000 7f88b3f81640 1 -- 172.21.15.72:0/2194092220 wait complete. 2024-03-24T10:36:56.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.236+0000 7f88b3f81640 1 Processor -- start 2024-03-24T10:36:56.238 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 -- start start 2024-03-24T10:36:56.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac09a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 0x7f88ac1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac156b00 con 0x7f88ac0b2c20 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac156fc0 con 0x7f88ac06d570 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b3f81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac156ce0 con 0x7f88ac071050 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b251e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 0x7f88ac1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b1d1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac09a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b1d1d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac09a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53816/0 (socket says 172.21.15.72:53816) 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b251e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 0x7f88ac1519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51702/0 (socket says 172.21.15.72:51702) 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2759696438 learned_addr learned my addr 172.21.15.72:0/2759696438 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.237+0000 7f88b151c640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 msgr2=0x7f88ac1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b1d1d640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac1514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 msgr2=0x7f88ac1519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b1d1d640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 0x7f88ac1519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b1d1d640 1 -- 172.21.15.72:0/2759696438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a4009b30 con 0x7f88ac06d570 2024-03-24T10:36:56.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b251e640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 0x7f88ac1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b1d1d640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac09a9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f88a4036040 tx=0x7f88a4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a4009510 con 0x7f88ac06d570 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a403e450 con 0x7f88ac06d570 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a403e820 con 0x7f88ac06d570 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac15b510 con 0x7f88ac06d570 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.238+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac15bad0 con 0x7f88ac06d570 2024-03-24T10:36:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.239+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac15bcf0 con 0x7f88ac06d570 2024-03-24T10:36:56.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.240+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f88a403e980 con 0x7f88ac06d570 2024-03-24T10:36:56.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.240+0000 7f88aa7fc640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f889806b810 0x7f889806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.240+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88a40ad940 con 0x7f88ac06d570 2024-03-24T10:36:56.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.240+0000 7f88b151c640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f889806b810 0x7f889806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.240+0000 7f88b151c640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f889806b810 0x7f889806dcd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0cf2f0 tx=0x7f88a0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.248+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f88a40780b0 con 0x7f88ac06d570 2024-03-24T10:36:56.420 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.419+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88ac072a70 con 0x7f88ac06d570 2024-03-24T10:36:56.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.421+0000 7f88aa7fc640 1 -- 172.21.15.72:0/2759696438 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f88a402ce60 con 0x7f88ac06d570 2024-03-24T10:36:56.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:56.422 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f889806b810 msgr2=0x7f889806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f889806b810 0x7f889806dcd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0cf2f0 tx=0x7f88a0009190 comp rx=0 tx=0).stop 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 msgr2=0x7f88ac09a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac09a9d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f88a4036040 tx=0x7f88a4004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 shutdown_connections 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f889806b810 0x7f889806dcd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88ac0b2c20 0x7f88ac1519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f88ac071050 0x7f88ac1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 --2- 172.21.15.72:0/2759696438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f88ac06d570 0x7f88ac09a9d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 >> 172.21.15.72:0/2759696438 conn(0x7f88ac0b1920 msgr2=0x7f88ac1553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 shutdown_connections 2024-03-24T10:36:56.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.423+0000 7f88b3f81640 1 -- 172.21.15.72:0/2759696438 wait complete. 2024-03-24T10:36:56.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:36:56.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:36:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.538+0000 7efcab732640 1 Processor -- start 2024-03-24T10:36:56.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.538+0000 7efcab732640 1 -- start start 2024-03-24T10:36:56.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efcab732640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca40cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efcab732640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efca40d0f70 0x7efca40cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efcab732640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca40d4950 con 0x7efca415e240 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efcab732640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efca40d2270 con 0x7efca40d0f70 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efcab732640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efca40b38c0 con 0x7efca40d2b20 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca9ccf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efca40d0f70 0x7efca40cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca94ce640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efca415e240 0x7efca40d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37778/0 (socket says 172.21.15.72:37778) 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca94ce640 1 -- 172.21.15.72:0/1266235487 learned_addr learned my addr 172.21.15.72:0/1266235487 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca8ccd640 1 --2- 172.21.15.72:0/1266235487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca40cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efc9bfff640 1 -- 172.21.15.72:0/1266235487 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691325297 0 0) 0x7efca40d4950 con 0x7efca415e240 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efc9bfff640 1 -- 172.21.15.72:0/1266235487 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc90003520 con 0x7efca415e240 2024-03-24T10:36:56.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca9ccf640 1 -- 172.21.15.72:0/1266235487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 msgr2=0x7efca40cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:56.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca9ccf640 1 --2- 172.21.15.72:0/1266235487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca40cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca9ccf640 1 -- 172.21.15.72:0/1266235487 >> v1:172.21.15.72:6789/0 conn(0x7efca415e240 legacy=0x7efca40d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.539+0000 7efca9ccf640 1 -- 172.21.15.72:0/1266235487 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca40b3550 con 0x7efca40d0f70 2024-03-24T10:36:56.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efca9ccf640 1 --2- 172.21.15.72:0/1266235487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca40d0f70 0x7efca40cef80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009d90 tx=0x7efc9c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe3aa85981500d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efc9bfff640 1 -- 172.21.15.72:0/1266235487 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02cbd0 con 0x7efca40d0f70 2024-03-24T10:36:56.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efc9bfff640 1 -- 172.21.15.72:0/1266235487 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c02cd30 con 0x7efca40d0f70 2024-03-24T10:36:56.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efc9bfff640 1 -- 172.21.15.72:0/1266235487 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02cea0 con 0x7efca40d0f70 2024-03-24T10:36:56.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efcab732640 1 -- 172.21.15.72:0/1266235487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca40d0f70 msgr2=0x7efca40cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efcab732640 1 --2- 172.21.15.72:0/1266235487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca40d0f70 0x7efca40cef80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009d90 tx=0x7efc9c02be20 comp rx=0 tx=0).stop 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efcab732640 1 -- 172.21.15.72:0/1266235487 shutdown_connections 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efcab732640 1 --2- 172.21.15.72:0/1266235487 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca40d0f70 0x7efca40cef80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efcab732640 1 --2- 172.21.15.72:0/1266235487 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca40cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.540+0000 7efcab732640 1 -- 172.21.15.72:0/1266235487 >> 172.21.15.72:0/1266235487 conn(0x7efca40d3e30 msgr2=0x7efca40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.541+0000 7efcab732640 1 -- 172.21.15.72:0/1266235487 shutdown_connections 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.541+0000 7efcab732640 1 -- 172.21.15.72:0/1266235487 wait complete. 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 Processor -- start 2024-03-24T10:36:56.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 -- start start 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 0x7efca4160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca41492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 0x7efca415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efca41f6b40 con 0x7efca415e240 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efca40c95e0 con 0x7efca40d0f70 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.542+0000 7efcab732640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efca40c9880 con 0x7efca40d2b20 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 0x7efca415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca94ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 0x7efca4160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca94ce640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 0x7efca4160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:53830/0 (socket says 172.21.15.72:53830) 2024-03-24T10:36:56.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca94ce640 1 -- 172.21.15.72:0/1707979599 learned_addr learned my addr 172.21.15.72:0/1707979599 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 0x7efca415bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51712/0 (socket says 172.21.15.72:51712) 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca8ccd640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca41492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 -- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 msgr2=0x7efca41492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca41492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 -- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 msgr2=0x7efca4160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 0x7efca4160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 -- 172.21.15.72:0/1707979599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c009a70 con 0x7efca415e240 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca94ce640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 0x7efca4160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efca9ccf640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 0x7efca415bbe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc9c033000 tx=0x7efc9c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02cea0 con 0x7efca415e240 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc9c040650 con 0x7efca415e240 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca40c9b60 con 0x7efca415e240 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc9c040a00 con 0x7efca415e240 2024-03-24T10:36:56.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.543+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca40ca120 con 0x7efca415e240 2024-03-24T10:36:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.544+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca404f470 con 0x7efca415e240 2024-03-24T10:36:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.545+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efc9c040b60 con 0x7efca415e240 2024-03-24T10:36:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.545+0000 7efc99ffb640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc8806b810 0x7efc8806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.545+0000 7efca94ce640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc8806b810 0x7efc8806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.545+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc9c0ace50 con 0x7efca415e240 2024-03-24T10:36:56.548 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.546+0000 7efca94ce640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc8806b810 0x7efc8806dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc94005880 tx=0x7efc94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.550+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efc9c077670 con 0x7efca415e240 2024-03-24T10:36:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.721+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7efca40d1350 con 0x7efca415e240 2024-03-24T10:36:56.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.722+0000 7efc99ffb640 1 -- 172.21.15.72:0/1707979599 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7efc9c009450 con 0x7efca415e240 2024-03-24T10:36:56.722 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:36:56.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc8806b810 msgr2=0x7efc8806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc8806b810 0x7efc8806dcd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efc94005880 tx=0x7efc94009040 comp rx=0 tx=0).stop 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 msgr2=0x7efca415bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 0x7efca415bbe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efc9c033000 tx=0x7efc9c004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 shutdown_connections 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efc8806b810 0x7efc8806dcd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efca415e240 0x7efca415bbe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efca40d2b20 0x7efca41492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 --2- 172.21.15.72:0/1707979599 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca40d0f70 0x7efca4160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 >> 172.21.15.72:0/1707979599 conn(0x7efca40d3e30 msgr2=0x7efca406cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 shutdown_connections 2024-03-24T10:36:56.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.724+0000 7efcab732640 1 -- 172.21.15.72:0/1707979599 wait complete. 2024-03-24T10:36:56.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:36:56.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.836+0000 7fc30795e640 1 Processor -- start 2024-03-24T10:36:56.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.837+0000 7fc30795e640 1 -- start start 2024-03-24T10:36:56.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.837+0000 7fc30795e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fc30006ecb0 0x7fc3000b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.837+0000 7fc30795e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3000b30f0 con 0x7fc30006e8d0 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.837+0000 7fc30795e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3000b33d0 con 0x7fc30015f440 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.837+0000 7fc30795e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fc3000b48a0 con 0x7fc30006ecb0 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc3056fa640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc30006e8d0 0x7fc3000b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37782/0 (socket says 172.21.15.72:37782) 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc3056fa640 1 -- 172.21.15.72:0/2345170882 learned_addr learned my addr 172.21.15.72:0/2345170882 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc304ef9640 1 --2- 172.21.15.72:0/2345170882 >> v2:172.21.15.79:3300/0 conn(0x7fc30006ecb0 0x7fc3000b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc2f7fff640 1 -- 172.21.15.72:0/2345170882 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249537500 0 0) 0x7fc3000b30f0 con 0x7fc30006e8d0 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc2f7fff640 1 -- 172.21.15.72:0/2345170882 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2ec003520 con 0x7fc30006e8d0 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc304ef9640 1 -- 172.21.15.72:0/2345170882 >> v1:172.21.15.79:6789/0 conn(0x7fc30015f440 legacy=0x7fc300144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc304ef9640 1 -- 172.21.15.72:0/2345170882 >> v1:172.21.15.72:6789/0 conn(0x7fc30006e8d0 legacy=0x7fc3000b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.838+0000 7fc304ef9640 1 -- 172.21.15.72:0/2345170882 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3000b36b0 con 0x7fc30006ecb0 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc304ef9640 1 --2- 172.21.15.72:0/2345170882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc3000b2b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00097d0 tx=0x7fc2f002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77ca590aac10214d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc2f7fff640 1 -- 172.21.15.72:0/2345170882 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0030610 con 0x7fc30006ecb0 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc2f7fff640 1 -- 172.21.15.72:0/2345170882 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f0030770 con 0x7fc30006ecb0 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc2f7fff640 1 -- 172.21.15.72:0/2345170882 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0030b00 con 0x7fc30006ecb0 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc30795e640 1 -- 172.21.15.72:0/2345170882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 msgr2=0x7fc3000b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc30795e640 1 --2- 172.21.15.72:0/2345170882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc3000b2b10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00097d0 tx=0x7fc2f002b960 comp rx=0 tx=0).stop 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc30795e640 1 -- 172.21.15.72:0/2345170882 shutdown_connections 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc30795e640 1 --2- 172.21.15.72:0/2345170882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc3000b2b10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc30795e640 1 -- 172.21.15.72:0/2345170882 >> 172.21.15.72:0/2345170882 conn(0x7fc3000b1810 msgr2=0x7fc3000b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:56.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.839+0000 7fc30795e640 1 -- 172.21.15.72:0/2345170882 shutdown_connections 2024-03-24T10:36:56.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.840+0000 7fc30795e640 1 -- 172.21.15.72:0/2345170882 wait complete. 2024-03-24T10:36:56.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 Processor -- start 2024-03-24T10:36:56.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 -- start start 2024-03-24T10:36:56.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 0x7fc3000abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc300141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc30015f440 0x7fc300142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc3000b0e70 con 0x7fc30006e8d0 2024-03-24T10:36:56.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc3000af440 con 0x7fc30006ecb0 2024-03-24T10:36:56.844 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc30795e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc3000ae5e0 con 0x7fc30015f440 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc3056fa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 0x7fc3000abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc3056fa640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 0x7fc3000abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51726/0 (socket says 172.21.15.72:51726) 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc3056fa640 1 -- 172.21.15.72:0/3450540208 learned_addr learned my addr 172.21.15.72:0/3450540208 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.841+0000 7fc304ef9640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc300141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc305efb640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc30015f440 0x7fc300142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc3056fa640 1 -- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc30015f440 msgr2=0x7fc300142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc3056fa640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc30015f440 0x7fc300142290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc3056fa640 1 -- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 msgr2=0x7fc300141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc3056fa640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc300141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc3056fa640 1 -- 172.21.15.72:0/3450540208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f0009400 con 0x7fc30006e8d0 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc3056fa640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 0x7fc3000abe30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c530 tx=0x7fc2f800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8005ce0 con 0x7fc30006e8d0 2024-03-24T10:36:56.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8005e40 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3000ae8c0 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f80072b0 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.842+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3000aee80 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.843+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30004f470 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.843+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc2f8007410 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.844+0000 7fc2f5ffb640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc2e406b810 0x7fc2e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.844+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2f8089aa0 con 0x7fc30006e8d0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.844+0000 7fc304ef9640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc2e406b810 0x7fc2e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:56.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.844+0000 7fc304ef9640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc2e406b810 0x7fc2e406dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0036000 tx=0x7fc2f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:56.849 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:56.848+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc2f80542f0 con 0x7fc30006e8d0 2024-03-24T10:36:57.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.018+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc30006d240 con 0x7fc30006e8d0 2024-03-24T10:36:57.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.019+0000 7fc2f5ffb640 1 -- 172.21.15.72:0/3450540208 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fc2f80170a0 con 0x7fc30006e8d0 2024-03-24T10:36:57.019 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:57.021 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc2e406b810 msgr2=0x7fc2e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc2e406b810 0x7fc2e406dcd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0036000 tx=0x7fc2f0008030 comp rx=0 tx=0).stop 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 msgr2=0x7fc3000abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 0x7fc3000abe30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c530 tx=0x7fc2f800c9f0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 shutdown_connections 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc2e406b810 0x7fc2e406dcd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc30015f440 0x7fc300142290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc30006ecb0 0x7fc300141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 --2- 172.21.15.72:0/3450540208 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc30006e8d0 0x7fc3000abe30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 >> 172.21.15.72:0/3450540208 conn(0x7fc3000b1810 msgr2=0x7fc3000af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 shutdown_connections 2024-03-24T10:36:57.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.021+0000 7fc30795e640 1 -- 172.21.15.72:0/3450540208 wait complete. 2024-03-24T10:36:57.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:36:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.134+0000 7fc82e8d4640 1 Processor -- start 2024-03-24T10:36:57.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.134+0000 7fc82e8d4640 1 -- start start 2024-03-24T10:36:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82e8d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc828142490 0x7fc8280b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82e8d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8280b2b10 0x7fc8280cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82e8d4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8280b2f50 con 0x7fc8280ce1b0 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82e8d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc8280b3210 con 0x7fc8280b2b10 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82e8d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc8280b34f0 con 0x7fc828142490 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc8277fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc8280b2b10 0x7fc8280cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82ce71640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc8280ce1b0 0x7fc8280ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37790/0 (socket says 172.21.15.72:37790) 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc82ce71640 1 -- 172.21.15.72:0/3100650109 learned_addr learned my addr 172.21.15.72:0/3100650109 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc827fff640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc828142490 0x7fc8280b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc8277fe640 1 -- 172.21.15.72:0/3100650109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc828142490 msgr2=0x7fc8280b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc8277fe640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc828142490 0x7fc8280b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc8277fe640 1 -- 172.21.15.72:0/3100650109 >> v1:172.21.15.72:6789/0 conn(0x7fc8280ce1b0 legacy=0x7fc8280ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.135+0000 7fc826ffd640 1 -- 172.21.15.72:0/3100650109 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468770806 0 0) 0x7fc8280b2f50 con 0x7fc8280ce1b0 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc8277fe640 1 -- 172.21.15.72:0/3100650109 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8280b37d0 con 0x7fc8280b2b10 2024-03-24T10:36:57.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc827fff640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc828142490 0x7fc8280b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:57.138 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc8277fe640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280b2b10 0x7fc8280cf110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0097a0 tx=0x7fc81c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397b833bd1dc619b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc826ffd640 1 -- 172.21.15.72:0/3100650109 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c02e070 con 0x7fc8280b2b10 2024-03-24T10:36:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc826ffd640 1 -- 172.21.15.72:0/3100650109 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c0315a0 con 0x7fc8280b2b10 2024-03-24T10:36:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.136+0000 7fc826ffd640 1 -- 172.21.15.72:0/3100650109 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c031930 con 0x7fc8280b2b10 2024-03-24T10:36:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 -- 172.21.15.72:0/3100650109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280b2b10 msgr2=0x7fc8280cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.142 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280b2b10 0x7fc8280cf110 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc81c0097a0 tx=0x7fc81c02b840 comp rx=0 tx=0).stop 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 -- 172.21.15.72:0/3100650109 shutdown_connections 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280b2b10 0x7fc8280cf110 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/3100650109 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc828142490 0x7fc8280b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 -- 172.21.15.72:0/3100650109 >> 172.21.15.72:0/3100650109 conn(0x7fc8280b1810 msgr2=0x7fc8280b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 -- 172.21.15.72:0/3100650109 shutdown_connections 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.137+0000 7fc82e8d4640 1 -- 172.21.15.72:0/3100650109 wait complete. 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.138+0000 7fc82e8d4640 1 Processor -- start 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.138+0000 7fc82e8d4640 1 -- start start 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82e8d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8280b2b10 0x7fc828139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82e8d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 0x7fc82813acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82e8d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828142490 0x7fc828157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82e8d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc82815c6b0 con 0x7fc8280ce1b0 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82e8d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc82815f2c0 con 0x7fc828142490 2024-03-24T10:36:57.143 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82e8d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc82815c900 con 0x7fc8280b2b10 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 0x7fc82813acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 0x7fc82813acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51734/0 (socket says 172.21.15.72:51734) 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 -- 172.21.15.72:0/99933986 learned_addr learned my addr 172.21.15.72:0/99933986 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc82ce71640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828142490 0x7fc828157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc827fff640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8280b2b10 0x7fc828139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 -- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8280b2b10 msgr2=0x7fc828139370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8280b2b10 0x7fc828139370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 -- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828142490 msgr2=0x7fc828157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828142490 0x7fc828157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 -- 172.21.15.72:0/99933986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc818009400 con 0x7fc8280ce1b0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.139+0000 7fc8277fe640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 0x7fc82813acb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc81c034040 tx=0x7fc81c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.140+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c032840 con 0x7fc8280ce1b0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.140+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81c031f00 con 0x7fc8280ce1b0 2024-03-24T10:36:57.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.140+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81c009400 con 0x7fc8280ce1b0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.140+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c032be0 con 0x7fc8280ce1b0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.140+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82815cec0 con 0x7fc8280ce1b0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.141+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82804f470 con 0x7fc8280ce1b0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.141+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc81c032d40 con 0x7fc8280ce1b0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.141+0000 7fc824ff9640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc81406b810 0x7fc81406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.141+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc81c0ac370 con 0x7fc8280ce1b0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.141+0000 7fc827fff640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc81406b810 0x7fc81406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.145 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.142+0000 7fc827fff640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc81406b810 0x7fc81406dcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc818009cd0 tx=0x7fc818009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.146 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.146+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc81c076b00 con 0x7fc8280ce1b0 2024-03-24T10:36:57.319 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.318+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc8280ccc70 con 0x7fc8280ce1b0 2024-03-24T10:36:57.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.321+0000 7fc824ff9640 1 -- 172.21.15.72:0/99933986 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fc81c07a1c0 con 0x7fc8280ce1b0 2024-03-24T10:36:57.321 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:36:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc81406b810 msgr2=0x7fc81406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc81406b810 0x7fc81406dcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc818009cd0 tx=0x7fc818009190 comp rx=0 tx=0).stop 2024-03-24T10:36:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 msgr2=0x7fc82813acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 0x7fc82813acb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc81c034040 tx=0x7fc81c0046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 shutdown_connections 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc81406b810 0x7fc81406dcd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc828142490 0x7fc828157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc8280ce1b0 0x7fc82813acb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 --2- 172.21.15.72:0/99933986 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc8280b2b10 0x7fc828139370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.322+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 >> 172.21.15.72:0/99933986 conn(0x7fc8280b1810 msgr2=0x7fc82806d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.323+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 shutdown_connections 2024-03-24T10:36:57.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.323+0000 7fc82e8d4640 1 -- 172.21.15.72:0/99933986 wait complete. 2024-03-24T10:36:57.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:36:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.436+0000 7ff65eb3e640 1 Processor -- start 2024-03-24T10:36:57.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.436+0000 7ff65eb3e640 1 -- start start 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65eb3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff658072470 0x7ff6580cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65eb3e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff65815b480 0x7ff65806d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65eb3e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff658154ea0 con 0x7ff6580b3580 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65eb3e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff658071460 con 0x7ff65815b480 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65eb3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff658071fe0 con 0x7ff658072470 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff65815b480 0x7ff65806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff65815b480 0x7ff65806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51746/0 (socket says 172.21.15.72:51746) 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 -- 172.21.15.72:0/3716571238 learned_addr learned my addr 172.21.15.72:0/3716571238 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff657fff640 1 --2- 172.21.15.72:0/3716571238 >> v2:172.21.15.79:3300/0 conn(0x7ff658072470 0x7ff6580cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 -- 172.21.15.72:0/3716571238 >> v2:172.21.15.79:3300/0 conn(0x7ff658072470 msgr2=0x7ff6580cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 --2- 172.21.15.72:0/3716571238 >> v2:172.21.15.79:3300/0 conn(0x7ff658072470 0x7ff6580cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 -- 172.21.15.72:0/3716571238 >> v1:172.21.15.79:6789/0 conn(0x7ff6580b3580 legacy=0x7ff6580b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.437+0000 7ff65d0db640 1 -- 172.21.15.72:0/3716571238 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65815b910 con 0x7ff65815b480 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65d0db640 1 --2- 172.21.15.72:0/3716571238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65815b480 0x7ff65806d550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6580b4eb0 tx=0x7ff65002e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe66efea369fbae server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff6577fe640 1 -- 172.21.15.72:0/3716571238 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65002eea0 con 0x7ff65815b480 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff6577fe640 1 -- 172.21.15.72:0/3716571238 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff650032070 con 0x7ff65815b480 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff6577fe640 1 -- 172.21.15.72:0/3716571238 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff650038620 con 0x7ff65815b480 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 -- 172.21.15.72:0/3716571238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65815b480 msgr2=0x7ff65806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/3716571238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65815b480 0x7ff65806d550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff6580b4eb0 tx=0x7ff65002e0f0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 -- 172.21.15.72:0/3716571238 shutdown_connections 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/3716571238 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff65815b480 0x7ff65806d550 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/3716571238 >> v2:172.21.15.79:3300/0 conn(0x7ff658072470 0x7ff6580cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 -- 172.21.15.72:0/3716571238 >> 172.21.15.72:0/3716571238 conn(0x7ff6580b1810 msgr2=0x7ff6580b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 -- 172.21.15.72:0/3716571238 shutdown_connections 2024-03-24T10:36:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.438+0000 7ff65eb3e640 1 -- 172.21.15.72:0/3716571238 wait complete. 2024-03-24T10:36:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 Processor -- start 2024-03-24T10:36:57.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 -- start start 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff658072470 0x7ff658145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 0x7ff6581e4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff65815b480 0x7ff6581e4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff658155b70 con 0x7ff6580b3580 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6580cb9a0 con 0x7ff658072470 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.440+0000 7ff65eb3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff6581560c0 con 0x7ff65815b480 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 0x7ff6581e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 0x7ff6581e4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51762/0 (socket says 172.21.15.72:51762) 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 -- 172.21.15.72:0/989015571 learned_addr learned my addr 172.21.15.72:0/989015571 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff65c8da640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff658072470 0x7ff658145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.443 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff65d0db640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff65815b480 0x7ff6581e4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 -- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff65815b480 msgr2=0x7ff6581e4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff65815b480 0x7ff6581e4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 -- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff658072470 msgr2=0x7ff658145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff658072470 0x7ff658145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 -- 172.21.15.72:0/989015571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65000bd40 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff657fff640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 0x7ff6581e4820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e840 tx=0x7ff64400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6440094f0 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff64400c940 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6581463d0 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64400ccd0 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.441+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6581e5670 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.442+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff658068120 con 0x7ff6580b3580 2024-03-24T10:36:57.444 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.443+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff644013470 con 0x7ff6580b3580 2024-03-24T10:36:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.443+0000 7ff6557fa640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff63c06b810 0x7ff63c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.443+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff64408a540 con 0x7ff6580b3580 2024-03-24T10:36:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.443+0000 7ff65c8da640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff63c06b810 0x7ff63c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.445 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.443+0000 7ff65c8da640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff63c06b810 0x7ff63c06dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0016e0 tx=0x7ff64c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.447+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff644054cd0 con 0x7ff6580b3580 2024-03-24T10:36:57.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.617+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7ff65804f470 con 0x7ff6580b3580 2024-03-24T10:36:57.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.618+0000 7ff6557fa640 1 -- 172.21.15.72:0/989015571 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7ff644058390 con 0x7ff6580b3580 2024-03-24T10:36:57.618 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:36:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.619+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff63c06b810 msgr2=0x7ff63c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.619+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff63c06b810 0x7ff63c06dcd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff64c0016e0 tx=0x7ff64c009040 comp rx=0 tx=0).stop 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 msgr2=0x7ff6581e4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 0x7ff6581e4820 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff64400e840 tx=0x7ff64400ed00 comp rx=0 tx=0).stop 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 shutdown_connections 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff63c06b810 0x7ff63c06dcd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff65815b480 0x7ff6581e4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff6580b3580 0x7ff6581e4820 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 --2- 172.21.15.72:0/989015571 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff658072470 0x7ff658145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 >> 172.21.15.72:0/989015571 conn(0x7ff6580b1810 msgr2=0x7ff65815bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 shutdown_connections 2024-03-24T10:36:57.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.620+0000 7ff65eb3e640 1 -- 172.21.15.72:0/989015571 wait complete. 2024-03-24T10:36:57.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:57.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.730+0000 7f28f23d7640 1 Processor -- start 2024-03-24T10:36:57.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.730+0000 7f28f23d7640 1 -- start start 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f23d7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec15c110 0x7f28ec0cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f23d7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28ec06f010 0x7f28ec0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f23d7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28ec0cfb70 con 0x7f28ec06f430 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f23d7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f28ec0cfe50 con 0x7f28ec06f010 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f23d7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec0d0130 con 0x7f28ec15c110 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28eb7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f28ec06f010 0x7f28ec0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f0974640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f28ec06f430 0x7f28ec0cd340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:39560/0 (socket says 172.21.15.72:39560) 2024-03-24T10:36:57.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28f0974640 1 -- 172.21.15.72:0/1895186223 learned_addr learned my addr 172.21.15.72:0/1895186223 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.731+0000 7f28ebfff640 1 --2- 172.21.15.72:0/1895186223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec15c110 0x7f28ec0cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.732+0000 7f28eaffd640 1 -- 172.21.15.72:0/1895186223 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451652182 0 0) 0x7f28ec0cfb70 con 0x7f28ec06f430 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.732+0000 7f28ebfff640 1 -- 172.21.15.72:0/1895186223 >> v2:172.21.15.72:3300/0 conn(0x7f28ec06f010 msgr2=0x7f28ec0d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.732+0000 7f28ebfff640 1 --2- 172.21.15.72:0/1895186223 >> v2:172.21.15.72:3300/0 conn(0x7f28ec06f010 0x7f28ec0d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.732+0000 7f28ebfff640 1 -- 172.21.15.72:0/1895186223 >> v1:172.21.15.79:6789/0 conn(0x7f28ec06f430 legacy=0x7f28ec0cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.732+0000 7f28ebfff640 1 -- 172.21.15.72:0/1895186223 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec0ccb40 con 0x7f28ec15c110 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.732+0000 7f28ebfff640 1 --2- 172.21.15.72:0/1895186223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec15c110 0x7f28ec0cf0e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0097a0 tx=0x7f28dc02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c854de41564e0df server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28eaffd640 1 -- 172.21.15.72:0/1895186223 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc030610 con 0x7f28ec15c110 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28eaffd640 1 -- 172.21.15.72:0/1895186223 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28dc030770 con 0x7f28ec15c110 2024-03-24T10:36:57.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28eaffd640 1 -- 172.21.15.72:0/1895186223 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28dc030b00 con 0x7f28ec15c110 2024-03-24T10:36:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 -- 172.21.15.72:0/1895186223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec15c110 msgr2=0x7f28ec0cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 --2- 172.21.15.72:0/1895186223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec15c110 0x7f28ec0cf0e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0097a0 tx=0x7f28dc02b960 comp rx=0 tx=0).stop 2024-03-24T10:36:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 -- 172.21.15.72:0/1895186223 shutdown_connections 2024-03-24T10:36:57.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 --2- 172.21.15.72:0/1895186223 >> v2:172.21.15.72:3300/0 conn(0x7f28ec06f010 0x7f28ec0d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 --2- 172.21.15.72:0/1895186223 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec15c110 0x7f28ec0cf0e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 -- 172.21.15.72:0/1895186223 >> 172.21.15.72:0/1895186223 conn(0x7f28ec0b3930 msgr2=0x7f28ec0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 -- 172.21.15.72:0/1895186223 shutdown_connections 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.733+0000 7f28f23d7640 1 -- 172.21.15.72:0/1895186223 wait complete. 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.734+0000 7f28f23d7640 1 Processor -- start 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 -- start start 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec06f010 0x7f28ec157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 0x7f28ec0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ec15c110 0x7f28ec0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec0b6440 con 0x7f28ec06f430 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec0b6720 con 0x7f28ec15c110 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f23d7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f28ec0b6a00 con 0x7f28ec06f010 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28eb7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 0x7f28ec0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28eb7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 0x7f28ec0b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51780/0 (socket says 172.21.15.72:51780) 2024-03-24T10:36:57.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28eb7fe640 1 -- 172.21.15.72:0/2348165719 learned_addr learned my addr 172.21.15.72:0/2348165719 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:57.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28ebfff640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec06f010 0x7f28ec157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.735+0000 7f28f0974640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ec15c110 0x7f28ec0b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.741 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28eb7fe640 1 -- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec06f010 msgr2=0x7f28ec157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28eb7fe640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec06f010 0x7f28ec157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28eb7fe640 1 -- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ec15c110 msgr2=0x7f28ec0b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28eb7fe640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ec15c110 0x7f28ec0b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28eb7fe640 1 -- 172.21.15.72:0/2348165719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc009400 con 0x7f28ec06f430 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28eb7fe640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 0x7f28ec0b29e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e9b0 tx=0x7f28e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0009670 con 0x7f28ec06f430 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e000c9a0 con 0x7f28ec06f430 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec0b6ce0 con 0x7f28ec06f430 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e000cd50 con 0x7f28ec06f430 2024-03-24T10:36:57.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.736+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec0b74e0 con 0x7f28ec06f430 2024-03-24T10:36:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.737+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ec09ff20 con 0x7f28ec06f430 2024-03-24T10:36:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.738+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f28e0013470 con 0x7f28ec06f430 2024-03-24T10:36:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.738+0000 7f28e8ff9640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f28d806b810 0x7f28d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.738+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f28e008a680 con 0x7f28ec06f430 2024-03-24T10:36:57.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.738+0000 7f28ebfff640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f28d806b810 0x7f28d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.738+0000 7f28ebfff640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f28d806b810 0x7f28d806dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28dc036000 tx=0x7f28dc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:57.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.742+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f28e0054e10 con 0x7f28ec06f430 2024-03-24T10:36:57.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.949+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f28ec0ce2a0 con 0x7f28ec06f430 2024-03-24T10:36:57.949 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.949+0000 7f28e8ff9640 1 -- 172.21.15.72:0/2348165719 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f28e00584d0 con 0x7f28ec06f430 2024-03-24T10:36:57.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:57.950 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:36:57.950 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f28d806b810 msgr2=0x7f28d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f28d806b810 0x7f28d806dcd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f28dc036000 tx=0x7f28dc008030 comp rx=0 tx=0).stop 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 msgr2=0x7f28ec0b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 0x7f28ec0b29e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e9b0 tx=0x7f28e000ee70 comp rx=0 tx=0).stop 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 shutdown_connections 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f28d806b810 0x7f28d806dcd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.952 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28ec15c110 0x7f28ec0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f28ec06f430 0x7f28ec0b29e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 --2- 172.21.15.72:0/2348165719 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f28ec06f010 0x7f28ec157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:57.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 >> 172.21.15.72:0/2348165719 conn(0x7f28ec0b3930 msgr2=0x7f28ec068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:57.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 shutdown_connections 2024-03-24T10:36:57.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:57.951+0000 7f28f23d7640 1 -- 172.21.15.72:0/2348165719 wait complete. 2024-03-24T10:36:57.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:36:58.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.061+0000 7f1a6956c640 1 Processor -- start 2024-03-24T10:36:58.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.061+0000 7f1a6956c640 1 -- start start 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a6956c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a6415e640 0x7f1a640b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a6956c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1a640cfe70 0x7f1a640d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a6956c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a640d0830 0x7f1a640ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a6956c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1a640b3690 con 0x7f1a640d0830 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a6956c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1a6406c6e0 con 0x7f1a640cfe70 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a6956c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1a640b30d0 con 0x7f1a6415e640 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a637fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a640d0830 0x7f1a640ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a62ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a6415e640 0x7f1a640b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a637fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a640d0830 0x7f1a640ce5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51788/0 (socket says 172.21.15.72:51788) 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a637fe640 1 -- 172.21.15.72:0/3038110280 learned_addr learned my addr 172.21.15.72:0/3038110280 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.062+0000 7f1a627fc640 1 --2- 172.21.15.72:0/3038110280 >> v2:172.21.15.79:3300/0 conn(0x7f1a640cfe70 0x7f1a640d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.063+0000 7f1a62ffd640 1 -- 172.21.15.72:0/3038110280 >> v2:172.21.15.79:3300/0 conn(0x7f1a640cfe70 msgr2=0x7f1a640d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.063+0000 7f1a62ffd640 1 --2- 172.21.15.72:0/3038110280 >> v2:172.21.15.79:3300/0 conn(0x7f1a640cfe70 0x7f1a640d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.063+0000 7f1a62ffd640 1 -- 172.21.15.72:0/3038110280 >> v2:172.21.15.72:3300/0 conn(0x7f1a640d0830 msgr2=0x7f1a640ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.063+0000 7f1a62ffd640 1 --2- 172.21.15.72:0/3038110280 >> v2:172.21.15.72:3300/0 conn(0x7f1a640d0830 0x7f1a640ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.063+0000 7f1a62ffd640 1 -- 172.21.15.72:0/3038110280 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a640b33b0 con 0x7f1a6415e640 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.063+0000 7f1a62ffd640 1 --2- 172.21.15.72:0/3038110280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a6415e640 0x7f1a640b2a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a64072540 tx=0x7f1a5402bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf0ff39b6447ce9f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a61ffb640 1 -- 172.21.15.72:0/3038110280 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5402cab0 con 0x7f1a6415e640 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a61ffb640 1 -- 172.21.15.72:0/3038110280 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5402cc10 con 0x7f1a6415e640 2024-03-24T10:36:58.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a61ffb640 1 -- 172.21.15.72:0/3038110280 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54034440 con 0x7f1a6415e640 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 -- 172.21.15.72:0/3038110280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a6415e640 msgr2=0x7f1a640b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 --2- 172.21.15.72:0/3038110280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a6415e640 0x7f1a640b2a70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a64072540 tx=0x7f1a5402bd00 comp rx=0 tx=0).stop 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 -- 172.21.15.72:0/3038110280 shutdown_connections 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 --2- 172.21.15.72:0/3038110280 >> v2:172.21.15.72:3300/0 conn(0x7f1a640d0830 0x7f1a640ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 --2- 172.21.15.72:0/3038110280 >> v2:172.21.15.79:3300/0 conn(0x7f1a640cfe70 0x7f1a640d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 --2- 172.21.15.72:0/3038110280 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a6415e640 0x7f1a640b2a70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 -- 172.21.15.72:0/3038110280 >> 172.21.15.72:0/3038110280 conn(0x7f1a640d1d50 msgr2=0x7f1a640d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 -- 172.21.15.72:0/3038110280 shutdown_connections 2024-03-24T10:36:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.064+0000 7f1a6956c640 1 -- 172.21.15.72:0/3038110280 wait complete. 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.065+0000 7f1a6956c640 1 Processor -- start 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.065+0000 7f1a6956c640 1 -- start start 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a6956c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a640cfe70 0x7f1a6414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a6956c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 0x7f1a640c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a6956c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a6415e640 0x7f1a640cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a6956c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640c9480 con 0x7f1a640d0830 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a6956c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a640cbd10 con 0x7f1a6415e640 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a6956c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1a640c8ec0 con 0x7f1a640cfe70 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 0x7f1a640c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 0x7f1a640c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51792/0 (socket says 172.21.15.72:51792) 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 -- 172.21.15.72:0/965961091 learned_addr learned my addr 172.21.15.72:0/965961091 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a62ffd640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a640cfe70 0x7f1a6414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a637fe640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a6415e640 0x7f1a640cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 -- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a640cfe70 msgr2=0x7f1a6414bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a640cfe70 0x7f1a6414bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 -- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a6415e640 msgr2=0x7f1a640cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a6415e640 0x7f1a640cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a627fc640 1 -- 172.21.15.72:0/965961091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a54009a70 con 0x7f1a640d0830 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.066+0000 7f1a637fe640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a6415e640 0x7f1a640cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.067+0000 7f1a627fc640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 0x7f1a640c58b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800e890 tx=0x7f1a5800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.067+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800c940 con 0x7f1a640d0830 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.067+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5800caa0 con 0x7f1a640d0830 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.067+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a640c91a0 con 0x7f1a640d0830 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.067+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800ce30 con 0x7f1a640d0830 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.067+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a640c86c0 con 0x7f1a640d0830 2024-03-24T10:36:58.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.068+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a640b7b10 con 0x7f1a640d0830 2024-03-24T10:36:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.068+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1a58013470 con 0x7f1a640d0830 2024-03-24T10:36:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.068+0000 7f1a4b7fe640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1a5006b810 0x7f1a5006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.069+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a5808a710 con 0x7f1a640d0830 2024-03-24T10:36:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.069+0000 7f1a62ffd640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1a5006b810 0x7f1a5006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.069+0000 7f1a62ffd640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1a5006b810 0x7f1a5006dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a54036000 tx=0x7f1a54030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:58.073 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.073+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1a58054d90 con 0x7f1a640d0830 2024-03-24T10:36:58.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.249+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a6409fe20 con 0x7f1a640d0830 2024-03-24T10:36:58.250 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.250+0000 7f1a4b7fe640 1 -- 172.21.15.72:0/965961091 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18478 (secure 0 0 0) 0x7f1a58058450 con 0x7f1a640d0830 2024-03-24T10:36:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:58.251 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:36:30.594049+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:36:58.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1a5006b810 msgr2=0x7f1a5006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1a5006b810 0x7f1a5006dcd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a54036000 tx=0x7f1a54030000 comp rx=0 tx=0).stop 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 msgr2=0x7f1a640c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 0x7f1a640c58b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a5800e890 tx=0x7f1a5800ed50 comp rx=0 tx=0).stop 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 shutdown_connections 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1a5006b810 0x7f1a5006dcd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a6415e640 0x7f1a640cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a640d0830 0x7f1a640c58b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 --2- 172.21.15.72:0/965961091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1a640cfe70 0x7f1a6414bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 >> 172.21.15.72:0/965961091 conn(0x7f1a640d1d50 msgr2=0x7f1a640cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 shutdown_connections 2024-03-24T10:36:58.253 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.252+0000 7f1a6956c640 1 -- 172.21.15.72:0/965961091 wait complete. 2024-03-24T10:36:58.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:36:58.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.364+0000 7fbacf99a640 1 Processor -- start 2024-03-24T10:36:58.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.364+0000 7fbacf99a640 1 -- start start 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbacf99a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbacf99a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac815eea0 con 0x7fbac80ae790 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbacf99a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbac815f180 con 0x7fbac806b840 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbacf99a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbac80b45b0 con 0x7fbac8158a20 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbaccf35640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbac80ae790 0x7fbac806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37798/0 (socket says 172.21.15.72:37798) 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbaccf35640 1 -- 172.21.15.72:0/1293182000 learned_addr learned my addr 172.21.15.72:0/1293182000 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.365+0000 7fbacd736640 1 --2- 172.21.15.72:0/1293182000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.366+0000 7fbabffff640 1 -- 172.21.15.72:0/1293182000 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632835023 0 0) 0x7fbac815eea0 con 0x7fbac80ae790 2024-03-24T10:36:58.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.366+0000 7fbacd736640 1 -- 172.21.15.72:0/1293182000 >> v1:172.21.15.79:6789/0 conn(0x7fbac806b840 legacy=0x7fbac80b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.366+0000 7fbacd736640 1 -- 172.21.15.72:0/1293182000 >> v1:172.21.15.72:6789/0 conn(0x7fbac80ae790 legacy=0x7fbac806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.366+0000 7fbacd736640 1 -- 172.21.15.72:0/1293182000 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac815f460 con 0x7fbac8158a20 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.366+0000 7fbacd736640 1 --2- 172.21.15.72:0/1293182000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac815e8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009750 tx=0x7fbac402b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4e29144b9d81a46 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.366+0000 7fbabffff640 1 -- 172.21.15.72:0/1293182000 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4030710 con 0x7fbac8158a20 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbabffff640 1 -- 172.21.15.72:0/1293182000 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac402e050 con 0x7fbac8158a20 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbabffff640 1 -- 172.21.15.72:0/1293182000 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4030a90 con 0x7fbac8158a20 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 -- 172.21.15.72:0/1293182000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 msgr2=0x7fbac815e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 --2- 172.21.15.72:0/1293182000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac815e8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009750 tx=0x7fbac402b730 comp rx=0 tx=0).stop 2024-03-24T10:36:58.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 -- 172.21.15.72:0/1293182000 shutdown_connections 2024-03-24T10:36:58.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 --2- 172.21.15.72:0/1293182000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac815e8c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 -- 172.21.15.72:0/1293182000 >> 172.21.15.72:0/1293182000 conn(0x7fbac80b29c0 msgr2=0x7fbac80b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:58.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 -- 172.21.15.72:0/1293182000 shutdown_connections 2024-03-24T10:36:58.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.367+0000 7fbacf99a640 1 -- 172.21.15.72:0/1293182000 wait complete. 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.368+0000 7fbacf99a640 1 Processor -- start 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.368+0000 7fbacf99a640 1 -- start start 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacf99a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 0x7fbac8151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacf99a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbac80ae790 0x7fbac815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacf99a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac8160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacf99a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbac8154010 con 0x7fbac806b840 2024-03-24T10:36:58.371 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacf99a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbac8151e70 con 0x7fbac80ae790 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacf99a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbac81530b0 con 0x7fbac8158a20 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 0x7fbac8151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 0x7fbac8151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51800/0 (socket says 172.21.15.72:51800) 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 -- 172.21.15.72:0/3124929976 learned_addr learned my addr 172.21.15.72:0/3124929976 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacdf37640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac8160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbaccf35640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbac80ae790 0x7fbac815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 -- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 msgr2=0x7fbac8160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac8160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 -- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbac80ae790 msgr2=0x7fbac815ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbac80ae790 0x7fbac815ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.369+0000 7fbacd736640 1 -- 172.21.15.72:0/3124929976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac4009400 con 0x7fbac806b840 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.370+0000 7fbacd736640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 0x7fbac8151930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009870 tx=0x7fbac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:58.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.370+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4032950 con 0x7fbac806b840 2024-03-24T10:36:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.370+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac4032ab0 con 0x7fbac806b840 2024-03-24T10:36:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.370+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac8153390 con 0x7fbac806b840 2024-03-24T10:36:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.370+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4032e60 con 0x7fbac806b840 2024-03-24T10:36:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.370+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac8153950 con 0x7fbac806b840 2024-03-24T10:36:58.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.371+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac809f090 con 0x7fbac806b840 2024-03-24T10:36:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.371+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbac4039040 con 0x7fbac806b840 2024-03-24T10:36:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.372+0000 7fbabdffb640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbaac06b810 0x7fbaac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.372+0000 7fbaccf35640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbaac06b810 0x7fbaac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.372+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbac40ac080 con 0x7fbac806b840 2024-03-24T10:36:58.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.372+0000 7fbaccf35640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbaac06b810 0x7fbaac06dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007f70 tx=0x7fbab8007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:58.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.376+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbac4076820 con 0x7fbac806b840 2024-03-24T10:36:58.585 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.585+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbac80d0a70 con 0x7fbac806b840 2024-03-24T10:36:58.586 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.585+0000 7fbabdffb640 1 -- 172.21.15.72:0/3124929976 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7fbac4079ee0 con 0x7fbac806b840 2024-03-24T10:36:58.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:36:58.586 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:36:58.587 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:36:58.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.587+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbaac06b810 msgr2=0x7fbaac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.587+0000 7fbacf99a640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbaac06b810 0x7fbaac06dcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbab8007f70 tx=0x7fbab8007f00 comp rx=0 tx=0).stop 2024-03-24T10:36:58.588 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 msgr2=0x7fbac8151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 0x7fbac8151930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009870 tx=0x7fbac40046c0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 shutdown_connections 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbaac06b810 0x7fbaac06dcd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbac8158a20 0x7fbac8160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbac80ae790 0x7fbac815ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 --2- 172.21.15.72:0/3124929976 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbac806b840 0x7fbac8151930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 >> 172.21.15.72:0/3124929976 conn(0x7fbac80b29c0 msgr2=0x7fbac80d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 shutdown_connections 2024-03-24T10:36:58.589 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:58.588+0000 7fbacf99a640 1 -- 172.21.15.72:0/3124929976 wait complete. 2024-03-24T10:36:59.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-24T10:36:25.553252+0000', 'modified': '2024-03-24T10:36:47.629880+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6835/68214934', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6833', 'nonce': 68214934}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 68214934}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4288, 'qdb_cluster': [4288]} 2024-03-24T10:36:59.002 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-24T10:36:59.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-24T10:36:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.105+0000 7efc044f1640 1 Processor -- start 2024-03-24T10:36:59.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.105+0000 7efc044f1640 1 -- start start 2024-03-24T10:36:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc044f1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc15aee0 0x7efbfc15f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc044f1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efbfc0b3f30 0x7efbfc06e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc044f1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbfc15f8a0 con 0x7efbfc06e970 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc044f1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efbfc06ee00 con 0x7efbfc0b3f30 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc044f1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc0b2e90 con 0x7efbfc15aee0 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc02a8e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efbfc06e970 0x7efbfc0cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37814/0 (socket says 172.21.15.72:37814) 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc02a8e640 1 -- 172.21.15.72:0/2270401920 learned_addr learned my addr 172.21.15.72:0/2270401920 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc01a8c640 1 --2- 172.21.15.72:0/2270401920 >> v2:172.21.15.79:3300/0 conn(0x7efbfc0b3f30 0x7efbfc06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc0228d640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc15aee0 0x7efbfc15f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc0128b640 1 -- 172.21.15.72:0/2270401920 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993991611 0 0) 0x7efbfc15f8a0 con 0x7efbfc06e970 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc0128b640 1 -- 172.21.15.72:0/2270401920 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbe8003520 con 0x7efbfc06e970 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc01a8c640 1 -- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc15aee0 msgr2=0x7efbfc15f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc01a8c640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc15aee0 0x7efbfc15f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc01a8c640 1 -- 172.21.15.72:0/2270401920 >> v1:172.21.15.72:6789/0 conn(0x7efbfc06e970 legacy=0x7efbfc0cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc01a8c640 1 -- 172.21.15.72:0/2270401920 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc0b3170 con 0x7efbfc0b3f30 2024-03-24T10:36:59.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.106+0000 7efc0228d640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc15aee0 0x7efbfc15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:36:59.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.107+0000 7efc01a8c640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc06e430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efbec0097a0 tx=0x7efbec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a69c782c3ac119d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.107+0000 7efc0128b640 1 -- 172.21.15.72:0/2270401920 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec031830 con 0x7efbfc0b3f30 2024-03-24T10:36:59.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.107+0000 7efc0128b640 1 -- 172.21.15.72:0/2270401920 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec031990 con 0x7efbfc0b3f30 2024-03-24T10:36:59.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.107+0000 7efc0128b640 1 -- 172.21.15.72:0/2270401920 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec031d00 con 0x7efbfc0b3f30 2024-03-24T10:36:59.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 -- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 msgr2=0x7efbfc06e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc06e430 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7efbec0097a0 tx=0x7efbec02b8d0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 -- 172.21.15.72:0/2270401920 shutdown_connections 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc06e430 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 --2- 172.21.15.72:0/2270401920 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc15aee0 0x7efbfc15f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 -- 172.21.15.72:0/2270401920 >> 172.21.15.72:0/2270401920 conn(0x7efbfc0b1810 msgr2=0x7efbfc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 -- 172.21.15.72:0/2270401920 shutdown_connections 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.108+0000 7efc044f1640 1 -- 172.21.15.72:0/2270401920 wait complete. 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.109+0000 7efc044f1640 1 Processor -- start 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.109+0000 7efc044f1640 1 -- start start 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc06e970 0x7efbfc1496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc1f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 0x7efbfc15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc149c10 con 0x7efbfc15aee0 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc1f8330 con 0x7efbfc0b3f30 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc1f7d70 con 0x7efbfc06e970 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 0x7efbfc15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 0x7efbfc15b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51804/0 (socket says 172.21.15.72:51804) 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 -- 172.21.15.72:0/395430980 learned_addr learned my addr 172.21.15.72:0/395430980 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc0228d640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc06e970 0x7efbfc1496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc01a8c640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc1f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 -- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc06e970 msgr2=0x7efbfc1496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc06e970 0x7efbfc1496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 -- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 msgr2=0x7efbfc1f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc1f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 -- 172.21.15.72:0/395430980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf4009a70 con 0x7efbfc15aee0 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc02a8e640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 0x7efbfc15b2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c3c0 tx=0x7efbf800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efbf2ffd640 1 -- 172.21.15.72:0/395430980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8005ce0 con 0x7efbfc15aee0 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efbf2ffd640 1 -- 172.21.15.72:0/395430980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf8005e40 con 0x7efbfc15aee0 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbec009400 con 0x7efbfc15aee0 2024-03-24T10:36:59.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efbf2ffd640 1 -- 172.21.15.72:0/395430980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8007310 con 0x7efbfc15aee0 2024-03-24T10:36:59.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.110+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbfc0ae190 con 0x7efbfc15aee0 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.112+0000 7efbf2ffd640 1 -- 172.21.15.72:0/395430980 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efbf8007470 con 0x7efbfc15aee0 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.112+0000 7efbf2ffd640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe006b810 0x7efbe006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.112+0000 7efbf2ffd640 1 -- 172.21.15.72:0/395430980 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efbf8089960 con 0x7efbfc15aee0 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.112+0000 7efc0228d640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe006b810 0x7efbe006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.113+0000 7efc0228d640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe006b810 0x7efbe006dcd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009fd0 tx=0x7efbf400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.113+0000 7efc071aa740 1 Processor -- start 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.113+0000 7efc071aa740 1 -- start start 2024-03-24T10:36:59.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc071aa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84d7f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d7faf0 0x555e84daf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc071aa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e84cf3180 con 0x555e84dac610 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e84cf06b0 con 0x555e84dac9f0 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x555e84cebe90 con 0x555e84d7faf0 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84d7f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84d7f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51808/0 (socket says 172.21.15.72:51808) 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 -- 172.21.15.72:0/1218781444 learned_addr learned my addr 172.21.15.72:0/1218781444 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc02a8e640 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d7faf0 0x555e84daf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc01a8c640 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 -- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d7faf0 msgr2=0x555e84daf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d7faf0 0x555e84daf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 -- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 msgr2=0x555e84daf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.114+0000 7efc0228d640 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efc0228d640 1 -- 172.21.15.72:0/1218781444 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e84ca8d80 con 0x555e84dac610 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efc01a8c640 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efc0228d640 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84d7f5b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efbf4003e60 tx=0x7efbf4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c2b74206117c03 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efbdffff640 1 -- 172.21.15.72:0/1218781444 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf401c040 con 0x555e84dac610 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efbdffff640 1 -- 172.21.15.72:0/1218781444 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf400f040 con 0x555e84dac610 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efbdffff640 1 -- 172.21.15.72:0/1218781444 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf400e040 con 0x555e84dac610 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efc071aa740 1 -- 172.21.15.72:0/1218781444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 msgr2=0x555e84d7f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.115+0000 7efc071aa740 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84d7f5b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7efbf4003e60 tx=0x7efbf4014000 comp rx=0 tx=0).stop 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 -- 172.21.15.72:0/1218781444 shutdown_connections 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d7faf0 0x555e84daf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 --2- 172.21.15.72:0/1218781444 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84d7f5b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 -- 172.21.15.72:0/1218781444 >> 172.21.15.72:0/1218781444 conn(0x555e84d81820 msgr2=0x555e84dca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 -- 172.21.15.72:0/1218781444 shutdown_connections 2024-03-24T10:36:59.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 -- 172.21.15.72:0/1218781444 wait complete. 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 -- start start 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.116+0000 7efc071aa740 1 Processor -- start 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac610 0x555e84d9ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 0x555e84d99a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d9c2e0 0x555e84d9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e84c90d50 con 0x555e84dac9f0 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e849bf310 con 0x555e84dac610 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x555e84c718f0 con 0x555e84d9c2e0 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc071aa740 10 client.0 _ll_register_callbacks cb 0x555e849fcac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:36:59.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc01a8c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 0x555e84d99a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc01a8c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 0x555e84d99a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51824/0 (socket says 172.21.15.72:51824) 2024-03-24T10:36:59.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc01a8c640 1 -- 172.21.15.72:0/2363248498 learned_addr learned my addr 172.21.15.72:0/2363248498 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc02a8e640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d9c2e0 0x555e84d9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc0228d640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac610 0x555e84d9ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc01a8c640 1 -- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d9c2e0 msgr2=0x555e84d9c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.117+0000 7efc01a8c640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d9c2e0 0x555e84d9c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc01a8c640 1 -- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac610 msgr2=0x555e84d9ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc01a8c640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac610 0x555e84d9ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc01a8c640 1 -- 172.21.15.72:0/2363248498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf4003ae0 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc01a8c640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 0x555e84d99a90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efbec02bee0 tx=0x7efbec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9832b21aefcdb477 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efbdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efbdd7fa640 1 -- 172.21.15.72:0/2363248498 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec03f040 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efbdd7fa640 1 -- 172.21.15.72:0/2363248498 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efbec03a830 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e849eb6c0 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efbdd7fa640 1 -- 172.21.15.72:0/2363248498 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7efbec03aa10 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 10 client.4815 fetch_fsmap learned FSMap version 8 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x555e84cea510 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efbdd7fa640 1 -- 172.21.15.72:0/2363248498 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555e849eb6c0 con 0x555e84dac9f0 2024-03-24T10:36:59.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efbdd7fa640 1 -- 172.21.15.72:0/2363248498 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7efbec042030 con 0x555e84dac9f0 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 10 client.4815 fetch_fsmap finished waiting for FSMap version 8 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 10 client.4815 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 20 client.4815 populate_metadata read hostname 'smithi072' 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84de5460 0x555e84de7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 4 client.4815 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 --> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e84a3c270 con 0x555e84de5460 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.118+0000 7efc0228d640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84de5460 0x555e84de7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.119+0000 7efc0228d640 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84de5460 0x555e84de7850 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f82420cf373f7b26 server_cookie=6bd936545398a8cc in_seq=0 out_seq=0 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.119+0000 7efbdd7fa640 10 client.4815 ms_handle_connect on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.119+0000 7efbdd7fa640 1 -- 172.21.15.72:0/2363248498 <== mds.0 v2:172.21.15.79:6833/68214934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555e84a3c270 con 0x555e84de5460 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.119+0000 7efbdd7fa640 10 client.4815 handle_command_reply: tid=0 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.119+0000 7efc071aa740 1 client.4815 shutdown 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 msgr2=0x555e84d99a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 0x555e84d99a90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efbec02bee0 tx=0x7efbec004730 comp rx=0 tx=0).stop 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 shutdown_connections 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84d9c2e0 0x555e84d9c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84de5460 0x555e84de7850 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac9f0 0x555e84d99a90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efbdd7fa640 0 client.4815 ms_handle_reset on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 --2- 172.21.15.72:0/2363248498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac610 0x555e84d9ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 >> 172.21.15.72:0/2363248498 conn(0x555e84d7faf0 msgr2=0x555e84d83590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 shutdown_connections 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 1 -- 172.21.15.72:0/2363248498 wait complete. 2024-03-24T10:36:59.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.120+0000 7efc071aa740 20 client.4815 trim_cache size 0 max 16384 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 Processor -- start 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 -- start start 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84d9c2e0 0x555e84dab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84deccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac9f0 0x555e84e3d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e84dcb120 con 0x555e84dac610 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e84ce0050 con 0x555e84d9c2e0 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.138+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x555e84d9b4f0 con 0x555e84dac9f0 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84deccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84deccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51826/0 (socket says 172.21.15.72:51826) 2024-03-24T10:36:59.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 -- 172.21.15.72:0/861817185 learned_addr learned my addr 172.21.15.72:0/861817185 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc0228d640 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84d9c2e0 0x555e84dab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc02a8e640 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac9f0 0x555e84e3d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 -- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac9f0 msgr2=0x555e84e3d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac9f0 0x555e84e3d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 -- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84d9c2e0 msgr2=0x555e84dab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84d9c2e0 0x555e84dab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 -- 172.21.15.72:0/861817185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e84c86a80 con 0x555e84dac610 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efc01a8c640 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84deccc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efbec02b910 tx=0x7efbec041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37535e4da75be899 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efbdf7fe640 1 -- 172.21.15.72:0/861817185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec056070 con 0x555e84dac610 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efbdf7fe640 1 -- 172.21.15.72:0/861817185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbec004040 con 0x555e84dac610 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.139+0000 7efbdf7fe640 1 -- 172.21.15.72:0/861817185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbec0043b0 con 0x555e84dac610 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 -- 172.21.15.72:0/861817185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 msgr2=0x555e84deccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.150 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84deccc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efbec02b910 tx=0x7efbec041000 comp rx=0 tx=0).stop 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 -- 172.21.15.72:0/861817185 shutdown_connections 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac9f0 0x555e84e3d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84dac610 0x555e84deccc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 --2- 172.21.15.72:0/861817185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84d9c2e0 0x555e84dab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 -- 172.21.15.72:0/861817185 >> 172.21.15.72:0/861817185 conn(0x555e84d7faf0 msgr2=0x555e84d7a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 -- 172.21.15.72:0/861817185 shutdown_connections 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 -- 172.21.15.72:0/861817185 wait complete. 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 -- start start 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.140+0000 7efc071aa740 1 Processor -- start 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 0x555e84d7e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac610 0x555e84daa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x555e84e399c0 con 0x555e84d9c2e0 2024-03-24T10:36:59.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555e84e39bc0 con 0x555e84dac9f0 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x555e84e3b7d0 con 0x555e84dac610 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc071aa740 10 client.0 _ll_register_callbacks cb 0x7efbf40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc0228d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 0x555e84d7e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc0228d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 0x555e84d7e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51840/0 (socket says 172.21.15.72:51840) 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc0228d640 1 -- 172.21.15.72:0/882748339 learned_addr learned my addr 172.21.15.72:0/882748339 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc01a8c640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac610 0x555e84daa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.141+0000 7efc02a8e640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc0228d640 1 -- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac610 msgr2=0x555e84daa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc0228d640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac610 0x555e84daa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc0228d640 1 -- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 msgr2=0x555e84daac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc0228d640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc0228d640 1 -- 172.21.15.72:0/882748339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e84cea510 con 0x555e84d9c2e0 2024-03-24T10:36:59.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc0228d640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 0x555e84d7e450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efbf4022000 tx=0x7efbf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff699909ddda3304 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efbdd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efbdd7fa640 1 -- 172.21.15.72:0/882748339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf4032040 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efbdd7fa640 1 -- 172.21.15.72:0/882748339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efbf4017920 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e84dabf20 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efbdd7fa640 1 -- 172.21.15.72:0/882748339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7efbf400e040 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 10 client.4821 fetch_fsmap learned FSMap version 8 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x555e84cac7e0 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efbdd7fa640 1 -- 172.21.15.72:0/882748339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555e84dabf20 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efbdd7fa640 1 -- 172.21.15.72:0/882748339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7efbf4017ae0 con 0x555e84d9c2e0 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 10 client.4821 fetch_fsmap finished waiting for FSMap version 8 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 10 client.4821 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-24T10:36:59.153 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 20 client.4821 populate_metadata read hostname 'smithi072' 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84e3af90 0x555e84daede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 4 client.4821 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 --> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] -- command(tid 0: {"prefix": "status"}) -- 0x7efbf400f040 con 0x555e84e3af90 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.142+0000 7efc01a8c640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84e3af90 0x555e84daede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efbdd7fa640 10 client.4821 ms_handle_connect on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc01a8c640 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84e3af90 0x555e84daede0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d6826cf4bf8cce4 server_cookie=e5502ea8511131ea in_seq=0 out_seq=0 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efbdd7fa640 1 -- 172.21.15.72:0/882748339 <== mds.0 v2:172.21.15.79:6833/68214934 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x7efbf400f040 con 0x555e84e3af90 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efbdd7fa640 10 client.4821 handle_command_reply: tid=0 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 client.4821 shutdown 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 msgr2=0x555e84d7e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 0x555e84d7e450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7efbf4022000 tx=0x7efbf4004a40 comp rx=0 tx=0).stop 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 shutdown_connections 2024-03-24T10:36:59.154 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555e84dac9f0 0x555e84daac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x555e84dac610 0x555e84daa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.79:6833/68214934,v1:172.21.15.79:6835/68214934] conn(0x555e84e3af90 0x555e84daede0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 --2- 172.21.15.72:0/882748339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x555e84d9c2e0 0x555e84d7e450 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efbdd7fa640 0 client.4821 ms_handle_reset on v2:172.21.15.79:6833/68214934 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 >> 172.21.15.72:0/882748339 conn(0x555e84d7faf0 msgr2=0x555e84d9bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 shutdown_connections 2024-03-24T10:36:59.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 1 -- 172.21.15.72:0/882748339 wait complete. 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.143+0000 7efc071aa740 20 client.4821 trim_cache size 0 max 16384 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "0cd6a1e7-49c4-4ce2-8320-31fe22775d9b", 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4288, 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 32.925919071999999, 2024-03-24T10:36:59.156 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 8, 2024-03-24T10:36:59.157 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2024-03-24T10:36:59.157 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2024-03-24T10:36:59.157 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 39.389890729999998 2024-03-24T10:36:59.157 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-24T10:36:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe006b810 msgr2=0x7efbe006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe006b810 0x7efbe006dcd0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009fd0 tx=0x7efbf400b040 comp rx=0 tx=0).stop 2024-03-24T10:36:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 msgr2=0x7efbfc15b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 0x7efbfc15b2c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efbf800c3c0 tx=0x7efbf800c880 comp rx=0 tx=0).stop 2024-03-24T10:36:59.158 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 shutdown_connections 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe006b810 0x7efbe006dcd0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbfc15aee0 0x7efbfc15b2c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbfc0b3f30 0x7efbfc1f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 --2- 172.21.15.72:0/395430980 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbfc06e970 0x7efbfc1496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 >> 172.21.15.72:0/395430980 conn(0x7efbfc0b1810 msgr2=0x7efbfc15a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 shutdown_connections 2024-03-24T10:36:59.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.144+0000 7efc044f1640 1 -- 172.21.15.72:0/395430980 wait complete. 2024-03-24T10:36:59.160 INFO:teuthology.run_tasks:Running task sequential... 2024-03-24T10:36:59.170 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-24T10:36:59.170 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-24T10:36:59.171 INFO:teuthology.task.print:Enabling mgr modules 2024-03-24T10:36:59.171 INFO:teuthology.run_tasks:Running task kclient... 2024-03-24T10:36:59.213 INFO:tasks.kclient:Mounting kernel clients... 2024-03-24T10:36:59.213 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-24T10:36:59.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.213 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-24T10:36:59.229 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-24T10:36:59.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-24T10:36:59.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-03-24T10:36:59.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.406 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-24T10:36:59.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2024-03-24T10:36:59.493 INFO:teuthology.orchestra.run.smithi072.stderr:Cannot find device "ceph-brx" 2024-03-24T10:36:59.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:36:59.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.494 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-03-24T10:36:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-03-24T10:36:59.581 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-03-24T10:36:59.582 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:36:59.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.582 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-03-24T10:36:59.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:36:59.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link delete ceph-brx 2024-03-24T10:36:59.704 INFO:teuthology.orchestra.run.smithi079.stderr:Cannot find device "ceph-brx" 2024-03-24T10:36:59.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T10:36:59.706 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-24T10:36:59.706 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-24T10:36:59.706 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-24T10:36:59.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:36:59.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.811+0000 7fb0d2d3e640 1 Processor -- start 2024-03-24T10:36:59.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.811+0000 7fb0d2d3e640 1 -- start start 2024-03-24T10:36:59.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d2d3e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0cc06d570 0x7fb0cc071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d2d3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb0cc0acf90 0x7fb0cc0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d2d3e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0cc0715f0 con 0x7fb0cc071050 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d2d3e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb0cc071d90 con 0x7fb0cc06d570 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d2d3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb0cc0b4d80 con 0x7fb0cc0acf90 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0cc06d570 0x7fb0cc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb0cc06d570 0x7fb0cc071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51842/0 (socket says 172.21.15.72:51842) 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0cbfff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb0cc071050 0x7fb0cc06d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:37826/0 (socket says 172.21.15.72:37826) 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 -- 172.21.15.72:0/2804082295 learned_addr learned my addr 172.21.15.72:0/2804082295 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d12db640 1 --2- 172.21.15.72:0/2804082295 >> v2:172.21.15.79:3300/0 conn(0x7fb0cc0acf90 0x7fb0cc0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 -- 172.21.15.72:0/2804082295 >> v2:172.21.15.79:3300/0 conn(0x7fb0cc0acf90 msgr2=0x7fb0cc0ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 --2- 172.21.15.72:0/2804082295 >> v2:172.21.15.79:3300/0 conn(0x7fb0cc0acf90 0x7fb0cc0ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 -- 172.21.15.72:0/2804082295 >> v1:172.21.15.72:6789/0 conn(0x7fb0cc071050 legacy=0x7fb0cc06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.812+0000 7fb0d0ada640 1 -- 172.21.15.72:0/2804082295 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc0b3d60 con 0x7fb0cc06d570 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.813+0000 7fb0d0ada640 1 --2- 172.21.15.72:0/2804082295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc071850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc06c630 tx=0x7fb0c002dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5419bc2a7abb80a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.813+0000 7fb0cb7fe640 1 -- 172.21.15.72:0/2804082295 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c002e960 con 0x7fb0cc06d570 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.813+0000 7fb0cb7fe640 1 -- 172.21.15.72:0/2804082295 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c002eac0 con 0x7fb0cc06d570 2024-03-24T10:36:59.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.813+0000 7fb0cb7fe640 1 -- 172.21.15.72:0/2804082295 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c002ee50 con 0x7fb0cc06d570 2024-03-24T10:36:59.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/2804082295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 msgr2=0x7fb0cc071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/2804082295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc071850 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc06c630 tx=0x7fb0c002dbb0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/2804082295 shutdown_connections 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/2804082295 >> v2:172.21.15.79:3300/0 conn(0x7fb0cc0acf90 0x7fb0cc0ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/2804082295 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc071850 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/2804082295 >> 172.21.15.72:0/2804082295 conn(0x7fb0cc0b1920 msgr2=0x7fb0cc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/2804082295 shutdown_connections 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.814+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/2804082295 wait complete. 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.815+0000 7fb0d2d3e640 1 Processor -- start 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.815+0000 7fb0d2d3e640 1 -- start start 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d2d3e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc1f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d2d3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc071050 0x7fb0cc1edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d2d3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0cc0acf90 0x7fb0cc158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.820 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d2d3e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1f02e0 con 0x7fb0cc06d570 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d2d3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc1f0e50 con 0x7fb0cc071050 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d2d3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb0cc15c8c0 con 0x7fb0cc0acf90 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc1f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc1f0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51848/0 (socket says 172.21.15.72:51848) 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 -- 172.21.15.72:0/3143169964 learned_addr learned my addr 172.21.15.72:0/3143169964 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d12db640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0cc0acf90 0x7fb0cc158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0cbfff640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc071050 0x7fb0cc1edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 -- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0cc0acf90 msgr2=0x7fb0cc158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0cc0acf90 0x7fb0cc158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.821 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 -- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc071050 msgr2=0x7fb0cc1edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.816+0000 7fb0d0ada640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc071050 0x7fb0cc1edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0d0ada640 1 -- 172.21.15.72:0/3143169964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00094d0 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0d0ada640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc1f0910 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00097f0 tx=0x7fb0c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c003f600 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c003f760 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c003fb10 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc15cba0 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.817+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc153000 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.818+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc09e080 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.818+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb0c003d040 con 0x7fb0cc06d570 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.819+0000 7fb0c97fa640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb0b006b840 0x7fb0b006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.819+0000 7fb0cbfff640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb0b006b840 0x7fb0b006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:36:59.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.819+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb0c00ae650 con 0x7fb0cc06d570 2024-03-24T10:36:59.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.819+0000 7fb0cbfff640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb0b006b840 0x7fb0b006dd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc15d0c0 tx=0x7fb0b8007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:36:59.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:36:59.823+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb0c0078de0 con 0x7fb0cc06d570 2024-03-24T10:37:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.110+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb0cc04f550 con 0x7fb0cc06d570 2024-03-24T10:37:00.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.111+0000 7fb0c97fa640 1 -- 172.21.15.72:0/3143169964 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fb0c003b070 con 0x7fb0cc06d570 2024-03-24T10:37:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-24T10:37:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.112+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb0b006b840 msgr2=0x7fb0b006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.112+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb0b006b840 0x7fb0b006dd00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc15d0c0 tx=0x7fb0b8007e80 comp rx=0 tx=0).stop 2024-03-24T10:37:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.112+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 msgr2=0x7fb0cc1f0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.112+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc1f0910 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00097f0 tx=0x7fb0c00046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:00.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 shutdown_connections 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb0b006b840 0x7fb0b006dd00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb0cc0acf90 0x7fb0cc158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb0cc071050 0x7fb0cc1edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 --2- 172.21.15.72:0/3143169964 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb0cc06d570 0x7fb0cc1f0910 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 >> 172.21.15.72:0/3143169964 conn(0x7fb0cc0b1920 msgr2=0x7fb0cc0afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 shutdown_connections 2024-03-24T10:37:00.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00.113+0000 7fb0d2d3e640 1 -- 172.21.15.72:0/3143169964 wait complete. 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-24T10:37:00.124 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:37:00.125 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:37:00.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:00.125 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:00.140 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42665sec preferred_lft 42665sec 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-24T10:37:00.141 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:00.141 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-24T10:37:00.141 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:00.141 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:00.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2024-03-24T10:37:00.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2024-03-24T10:37:00.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2024-03-24T10:37:00.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-24T10:37:00.142 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:00.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:00.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:00.289 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:37:00.314 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-03-24T10:37:00.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:00.315 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-03-24T10:37:00.372 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-03-24T10:37:00.372 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:37:00.372 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:37:00.372 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:37:00.372 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:37:00.373 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:00.373 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:00.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:37:00.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:37:00.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:37:00.374 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:00.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:00.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:00.508 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-24T10:37:00.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:00.523 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-03-24T10:37:00.579 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:00.579 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:00.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-24T10:37:00.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-24T10:37:00.580 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:00.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:00.700 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-24T10:37:00.701 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:00.749 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:00.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:00.825 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:00.826 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:00.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-03-24T10:37:00.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2024-03-24T10:37:00.826 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:00.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:00.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:00.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:00.906 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:00.928 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:37:00.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:00.929 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:00.983 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-24T10:37:00.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:00.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:01.068 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:01.068 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:01.181 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:01.181 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:01.181 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.79:3300,172.21.15.79:3301" 2024-03-24T10:37:01.181 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 0@0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.cephfs=/ 2024-03-24T10:37:01.181 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.72:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2024-03-24T10:37:01.182 INFO:teuthology.orchestra.run.smithi072.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-24T10:37:01.182 INFO:teuthology.orchestra.run.smithi072.stdout: You just mounted a file system that supports labels which does not 2024-03-24T10:37:01.182 INFO:teuthology.orchestra.run.smithi072.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-24T10:37:01.182 INFO:teuthology.orchestra.run.smithi072.stdout: applications will generate AVC messages and not be allowed access to 2024-03-24T10:37:01.182 INFO:teuthology.orchestra.run.smithi072.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-24T10:37:01.183 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:37:01.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:01.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:01.212 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:01.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:01.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:01.308 INFO:teuthology.orchestra.run.smithi072.stdout:client4849 2024-03-24T10:37:01.309 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:01.309 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:01.325 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:01.420 INFO:teuthology.orchestra.run.smithi072.stdout:client4849 2024-03-24T10:37:01.420 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:01.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:01.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:01.475 INFO:teuthology.orchestra.run.smithi072.stdout:client4849 2024-03-24T10:37:01.475 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.client4849/status') 2024-03-24T10:37:01.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:01.539 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4849 (3)172.21.15.72:0/2346540816 2024-03-24T10:37:01.539 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2024-03-24T10:37:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2024-03-24T10:37:01.539 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2024-03-24T10:37:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:70 bytes copied, 2.0772e-05 s, 3.4 MB/s 2024-03-24T10:37:01.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:01.547 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-24T10:37:01.547 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-24T10:37:01.547 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-24T10:37:01.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:37:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.650+0000 7f31d55d0640 1 Processor -- start 2024-03-24T10:37:01.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.650+0000 7f31d55d0640 1 -- start start 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31d55d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31d55d0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31d00d2450 0x7f31d00b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31d55d0640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d00d4e50 con 0x7f31d00d4930 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31d55d0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f31d00cf790 con 0x7f31d00d2450 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31d55d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f31d00cfa70 con 0x7f31d015e170 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ceffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31cf7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f31d00d2450 0x7f31d00b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ce7fc640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f31d00d4930 0x7f31d00d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:42800/0 (socket says 172.21.15.72:42800) 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ce7fc640 1 -- 172.21.15.72:0/122069477 learned_addr learned my addr 172.21.15.72:0/122069477 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31cdffb640 1 -- 172.21.15.72:0/122069477 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884843365 0 0) 0x7f31d00d4e50 con 0x7f31d00d4930 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31cdffb640 1 -- 172.21.15.72:0/122069477 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b8003520 con 0x7f31d00d4930 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ceffd640 1 -- 172.21.15.72:0/122069477 >> v2:172.21.15.79:3300/0 conn(0x7f31d00d2450 msgr2=0x7f31d00b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ceffd640 1 --2- 172.21.15.72:0/122069477 >> v2:172.21.15.79:3300/0 conn(0x7f31d00d2450 0x7f31d00b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ceffd640 1 -- 172.21.15.72:0/122069477 >> v1:172.21.15.79:6789/0 conn(0x7f31d00d4930 legacy=0x7f31d00d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31ceffd640 1 -- 172.21.15.72:0/122069477 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d00cfd50 con 0x7f31d015e170 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.651+0000 7f31cf7fe640 1 --2- 172.21.15.72:0/122069477 >> v2:172.21.15.79:3300/0 conn(0x7f31d00d2450 0x7f31d00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.652+0000 7f31ceffd640 1 --2- 172.21.15.72:0/122069477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d015e550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31c00097a0 tx=0x7f31c002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb82464a7ddb780 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.652+0000 7f31cdffb640 1 -- 172.21.15.72:0/122069477 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0031780 con 0x7f31d015e170 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.652+0000 7f31cdffb640 1 -- 172.21.15.72:0/122069477 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c00318e0 con 0x7f31d015e170 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.652+0000 7f31cdffb640 1 -- 172.21.15.72:0/122069477 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0031c50 con 0x7f31d015e170 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 -- 172.21.15.72:0/122069477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 msgr2=0x7f31d015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 --2- 172.21.15.72:0/122069477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d015e550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31c00097a0 tx=0x7f31c002b820 comp rx=0 tx=0).stop 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 -- 172.21.15.72:0/122069477 shutdown_connections 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 --2- 172.21.15.72:0/122069477 >> v2:172.21.15.79:3300/0 conn(0x7f31d00d2450 0x7f31d00b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 --2- 172.21.15.72:0/122069477 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d015e550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 -- 172.21.15.72:0/122069477 >> 172.21.15.72:0/122069477 conn(0x7f31d009d310 msgr2=0x7f31d00d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:01.655 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 -- 172.21.15.72:0/122069477 shutdown_connections 2024-03-24T10:37:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.653+0000 7f31d55d0640 1 -- 172.21.15.72:0/122069477 wait complete. 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.654+0000 7f31d55d0640 1 Processor -- start 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.654+0000 7f31d55d0640 1 -- start start 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31d55d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d00d2450 0x7f31d01584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31d55d0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 0x7f31d006cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31d55d0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31d55d0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f31d00b72e0 con 0x7f31d00d4930 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31d55d0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f31d015b200 con 0x7f31d00d2450 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31d55d0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f31d00b7b10 con 0x7f31d015e170 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 0x7f31d006cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ceffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d00d2450 0x7f31d01584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 0x7f31d006cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41404/0 (socket says 172.21.15.72:41404) 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 -- 172.21.15.72:0/3743405184 learned_addr learned my addr 172.21.15.72:0/3743405184 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31cf7fe640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 -- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 msgr2=0x7f31d006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 -- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d00d2450 msgr2=0x7f31d01584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d00d2450 0x7f31d01584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.655+0000 7f31ce7fc640 1 -- 172.21.15.72:0/3743405184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c8009a70 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.656+0000 7f31ce7fc640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 0x7f31d006cf10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c460 tx=0x7f31c400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.656+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4005ce0 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.656+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c4005e40 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.656+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c0009400 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.656+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40072f0 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.656+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d00b74c0 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.657+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d00a1ef0 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.657+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f31c4007450 con 0x7f31d00d4930 2024-03-24T10:37:01.660 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.657+0000 7f31b77fe640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f31bc06b810 0x7f31bc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.657+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f31c40899a0 con 0x7f31d00d4930 2024-03-24T10:37:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.657+0000 7f31ceffd640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f31bc06b810 0x7f31bc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.658+0000 7f31ceffd640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f31bc06b810 0x7f31bc06dcd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31c0036000 tx=0x7f31c003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.662+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f31c40541c0 con 0x7f31d00d4930 2024-03-24T10:37:01.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.869+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f31d004f550 con 0x7f31d00d4930 2024-03-24T10:37:01.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.869+0000 7f31b77fe640 1 -- 172.21.15.72:0/3743405184 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f31c4017070 con 0x7f31d00d4930 2024-03-24T10:37:01.871 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f31bc06b810 msgr2=0x7f31bc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f31bc06b810 0x7f31bc06dcd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f31c0036000 tx=0x7f31c003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 msgr2=0x7f31d006cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 0x7f31d006cf10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c460 tx=0x7f31c400c860 comp rx=0 tx=0).stop 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 shutdown_connections 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f31bc06b810 0x7f31bc06dcd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f31d015e170 0x7f31d006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f31d00d4930 0x7f31d006cf10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 --2- 172.21.15.72:0/3743405184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31d00d2450 0x7f31d01584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 >> 172.21.15.72:0/3743405184 conn(0x7f31d009d310 msgr2=0x7f31d00ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 shutdown_connections 2024-03-24T10:37:01.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:01.871+0000 7f31d55d0640 1 -- 172.21.15.72:0/3743405184 wait complete. 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:37:01.883 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-24T10:37:01.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:01.883 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:01.899 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether ae:38:a6:4f:5d:73 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:01.900 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::cc84:caff:fe04:6e/64 scope link tentative 2024-03-24T10:37:01.901 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:01.901 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-24T10:37:01.901 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether ae:38:a6:4f:5d:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-24T10:37:01.901 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ac38:a6ff:fe4f:5d73/64 scope link tentative 2024-03-24T10:37:01.901 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:01.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:01.901 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:37:01.966 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-03-24T10:37:01.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:01.967 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-03-24T10:37:02.025 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-03-24T10:37:02.025 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:37:02.025 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:37:02.025 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:37:02.025 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:37:02.025 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:02.026 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:02.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:37:02.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:37:02.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:37:02.026 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:02.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:02.155 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:02.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:02.161 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-24T10:37:02.175 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-24T10:37:02.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:02.176 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2024-03-24T10:37:02.232 INFO:teuthology.orchestra.run.smithi072.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-24T10:37:02.233 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:02.233 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:02.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-24T10:37:02.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-24T10:37:02.233 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:02.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:02.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:02.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:02.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-24T10:37:02.383 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:02.383 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:02.383 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:02.383 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.383 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:02.383 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.384 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:02.384 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e6:3d:fd:6d:f6:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-24T10:37:02.384 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-24T10:37:02.384 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.384 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e43d:fdff:fe6d:f628/64 scope link tentative 2024-03-24T10:37:02.384 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:02.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-24T10:37:02.452 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:02.452 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:02.452 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:02.452 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether e6:3d:fd:6d:f6:28 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::e43d:fdff:fe6d:f628/64 scope link tentative 2024-03-24T10:37:02.453 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:02.454 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-24T10:37:02.454 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:02.454 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:02.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-24T10:37:02.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-24T10:37:02.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-24T10:37:02.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-24T10:37:02.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-24T10:37:02.455 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:02.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:02.618 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:02.618 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:02.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.1 up 2024-03-24T10:37:02.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.1 master ceph-brx 2024-03-24T10:37:02.618 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:02.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:02.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:02.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:02.700 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-24T10:37:02.727 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-24T10:37:02.727 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:02.727 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-24T10:37:02.782 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-24T10:37:02.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:02.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:02.867 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:02.867 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.79:3300,172.21.15.79:3301" 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 2@0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.cephfs=/ 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.72:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout: You just mounted a file system that supports labels which does not 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout: applications will generate AVC messages and not be allowed access to 2024-03-24T10:37:02.875 INFO:teuthology.orchestra.run.smithi072.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-24T10:37:02.876 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:37:02.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:02.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-24T10:37:02.945 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:03.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:03.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:03.042 INFO:teuthology.orchestra.run.smithi072.stdout:client4836 2024-03-24T10:37:03.043 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:03.043 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:03.059 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:03.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:03.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:03.154 INFO:teuthology.orchestra.run.smithi072.stdout:client4836 2024-03-24T10:37:03.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:03.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:03.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:03.209 INFO:teuthology.orchestra.run.smithi072.stdout:client4836 2024-03-24T10:37:03.209 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.client4836/status') 2024-03-24T10:37:03.257 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:03.269 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4836 (3)192.168.0.2:0/2589800036 2024-03-24T10:37:03.269 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2024-03-24T10:37:03.270 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2024-03-24T10:37:03.270 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2024-03-24T10:37:03.270 INFO:teuthology.orchestra.run.smithi072.stderr:69 bytes copied, 2.0675e-05 s, 3.3 MB/s 2024-03-24T10:37:03.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:03.276 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-24T10:37:03.276 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-24T10:37:03.276 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-24T10:37:03.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:37:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.377+0000 7f6ef7fc9640 1 Processor -- start 2024-03-24T10:37:03.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.377+0000 7f6ef7fc9640 1 -- start start 2024-03-24T10:37:03.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef7fc9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ef0071050 0x7f6ef0071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:03.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef7fc9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6ef00acf90 0x7f6ef00ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef7fc9640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef00715f0 con 0x7f6ef006d570 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef7fc9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef0071d90 con 0x7f6ef0071050 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef7fc9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef00b4d80 con 0x7f6ef00acf90 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5564640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ef0071050 0x7f6ef0071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5d65640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6ef006d570 0x7f6ef006d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59972/0 (socket says 172.21.15.72:59972) 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5d65640 1 -- 172.21.15.72:0/278716372 learned_addr learned my addr 172.21.15.72:0/278716372 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef6566640 1 --2- 172.21.15.72:0/278716372 >> v2:172.21.15.79:3300/0 conn(0x7f6ef00acf90 0x7f6ef00ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5564640 1 -- 172.21.15.72:0/278716372 >> v2:172.21.15.79:3300/0 conn(0x7f6ef00acf90 msgr2=0x7f6ef00ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5564640 1 --2- 172.21.15.72:0/278716372 >> v2:172.21.15.79:3300/0 conn(0x7f6ef00acf90 0x7f6ef00ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5564640 1 -- 172.21.15.72:0/278716372 >> v1:172.21.15.72:6789/0 conn(0x7f6ef006d570 legacy=0x7f6ef006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef4d63640 1 -- 172.21.15.72:0/278716372 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 478576464 0 0) 0x7f6ef00715f0 con 0x7f6ef006d570 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.378+0000 7f6ef5564640 1 -- 172.21.15.72:0/278716372 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef00b3d60 con 0x7f6ef0071050 2024-03-24T10:37:03.380 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.379+0000 7f6ef5564640 1 --2- 172.21.15.72:0/278716372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef0071050 0x7f6ef0071850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ef006c630 tx=0x7f6ee002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196eb7e7021cb983 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.379+0000 7f6ef4d63640 1 -- 172.21.15.72:0/278716372 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0031830 con 0x7f6ef0071050 2024-03-24T10:37:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.379+0000 7f6ef4d63640 1 -- 172.21.15.72:0/278716372 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0031990 con 0x7f6ef0071050 2024-03-24T10:37:03.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.379+0000 7f6ef4d63640 1 -- 172.21.15.72:0/278716372 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0031d20 con 0x7f6ef0071050 2024-03-24T10:37:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/278716372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef0071050 msgr2=0x7f6ef0071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/278716372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef0071050 0x7f6ef0071850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6ef006c630 tx=0x7f6ee002b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.383 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/278716372 shutdown_connections 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/278716372 >> v2:172.21.15.79:3300/0 conn(0x7f6ef00acf90 0x7f6ef00ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/278716372 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef0071050 0x7f6ef0071850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/278716372 >> 172.21.15.72:0/278716372 conn(0x7f6ef00b1920 msgr2=0x7f6ef00b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/278716372 shutdown_connections 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.380+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/278716372 wait complete. 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.381+0000 7f6ef7fc9640 1 Processor -- start 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.381+0000 7f6ef7fc9640 1 -- start start 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ef006d570 0x7f6ef01541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ef0071050 0x7f6ef01f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 0x7f6ef01547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0155040 con 0x7f6ef00acf90 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0155320 con 0x7f6ef0071050 2024-03-24T10:37:03.384 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef0155600 con 0x7f6ef006d570 2024-03-24T10:37:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 0x7f6ef01547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:03.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 0x7f6ef01547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41436/0 (socket says 172.21.15.72:41436) 2024-03-24T10:37:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 -- 172.21.15.72:0/3194631530 learned_addr learned my addr 172.21.15.72:0/3194631530 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef5564640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ef0071050 0x7f6ef01f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef5d65640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ef006d570 0x7f6ef01541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 -- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ef006d570 msgr2=0x7f6ef01541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ef006d570 0x7f6ef01541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 -- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ef0071050 msgr2=0x7f6ef01f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ef0071050 0x7f6ef01f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 -- 172.21.15.72:0/3194631530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee0009400 con 0x7f6ef00acf90 2024-03-24T10:37:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef6566640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 0x7f6ef01547f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800efc0 tx=0x7f6ee800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8014480 con 0x7f6ef00acf90 2024-03-24T10:37:03.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee800f040 con 0x7f6ef00acf90 2024-03-24T10:37:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef01558e0 con 0x7f6ef00acf90 2024-03-24T10:37:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8014820 con 0x7f6ef00acf90 2024-03-24T10:37:03.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.382+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef01560e0 con 0x7f6ef00acf90 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.383+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef0155e00 con 0x7f6ef00acf90 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.384+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6ee8014980 con 0x7f6ef00acf90 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.384+0000 7f6ee67fc640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6ed406b840 0x7f6ed406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.384+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6ee808aeb0 con 0x7f6ef00acf90 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.384+0000 7f6ef5d65640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6ed406b840 0x7f6ed406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.385+0000 7f6ef5d65640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6ed406b840 0x7f6ed406dd00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:03.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.389+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6ef0155e00 con 0x7f6ef00acf90 2024-03-24T10:37:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.597+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6ef0155e00 con 0x7f6ef00acf90 2024-03-24T10:37:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.597+0000 7f6ee67fc640 1 -- 172.21.15.72:0/3194631530 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f6ef0155e00 con 0x7f6ef00acf90 2024-03-24T10:37:03.598 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6ed406b840 msgr2=0x7f6ed406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6ed406b840 0x7f6ed406dd00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6eec007fd0 tx=0x7f6eec007de0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 msgr2=0x7f6ef01547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 0x7f6ef01547f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800efc0 tx=0x7f6ee800c490 comp rx=0 tx=0).stop 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 shutdown_connections 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6ed406b840 0x7f6ed406dd00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ef00acf90 0x7f6ef01547f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ef0071050 0x7f6ef01f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 --2- 172.21.15.72:0/3194631530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6ef006d570 0x7f6ef01541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 >> 172.21.15.72:0/3194631530 conn(0x7f6ef00b1920 msgr2=0x7f6ef0159a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 shutdown_connections 2024-03-24T10:37:03.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:03.599+0000 7f6ef7fc9640 1 -- 172.21.15.72:0/3194631530 wait complete. 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:37:03.611 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-24T10:37:03.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:03.611 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-03-24T10:37:03.627 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:03.627 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:03.627 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:03.627 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:03.627 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:03.627 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42632sec preferred_lft 42632sec 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-03-24T10:37:03.628 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:03.629 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add name ceph-brx type bridge 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr flush dev ceph-brx 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set ceph-brx up 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-24T10:37:03.629 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:03.715 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:03.906 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:03.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:03.915 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:37:03.942 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-03-24T10:37:03.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:03.944 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-03-24T10:37:04.014 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-03-24T10:37:04.014 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:37:04.014 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:37:04.014 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:37:04.014 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:37:04.015 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:04.015 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:04.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:37:04.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:37:04.015 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:37:04.015 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:04.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:04.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:04.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:04.345 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-03-24T10:37:04.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:04.360 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-03-24T10:37:04.416 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:04.416 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:04.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-24T10:37:04.416 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-24T10:37:04.416 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:04.505 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:04.539 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:04.546 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-24T10:37:04.547 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:04.596 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:04.684 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:04.690 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:04.690 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:04.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.0 up 2024-03-24T10:37:04.691 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.0 master ceph-brx 2024-03-24T10:37:04.691 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:04.738 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:04.766 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:04.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:04.772 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-24T10:37:04.786 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-24T10:37:04.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:04.787 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-24T10:37:04.840 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-24T10:37:04.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:04.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:04.927 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:04.927 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:05.043 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:05.043 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:05.043 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.79:3300,172.21.15.79:3301" 2024-03-24T10:37:05.043 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 1@0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.cephfs=/ 2024-03-24T10:37:05.044 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.72:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2024-03-24T10:37:05.044 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-24T10:37:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-03-24T10:37:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-24T10:37:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-03-24T10:37:05.044 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-24T10:37:05.046 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:37:05.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:05.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-24T10:37:05.116 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:05.204 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:05.205 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:05.211 INFO:teuthology.orchestra.run.smithi079.stdout:client4848 2024-03-24T10:37:05.211 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:05.211 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:05.227 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:05.314 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:05.316 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:05.321 INFO:teuthology.orchestra.run.smithi079.stdout:client4848 2024-03-24T10:37:05.322 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:05.380 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:05.381 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:05.389 INFO:teuthology.orchestra.run.smithi079.stdout:client4848 2024-03-24T10:37:05.389 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.client4848/status') 2024-03-24T10:37:05.437 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:05.450 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.4848 (3)172.21.15.79:0/138579458 2024-03-24T10:37:05.450 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-03-24T10:37:05.451 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-03-24T10:37:05.451 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-03-24T10:37:05.451 INFO:teuthology.orchestra.run.smithi079.stderr:69 bytes copied, 2.1159e-05 s, 3.3 MB/s 2024-03-24T10:37:05.451 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:05.457 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-24T10:37:05.458 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-24T10:37:05.458 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-24T10:37:05.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:37:05.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.569+0000 7f4813d8a640 1 Processor -- start 2024-03-24T10:37:05.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.569+0000 7f4813d8a640 1 -- start start 2024-03-24T10:37:05.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4813d8a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f480c071d80 0x7f480c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:05.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4813d8a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f480c0ae570 0x7f480c06dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:05.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4813d8a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f480c0ad840 con 0x7f480c155040 2024-03-24T10:37:05.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4813d8a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f480c06e4f0 con 0x7f480c071d80 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4813d8a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f480c0ada90 con 0x7f480c0ae570 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4811325640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f480c071d80 0x7f480c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4811325640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f480c071d80 0x7f480c06d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41450/0 (socket says 172.21.15.72:41450) 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4811325640 1 -- 172.21.15.72:0/3483781546 learned_addr learned my addr 172.21.15.72:0/3483781546 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.570+0000 7f4812327640 1 --2- 172.21.15.72:0/3483781546 >> v2:172.21.15.79:3300/0 conn(0x7f480c0ae570 0x7f480c06dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.571+0000 7f4811325640 1 -- 172.21.15.72:0/3483781546 >> v2:172.21.15.79:3300/0 conn(0x7f480c0ae570 msgr2=0x7f480c06dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.571+0000 7f4811325640 1 --2- 172.21.15.72:0/3483781546 >> v2:172.21.15.79:3300/0 conn(0x7f480c0ae570 0x7f480c06dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.571+0000 7f4811325640 1 -- 172.21.15.72:0/3483781546 >> v1:172.21.15.79:6789/0 conn(0x7f480c155040 legacy=0x7f480c071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.571+0000 7f4811325640 1 -- 172.21.15.72:0/3483781546 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480c0add70 con 0x7f480c071d80 2024-03-24T10:37:05.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.571+0000 7f4810b24640 1 -- 172.21.15.72:0/3483781546 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173916414 0 0) 0x7f480c0ad840 con 0x7f480c155040 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.571+0000 7f4811325640 1 --2- 172.21.15.72:0/3483781546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c071d80 0x7f480c06d780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f480c0ccfe0 tx=0x7f47fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7187ac6541f206 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4810b24640 1 -- 172.21.15.72:0/3483781546 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc031870 con 0x7f480c071d80 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4810b24640 1 -- 172.21.15.72:0/3483781546 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47fc0319d0 con 0x7f480c071d80 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4810b24640 1 -- 172.21.15.72:0/3483781546 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc031d60 con 0x7f480c071d80 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 -- 172.21.15.72:0/3483781546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c071d80 msgr2=0x7f480c06d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 --2- 172.21.15.72:0/3483781546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c071d80 0x7f480c06d780 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f480c0ccfe0 tx=0x7f47fc02b910 comp rx=0 tx=0).stop 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 -- 172.21.15.72:0/3483781546 shutdown_connections 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 --2- 172.21.15.72:0/3483781546 >> v2:172.21.15.79:3300/0 conn(0x7f480c0ae570 0x7f480c06dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 --2- 172.21.15.72:0/3483781546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c071d80 0x7f480c06d780 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 -- 172.21.15.72:0/3483781546 >> 172.21.15.72:0/3483781546 conn(0x7f480c06b310 msgr2=0x7f480c06b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 -- 172.21.15.72:0/3483781546 shutdown_connections 2024-03-24T10:37:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.572+0000 7f4813d8a640 1 -- 172.21.15.72:0/3483781546 wait complete. 2024-03-24T10:37:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.573+0000 7f4813d8a640 1 Processor -- start 2024-03-24T10:37:05.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.573+0000 7f4813d8a640 1 -- start start 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4813d8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f480c071d80 0x7f480c1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4813d8a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f480c0ae570 0x7f480c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4813d8a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 0x7f480c0b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4813d8a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f480c1425e0 con 0x7f480c155040 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4813d8a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f480c143970 con 0x7f480c071d80 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4813d8a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f480c142d60 con 0x7f480c0ae570 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4812327640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 0x7f480c0b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4812327640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 0x7f480c0b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41458/0 (socket says 172.21.15.72:41458) 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4812327640 1 -- 172.21.15.72:0/883934800 learned_addr learned my addr 172.21.15.72:0/883934800 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4811b26640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f480c071d80 0x7f480c1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:05.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.574+0000 7f4811325640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f480c0ae570 0x7f480c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4812327640 1 -- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f480c0ae570 msgr2=0x7f480c157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4812327640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f480c0ae570 0x7f480c157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4812327640 1 -- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f480c071d80 msgr2=0x7f480c1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4812327640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f480c071d80 0x7f480c1420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4812327640 1 -- 172.21.15.72:0/883934800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc0094d0 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4812327640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 0x7f480c0b5300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f480400e930 tx=0x7f480400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804009690 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480400c980 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480c143040 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f480400cd30 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.575+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480c143600 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.576+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f480c06c0c0 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.576+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4804013470 con 0x7f480c155040 2024-03-24T10:37:05.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.577+0000 7f48027fc640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f47f006b810 0x7f47f006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:05.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.577+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f480408a620 con 0x7f480c155040 2024-03-24T10:37:05.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.577+0000 7f4811b26640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f47f006b810 0x7f47f006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:05.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.577+0000 7f4811b26640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f47f006b810 0x7f47f006dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48080012e0 tx=0x7f4808009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:05.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.581+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4804054e70 con 0x7f480c155040 2024-03-24T10:37:05.792 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.792+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f480c143ae0 con 0x7f480c155040 2024-03-24T10:37:05.793 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.792+0000 7f48027fc640 1 -- 172.21.15.72:0/883934800 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f4804058530 con 0x7f480c155040 2024-03-24T10:37:05.793 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f47f006b810 msgr2=0x7f47f006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f47f006b810 0x7f47f006dcd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f48080012e0 tx=0x7f4808009040 comp rx=0 tx=0).stop 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 msgr2=0x7f480c0b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 0x7f480c0b5300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f480400e930 tx=0x7f480400edf0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 shutdown_connections 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f47f006b810 0x7f47f006dcd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f480c155040 0x7f480c0b5300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f480c0ae570 0x7f480c157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 --2- 172.21.15.72:0/883934800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f480c071d80 0x7f480c1420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 >> 172.21.15.72:0/883934800 conn(0x7f480c06b310 msgr2=0x7f480c161980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 shutdown_connections 2024-03-24T10:37:05.796 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:05.794+0000 7f4813d8a640 1 -- 172.21.15.72:0/883934800 wait complete. 2024-03-24T10:37:05.805 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-24T10:37:05.805 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi079.front.sepia.ceph.com 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:37:05.806 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-24T10:37:05.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:05.807 DEBUG:teuthology.orchestra.run.smithi079:> ip addr 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6a brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f0 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:d8:a1:6b brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: altname enp7s0f1 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:86 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether 0c:c4:7a:8f:ce:87 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: inet 172.21.15.79/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft 42630sec preferred_lft 42630sec 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::ec4:7aff:fe8f:ce87/64 scope link 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:8a:4f:e1:e0:b4 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::2473:75ff:fefe:c039/64 scope link 2024-03-24T10:37:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:05.825 INFO:teuthology.orchestra.run.smithi079.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-24T10:37:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether aa:8a:4f:e1:e0:b4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-24T10:37:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::a88a:4fff:fee1:e0b4/64 scope link tentative 2024-03-24T10:37:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:05.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:05.825 DEBUG:teuthology.orchestra.run.smithi079:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:37:05.889 INFO:teuthology.orchestra.run.smithi079.stdout:1 2024-03-24T10:37:05.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:05.891 DEBUG:teuthology.orchestra.run.smithi079:> route 2024-03-24T10:37:05.947 INFO:teuthology.orchestra.run.smithi079.stdout:Kernel IP routing table 2024-03-24T10:37:05.947 INFO:teuthology.orchestra.run.smithi079.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:37:05.947 INFO:teuthology.orchestra.run.smithi079.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:37:05.947 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:37:05.947 INFO:teuthology.orchestra.run.smithi079.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:37:05.948 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:05.948 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:05.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:37:05.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:37:05.948 DEBUG:teuthology.orchestra.run.smithi079:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:37:05.948 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:06.034 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:06.077 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:06.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:06.084 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list 2024-03-24T10:37:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-24T10:37:06.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:06.099 DEBUG:teuthology.orchestra.run.smithi079:> ip netns list-id 2024-03-24T10:37:06.154 INFO:teuthology.orchestra.run.smithi079.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-24T10:37:06.154 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:06.154 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:06.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-24T10:37:06.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-24T10:37:06.155 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:06.244 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:06.272 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:06.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:06.279 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:10:fe:82:cb:92 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.305 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e410:feff:fe82:cb92/64 scope link 2024-03-24T10:37:06.306 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:06.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: link/ether e6:10:fe:82:cb:92 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: inet6 fe80::e410:feff:fe82:cb92/64 scope link 2024-03-24T10:37:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:06.377 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-24T10:37:06.378 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:06.466 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:06.538 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:06.547 DEBUG:teuthology.orchestra.run.smithi079:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:06.547 DEBUG:teuthology.orchestra.run.smithi079:> set -e 2024-03-24T10:37:06.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set brx.1 up 2024-03-24T10:37:06.547 DEBUG:teuthology.orchestra.run.smithi079:> sudo ip link set dev brx.1 master ceph-brx 2024-03-24T10:37:06.547 DEBUG:teuthology.orchestra.run.smithi079:> ') 2024-03-24T10:37:06.595 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:06.628 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:06.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:06.634 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-24T10:37:06.662 INFO:teuthology.orchestra.run.smithi079.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-24T10:37:06.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:06.662 DEBUG:teuthology.orchestra.run.smithi079:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-24T10:37:06.716 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-24T10:37:06.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:06.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:06.800 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.79:3300,172.21.15.79:3301" 2024-03-24T10:37:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: trying mount with new device syntax: 3@0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.cephfs=/ 2024-03-24T10:37:06.808 INFO:teuthology.orchestra.run.smithi079.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.72:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2024-03-24T10:37:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-24T10:37:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: You just mounted a file system that supports labels which does not 2024-03-24T10:37:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-24T10:37:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: applications will generate AVC messages and not be allowed access to 2024-03-24T10:37:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-24T10:37:06.811 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:37:06.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:06.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-24T10:37:06.842 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:06.933 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:06.934 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:06.937 INFO:teuthology.orchestra.run.smithi079.stdout:client4876 2024-03-24T10:37:06.938 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:06.938 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:06.953 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:07.040 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:07.042 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:07.047 INFO:teuthology.orchestra.run.smithi079.stdout:client4876 2024-03-24T10:37:07.048 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:07.095 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:07.096 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:07.102 INFO:teuthology.orchestra.run.smithi079.stdout:client4876 2024-03-24T10:37:07.102 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.client4876/status') 2024-03-24T10:37:07.151 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:07.163 INFO:teuthology.orchestra.run.smithi079.stdout:instance: client.4876 (3)192.168.0.2:0/2709546993 2024-03-24T10:37:07.163 INFO:teuthology.orchestra.run.smithi079.stdout:blocklisted: false 2024-03-24T10:37:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records in 2024-03-24T10:37:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:0+1 records out 2024-03-24T10:37:07.163 INFO:teuthology.orchestra.run.smithi079.stderr:69 bytes copied, 1.9911e-05 s, 3.5 MB/s 2024-03-24T10:37:07.164 INFO:teuthology.orchestra.run.smithi079.stderr:2024-03-24T10:37:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:07.170 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-24T10:37:07.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:07.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.299+0000 7fcec122a640 1 Processor -- start 2024-03-24T10:37:07.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.299+0000 7fcec122a640 1 -- start start 2024-03-24T10:37:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcec122a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 0x7fcebc071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcec122a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 0x7fcebc0ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcec122a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcebc0715f0 con 0x7fcebc071050 2024-03-24T10:37:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcec122a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcebc071d90 con 0x7fcebc06d570 2024-03-24T10:37:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcec122a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc0b4d80 con 0x7fcebc0acf90 2024-03-24T10:37:07.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 0x7fcebc0ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 0x7fcebc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 0x7fcebc0ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:48288/0 (socket says 172.21.15.72:48288) 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 0x7fcebc071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47100/0 (socket says 172.21.15.72:47100) 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 -- 172.21.15.72:0/1327915861 learned_addr learned my addr 172.21.15.72:0/1327915861 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fceb3fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fcebc071050 0x7fcebc06d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:42810/0 (socket says 172.21.15.72:42810) 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fceba59c640 1 -- 172.21.15.72:0/1327915861 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527348483 0 0) 0x7fcebc0715f0 con 0x7fcebc071050 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fceba59c640 1 -- 172.21.15.72:0/1327915861 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcea8003520 con 0x7fcebc071050 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 -- 172.21.15.72:0/1327915861 >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 msgr2=0x7fcebc071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 --2- 172.21.15.72:0/1327915861 >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 0x7fcebc071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 -- 172.21.15.72:0/1327915861 >> v1:172.21.15.79:6789/0 conn(0x7fcebc071050 legacy=0x7fcebc06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebb59e640 1 -- 172.21.15.72:0/1327915861 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc0b3d60 con 0x7fcebc0acf90 2024-03-24T10:37:07.302 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.300+0000 7fcebad9d640 1 --2- 172.21.15.72:0/1327915861 >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 0x7fcebc071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.301+0000 7fcebb59e640 1 --2- 172.21.15.72:0/1327915861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 0x7fcebc0ad420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fceb400af60 tx=0x7fceb402d070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91aa7842d6d36d54 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.301+0000 7fceba59c640 1 -- 172.21.15.72:0/1327915861 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb402da10 con 0x7fcebc0acf90 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.301+0000 7fceba59c640 1 -- 172.21.15.72:0/1327915861 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb402db70 con 0x7fcebc0acf90 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.301+0000 7fceba59c640 1 -- 172.21.15.72:0/1327915861 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb4008500 con 0x7fcebc0acf90 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 -- 172.21.15.72:0/1327915861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 msgr2=0x7fcebc0ad420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 --2- 172.21.15.72:0/1327915861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 0x7fcebc0ad420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fceb400af60 tx=0x7fceb402d070 comp rx=0 tx=0).stop 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 -- 172.21.15.72:0/1327915861 shutdown_connections 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 --2- 172.21.15.72:0/1327915861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc0acf90 0x7fcebc0ad420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 --2- 172.21.15.72:0/1327915861 >> v2:172.21.15.79:3300/0 conn(0x7fcebc06d570 0x7fcebc071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 -- 172.21.15.72:0/1327915861 >> 172.21.15.72:0/1327915861 conn(0x7fcebc0b1920 msgr2=0x7fcebc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 -- 172.21.15.72:0/1327915861 shutdown_connections 2024-03-24T10:37:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.302+0000 7fcec122a640 1 -- 172.21.15.72:0/1327915861 wait complete. 2024-03-24T10:37:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.303+0000 7fcec122a640 1 Processor -- start 2024-03-24T10:37:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.303+0000 7fcec122a640 1 -- start start 2024-03-24T10:37:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcec122a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcebc06d570 0x7fcebc09cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcec122a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc071050 0x7fcebc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcec122a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 0x7fcebc156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcec122a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0c9910 con 0x7fcebc0acf90 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcec122a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0c9bf0 con 0x7fcebc06d570 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcec122a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc0c9ed0 con 0x7fcebc071050 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcebb59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 0x7fcebc156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fceb3fff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc071050 0x7fcebc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcebb59e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 0x7fcebc156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41472/0 (socket says 172.21.15.72:41472) 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcebb59e640 1 -- 172.21.15.72:0/1047090083 learned_addr learned my addr 172.21.15.72:0/1047090083 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.304+0000 7fcebad9d640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcebc06d570 0x7fcebc09cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb3fff640 1 -- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcebc06d570 msgr2=0x7fcebc09cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb3fff640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcebc06d570 0x7fcebc09cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb3fff640 1 -- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 msgr2=0x7fcebc156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb3fff640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 0x7fcebc156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb3fff640 1 -- 172.21.15.72:0/1047090083 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac009400 con 0x7fcebc071050 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fcebb59e640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 0x7fcebc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:07.308 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb3fff640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc071050 0x7fcebc0c8fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcea400c390 tx=0x7fcea4001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea40074e0 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea4007640 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceb400ac40 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4004a00 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.305+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc0ca490 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.306+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcebc067b80 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.307+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcea4004b60 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.307+0000 7fceb37fe640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fce9c06b810 0x7fce9c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.307+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6735+0+0 (secure 0 0 0) 0x7fcea4089db0 con 0x7fcebc071050 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.307+0000 7fcebad9d640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fce9c06b810 0x7fce9c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.307+0000 7fcebad9d640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fce9c06b810 0x7fce9c06dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ca870 tx=0x7fceac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.316+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcea4057fb0 con 0x7fcebc071050 2024-03-24T10:37:07.497 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.496+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcebc09e080 con 0x7fcebc071050 2024-03-24T10:37:07.498 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.498+0000 7fceb37fe640 1 -- 172.21.15.72:0/1047090083 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7fcea4057b40 con 0x7fcebc071050 2024-03-24T10:37:07.498 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:07.499 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:07.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fce9c06b810 msgr2=0x7fce9c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fce9c06b810 0x7fce9c06dcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcebc0ca870 tx=0x7fceac009190 comp rx=0 tx=0).stop 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc071050 msgr2=0x7fcebc0c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc071050 0x7fcebc0c8fa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcea400c390 tx=0x7fcea4001e70 comp rx=0 tx=0).stop 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 shutdown_connections 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fce9c06b810 0x7fce9c06dcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcebc0acf90 0x7fcebc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcebc071050 0x7fcebc0c8fa0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 --2- 172.21.15.72:0/1047090083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcebc06d570 0x7fcebc09cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 >> 172.21.15.72:0/1047090083 conn(0x7fcebc0b1920 msgr2=0x7fcebc0ad880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 shutdown_connections 2024-03-24T10:37:07.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.500+0000 7fcec122a640 1 -- 172.21.15.72:0/1047090083 wait complete. 2024-03-24T10:37:07.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:07.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 Processor -- start 2024-03-24T10:37:07.616 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 -- start start 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1b140b3580 0x7f1b140cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1415b480 0x7f1b1406d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b14154ea0 con 0x7f1b14072470 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1b14071460 con 0x7f1b1415b480 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.616+0000 7f1b1ad13640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1b14071fe0 con 0x7f1b140b3580 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1415b480 0x7f1b1406d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b1415b480 0x7f1b1406d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41486/0 (socket says 172.21.15.72:41486) 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 -- 172.21.15.72:0/3487415434 learned_addr learned my addr 172.21.15.72:0/3487415434 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b18aaf640 1 --2- 172.21.15.72:0/3487415434 >> v2:172.21.15.79:3300/0 conn(0x7f1b140b3580 0x7f1b140cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 -- 172.21.15.72:0/3487415434 >> v2:172.21.15.79:3300/0 conn(0x7f1b140b3580 msgr2=0x7f1b140cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 --2- 172.21.15.72:0/3487415434 >> v2:172.21.15.79:3300/0 conn(0x7f1b140b3580 0x7f1b140cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 -- 172.21.15.72:0/3487415434 >> v1:172.21.15.79:6789/0 conn(0x7f1b14072470 legacy=0x7f1b140b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.617+0000 7f1b192b0640 1 -- 172.21.15.72:0/3487415434 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b1415b910 con 0x7f1b1415b480 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b192b0640 1 --2- 172.21.15.72:0/3487415434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1415b480 0x7f1b1406d550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b140b2890 tx=0x7f1b0c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924b874b70131fee server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b137fe640 1 -- 172.21.15.72:0/3487415434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c02ca80 con 0x7f1b1415b480 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b137fe640 1 -- 172.21.15.72:0/3487415434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b0c02cbe0 con 0x7f1b1415b480 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b137fe640 1 -- 172.21.15.72:0/3487415434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c0343f0 con 0x7f1b1415b480 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 -- 172.21.15.72:0/3487415434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1415b480 msgr2=0x7f1b1406d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/3487415434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1415b480 0x7f1b1406d550 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1b140b2890 tx=0x7f1b0c02bee0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 -- 172.21.15.72:0/3487415434 shutdown_connections 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/3487415434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1415b480 0x7f1b1406d550 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/3487415434 >> v2:172.21.15.79:3300/0 conn(0x7f1b140b3580 0x7f1b140cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 -- 172.21.15.72:0/3487415434 >> 172.21.15.72:0/3487415434 conn(0x7f1b140b1810 msgr2=0x7f1b140b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 -- 172.21.15.72:0/3487415434 shutdown_connections 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.618+0000 7f1b1ad13640 1 -- 172.21.15.72:0/3487415434 wait complete. 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.619+0000 7f1b1ad13640 1 Processor -- start 2024-03-24T10:37:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 -- start start 2024-03-24T10:37:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b14072470 0x7f1b1414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 0x7f1b141f2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1b1415b480 0x7f1b1415a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1414eaf0 con 0x7f1b140b3580 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1b1414edd0 con 0x7f1b14072470 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b1ad13640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1b1414f0b0 con 0x7f1b1415b480 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 0x7f1b141f2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b13fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 0x7f1b141f2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41496/0 (socket says 172.21.15.72:41496) 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.620+0000 7f1b13fff640 1 -- 172.21.15.72:0/2366247168 learned_addr learned my addr 172.21.15.72:0/2366247168 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b18aaf640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b14072470 0x7f1b1414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b192b0640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1b1415b480 0x7f1b1415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b13fff640 1 -- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1b1415b480 msgr2=0x7f1b1415a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b13fff640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1b1415b480 0x7f1b1415a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b13fff640 1 -- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b14072470 msgr2=0x7f1b1414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b13fff640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b14072470 0x7f1b1414e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b13fff640 1 -- 172.21.15.72:0/2366247168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c009b30 con 0x7f1b140b3580 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b18aaf640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b14072470 0x7f1b1414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:07.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b13fff640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 0x7f1b141f2890 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00c440 tx=0x7f1afc00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc0052d0 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1afc005430 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b1414f390 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc007260 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.621+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b14149860 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.622+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b141f3260 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.623+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1afc0073c0 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.623+0000 7f1b117fa640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1af406b810 0x7f1af406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.623+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1afc0897e0 con 0x7f1b140b3580 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.623+0000 7f1b18aaf640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1af406b810 0x7f1af406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.623+0000 7f1b18aaf640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1af406b810 0x7f1af406dcd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009e90 tx=0x7f1b04009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.627+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1b141f3260 con 0x7f1b140b3580 2024-03-24T10:37:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.800+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b141f3260 con 0x7f1b140b3580 2024-03-24T10:37:07.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.800+0000 7f1b117fa640 1 -- 172.21.15.72:0/2366247168 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f1b141f3260 con 0x7f1b140b3580 2024-03-24T10:37:07.801 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.802+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1af406b810 msgr2=0x7f1af406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.802+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1af406b810 0x7f1af406dcd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b04009e90 tx=0x7f1b04009190 comp rx=0 tx=0).stop 2024-03-24T10:37:07.803 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.802+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 msgr2=0x7f1b141f2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.802+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 0x7f1b141f2890 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00c440 tx=0x7f1afc00c900 comp rx=0 tx=0).stop 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 shutdown_connections 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1af406b810 0x7f1af406dcd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1b1415b480 0x7f1b1415a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b140b3580 0x7f1b141f2890 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 --2- 172.21.15.72:0/2366247168 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1b14072470 0x7f1b1414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 >> 172.21.15.72:0/2366247168 conn(0x7f1b140b1810 msgr2=0x7f1b1406dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 shutdown_connections 2024-03-24T10:37:07.804 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.803+0000 7f1b1ad13640 1 -- 172.21.15.72:0/2366247168 wait complete. 2024-03-24T10:37:07.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:07.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 Processor -- start 2024-03-24T10:37:07.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 -- start start 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda980b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda9815f440 0x7fda98144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda980b30f0 con 0x7fda9806ecb0 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fda980b48a0 con 0x7fda9815f440 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.916+0000 7fda9dde2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda980b33d0 con 0x7fda9806e8d0 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda96ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda9806ecb0 0x7fda980b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59982/0 (socket says 172.21.15.72:59982) 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda96ffd640 1 -- 172.21.15.72:0/931506786 learned_addr learned my addr 172.21.15.72:0/931506786 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda977fe640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda980b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda97fff640 1 --2- 172.21.15.72:0/931506786 >> v2:172.21.15.79:3300/0 conn(0x7fda9815f440 0x7fda98144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda967fc640 1 -- 172.21.15.72:0/931506786 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3510525833 0 0) 0x7fda980b30f0 con 0x7fda9806ecb0 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda967fc640 1 -- 172.21.15.72:0/931506786 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda80003520 con 0x7fda9806ecb0 2024-03-24T10:37:07.919 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda97fff640 1 -- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 msgr2=0x7fda980b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda97fff640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda980b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda97fff640 1 -- 172.21.15.72:0/931506786 >> v1:172.21.15.72:6789/0 conn(0x7fda9806ecb0 legacy=0x7fda980b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda97fff640 1 -- 172.21.15.72:0/931506786 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda980b36b0 con 0x7fda9815f440 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.917+0000 7fda977fe640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda980b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda97fff640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda98144030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda90009d90 tx=0x7fda9002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3713d5ce1224f357 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda967fc640 1 -- 172.21.15.72:0/931506786 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9002cbc0 con 0x7fda9815f440 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda967fc640 1 -- 172.21.15.72:0/931506786 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9002cd20 con 0x7fda9815f440 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda967fc640 1 -- 172.21.15.72:0/931506786 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda90034640 con 0x7fda9815f440 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 -- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 msgr2=0x7fda98144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda98144030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fda90009d90 tx=0x7fda9002be10 comp rx=0 tx=0).stop 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 -- 172.21.15.72:0/931506786 shutdown_connections 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda98144030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 --2- 172.21.15.72:0/931506786 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda980b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 -- 172.21.15.72:0/931506786 >> 172.21.15.72:0/931506786 conn(0x7fda980b1810 msgr2=0x7fda980b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:07.920 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 -- 172.21.15.72:0/931506786 shutdown_connections 2024-03-24T10:37:07.921 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.918+0000 7fda9dde2640 1 -- 172.21.15.72:0/931506786 wait complete. 2024-03-24T10:37:07.922 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 Processor -- start 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 -- start start 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda9815a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 0x7fda98140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda9813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fda98140360 con 0x7fda9806ecb0 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda9813ca00 con 0x7fda9815f440 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.920+0000 7fda9dde2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda9815a840 con 0x7fda9806e8d0 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 0x7fda98140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda97fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda9813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda977fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda9815a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 0x7fda98140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41504/0 (socket says 172.21.15.72:41504) 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 -- 172.21.15.72:0/230694740 learned_addr learned my addr 172.21.15.72:0/230694740 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 -- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 msgr2=0x7fda9815a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda9815a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 -- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 msgr2=0x7fda9813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda9813e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 -- 172.21.15.72:0/230694740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda88009400 con 0x7fda9806ecb0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda97fff640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda9813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda96ffd640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 0x7fda98140780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c430 tx=0x7fda8c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c005ce0 con 0x7fda9806ecb0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c005e40 con 0x7fda9806ecb0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda90009a70 con 0x7fda9806ecb0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c0072f0 con 0x7fda9806ecb0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.921+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9813f6e0 con 0x7fda9806ecb0 2024-03-24T10:37:07.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.922+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda981404a0 con 0x7fda9806ecb0 2024-03-24T10:37:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.923+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fda8c007450 con 0x7fda9806ecb0 2024-03-24T10:37:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.923+0000 7fda7ffff640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda8406b810 0x7fda8406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.923+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fda8c089b90 con 0x7fda9806ecb0 2024-03-24T10:37:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.923+0000 7fda977fe640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda8406b810 0x7fda8406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:07.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.923+0000 7fda977fe640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda8406b810 0x7fda8406dcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda88009cd0 tx=0x7fda88009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:07.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:07.927+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fda981404a0 con 0x7fda9806ecb0 2024-03-24T10:37:08.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.100+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fda981404a0 con 0x7fda9806ecb0 2024-03-24T10:37:08.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.100+0000 7fda7ffff640 1 -- 172.21.15.72:0/230694740 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fda981404a0 con 0x7fda9806ecb0 2024-03-24T10:37:08.101 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda8406b810 msgr2=0x7fda8406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda8406b810 0x7fda8406dcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda88009cd0 tx=0x7fda88009190 comp rx=0 tx=0).stop 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 msgr2=0x7fda98140780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 0x7fda98140780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00c430 tx=0x7fda8c00c8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 shutdown_connections 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda8406b810 0x7fda8406dcd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9815f440 0x7fda9813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.103 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9806ecb0 0x7fda98140780 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 --2- 172.21.15.72:0/230694740 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9806e8d0 0x7fda9815a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.102+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 >> 172.21.15.72:0/230694740 conn(0x7fda980b1810 msgr2=0x7fda9815e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.103+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 shutdown_connections 2024-03-24T10:37:08.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.103+0000 7fda9dde2640 1 -- 172.21.15.72:0/230694740 wait complete. 2024-03-24T10:37:08.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:08.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.216+0000 7f62d029d640 1 Processor -- start 2024-03-24T10:37:08.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.217+0000 7f62d029d640 1 -- start start 2024-03-24T10:37:08.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.217+0000 7f62d029d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c80d2b20 0x7f62c80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.217+0000 7f62d029d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62c80d0f70 0x7f62c80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.217+0000 7f62d029d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c80d4950 con 0x7f62c815e240 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.217+0000 7f62d029d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f62c80d2270 con 0x7f62c80d0f70 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62d029d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f62c80b38c0 con 0x7f62c80d2b20 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62c80d0f70 0x7f62c80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62c80d0f70 0x7f62c80cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41506/0 (socket says 172.21.15.72:41506) 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce039640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f62c815e240 0x7f62c80d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59992/0 (socket says 172.21.15.72:59992) 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 -- 172.21.15.72:0/1281029235 learned_addr learned my addr 172.21.15.72:0/1281029235 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62cd838640 1 --2- 172.21.15.72:0/1281029235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c80d2b20 0x7f62c80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 -- 172.21.15.72:0/1281029235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c80d2b20 msgr2=0x7f62c80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 --2- 172.21.15.72:0/1281029235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c80d2b20 0x7f62c80cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 -- 172.21.15.72:0/1281029235 >> v1:172.21.15.72:6789/0 conn(0x7f62c815e240 legacy=0x7f62c80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62cd037640 1 -- 172.21.15.72:0/1281029235 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649875669 0 0) 0x7f62c80d4950 con 0x7f62c815e240 2024-03-24T10:37:08.220 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.218+0000 7f62ce83a640 1 -- 172.21.15.72:0/1281029235 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c80b3550 con 0x7f62c80d0f70 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62ce83a640 1 --2- 172.21.15.72:0/1281029235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d0f70 0x7f62c80cef80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009e50 tx=0x7f62c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66f3823a5e433ad server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62cd037640 1 -- 172.21.15.72:0/1281029235 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c002ca70 con 0x7f62c80d0f70 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62cd037640 1 -- 172.21.15.72:0/1281029235 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c002cbd0 con 0x7f62c80d0f70 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62cd037640 1 -- 172.21.15.72:0/1281029235 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c00343f0 con 0x7f62c80d0f70 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62d029d640 1 -- 172.21.15.72:0/1281029235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d0f70 msgr2=0x7f62c80cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62d029d640 1 --2- 172.21.15.72:0/1281029235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d0f70 0x7f62c80cef80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f62c0009e50 tx=0x7f62c002bed0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62d029d640 1 -- 172.21.15.72:0/1281029235 shutdown_connections 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62d029d640 1 --2- 172.21.15.72:0/1281029235 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d0f70 0x7f62c80cef80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62d029d640 1 --2- 172.21.15.72:0/1281029235 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c80d2b20 0x7f62c80cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.221 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.219+0000 7f62d029d640 1 -- 172.21.15.72:0/1281029235 >> 172.21.15.72:0/1281029235 conn(0x7f62c80d3e30 msgr2=0x7f62c80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.220+0000 7f62d029d640 1 -- 172.21.15.72:0/1281029235 shutdown_connections 2024-03-24T10:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.220+0000 7f62d029d640 1 -- 172.21.15.72:0/1281029235 wait complete. 2024-03-24T10:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 Processor -- start 2024-03-24T10:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 -- start start 2024-03-24T10:37:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c80d0f70 0x7f62c80c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 0x7f62c814ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c815e240 0x7f62c814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f62c80b97c0 con 0x7f62c80d2b20 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f62c80ca530 con 0x7f62c80d0f70 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62d029d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f62c80ca790 con 0x7f62c815e240 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62cd838640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 0x7f62c814ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62cd838640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 0x7f62c814ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41508/0 (socket says 172.21.15.72:41508) 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.221+0000 7f62cd838640 1 -- 172.21.15.72:0/590466588 learned_addr learned my addr 172.21.15.72:0/590466588 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62ce039640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c80d0f70 0x7f62c80c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62ce83a640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c815e240 0x7f62c814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62cd838640 1 -- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c815e240 msgr2=0x7f62c814d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62cd838640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c815e240 0x7f62c814d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62cd838640 1 -- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c80d0f70 msgr2=0x7f62c80c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.225 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62cd838640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c80d0f70 0x7f62c80c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62cd838640 1 -- 172.21.15.72:0/590466588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c0009b30 con 0x7f62c80d2b20 2024-03-24T10:37:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62cd838640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 0x7f62c814ce30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62b800e870 tx=0x7f62b800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b8009510 con 0x7f62c80d2b20 2024-03-24T10:37:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b800eec0 con 0x7f62c80d2b20 2024-03-24T10:37:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c8160b80 con 0x7f62c80d2b20 2024-03-24T10:37:08.226 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b800cb80 con 0x7f62c80d2b20 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.222+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c8161140 con 0x7f62c80d2b20 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.223+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c804f470 con 0x7f62c80d2b20 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.223+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f62b800cce0 con 0x7f62c80d2b20 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.224+0000 7f62beffd640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f62ac06b810 0x7f62ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.224+0000 7f62ce039640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f62ac06b810 0x7f62ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.224+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f62b808a640 con 0x7f62c80d2b20 2024-03-24T10:37:08.227 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.224+0000 7f62ce039640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f62ac06b810 0x7f62ac06dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f62c4000f60 tx=0x7f62c4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.228 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.228+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f62b8054d10 con 0x7f62c80d2b20 2024-03-24T10:37:08.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.402+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f62c815d820 con 0x7f62c80d2b20 2024-03-24T10:37:08.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.403+0000 7f62beffd640 1 -- 172.21.15.72:0/590466588 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f62b80583d0 con 0x7f62c80d2b20 2024-03-24T10:37:08.405 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:08.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f62ac06b810 msgr2=0x7f62ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f62ac06b810 0x7f62ac06dcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f62c4000f60 tx=0x7f62c4007d50 comp rx=0 tx=0).stop 2024-03-24T10:37:08.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 msgr2=0x7f62c814ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 0x7f62c814ce30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f62b800e870 tx=0x7f62b800ec70 comp rx=0 tx=0).stop 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 shutdown_connections 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f62ac06b810 0x7f62ac06dcd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f62c815e240 0x7f62c814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62c80d2b20 0x7f62c814ce30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 --2- 172.21.15.72:0/590466588 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f62c80d0f70 0x7f62c80c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.404+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 >> 172.21.15.72:0/590466588 conn(0x7f62c80d3e30 msgr2=0x7f62c806c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.405+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 shutdown_connections 2024-03-24T10:37:08.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.405+0000 7f62d029d640 1 -- 172.21.15.72:0/590466588 wait complete. 2024-03-24T10:37:08.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.519+0000 7f0003c9a640 1 Processor -- start 2024-03-24T10:37:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.520+0000 7f0003c9a640 1 -- start start 2024-03-24T10:37:08.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.520+0000 7f0003c9a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efffc0d0f70 0x7efffc0cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.520+0000 7f0003c9a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efffc0d4950 con 0x7efffc0d2b20 2024-03-24T10:37:08.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.520+0000 7f0003c9a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efffc0b38c0 con 0x7efffc15e240 2024-03-24T10:37:08.521 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.520+0000 7f0003c9a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efffc0d2270 con 0x7efffc0d0f70 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0002237640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efffc0d0f70 0x7efffc0cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0002237640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efffc0d0f70 0x7efffc0cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41524/0 (socket says 172.21.15.72:41524) 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0002237640 1 -- 172.21.15.72:0/3471474600 learned_addr learned my addr 172.21.15.72:0/3471474600 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0001235640 1 --1- 172.21.15.72:0/3471474600 >> v1:172.21.15.72:6789/0 conn(0x7efffc0d2b20 0x7efffc0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60002/0 (socket says 172.21.15.72:60002) 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0002237640 1 -- 172.21.15.72:0/3471474600 >> v1:172.21.15.79:6789/0 conn(0x7efffc15e240 legacy=0x7efffc0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0002237640 1 -- 172.21.15.72:0/3471474600 >> v1:172.21.15.72:6789/0 conn(0x7efffc0d2b20 legacy=0x7efffc0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0002237640 1 -- 172.21.15.72:0/3471474600 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efffc0b3550 con 0x7efffc0d0f70 2024-03-24T10:37:08.522 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.521+0000 7f0000a34640 1 -- 172.21.15.72:0/3471474600 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282575877 0 0) 0x7efffc0d4950 con 0x7efffc0d2b20 2024-03-24T10:37:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0002237640 1 --2- 172.21.15.72:0/3471474600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d0f70 0x7efffc0cf150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efff4009e50 tx=0x7efff402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a848aa13d7bee6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0000a34640 1 -- 172.21.15.72:0/3471474600 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff402cb20 con 0x7efffc0d0f70 2024-03-24T10:37:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0000a34640 1 -- 172.21.15.72:0/3471474600 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff402cc80 con 0x7efffc0d0f70 2024-03-24T10:37:08.523 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0000a34640 1 -- 172.21.15.72:0/3471474600 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff40343f0 con 0x7efffc0d0f70 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 -- 172.21.15.72:0/3471474600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d0f70 msgr2=0x7efffc0cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 --2- 172.21.15.72:0/3471474600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d0f70 0x7efffc0cf150 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efff4009e50 tx=0x7efff402bf80 comp rx=0 tx=0).stop 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 -- 172.21.15.72:0/3471474600 shutdown_connections 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 --2- 172.21.15.72:0/3471474600 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d0f70 0x7efffc0cf150 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 -- 172.21.15.72:0/3471474600 >> 172.21.15.72:0/3471474600 conn(0x7efffc0d3e30 msgr2=0x7efffc0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 -- 172.21.15.72:0/3471474600 shutdown_connections 2024-03-24T10:37:08.524 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.522+0000 7f0003c9a640 1 -- 172.21.15.72:0/3471474600 wait complete. 2024-03-24T10:37:08.526 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.523+0000 7f0003c9a640 1 Processor -- start 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 -- start start 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efffc0d0f70 0x7efffc1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 0x7efffc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efffc15e240 0x7efffc0cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efffc1603f0 con 0x7efffc0d2b20 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efffc153900 con 0x7efffc0d0f70 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0003c9a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efffc15f7e0 con 0x7efffc15e240 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0001235640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 0x7efffc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0001235640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 0x7efffc0c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41526/0 (socket says 172.21.15.72:41526) 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0001235640 1 -- 172.21.15.72:0/4035078427 learned_addr learned my addr 172.21.15.72:0/4035078427 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0002237640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efffc15e240 0x7efffc0cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.524+0000 7f0001a36640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efffc0d0f70 0x7efffc1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0001235640 1 -- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efffc15e240 msgr2=0x7efffc0cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0001235640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efffc15e240 0x7efffc0cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.527 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0001235640 1 -- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efffc0d0f70 msgr2=0x7efffc1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0001235640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efffc0d0f70 0x7efffc1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0001235640 1 -- 172.21.15.72:0/4035078427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff4009b30 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0002237640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efffc15e240 0x7efffc0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0001235640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 0x7efffc0c82e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efff800c4d0 tx=0x7efff800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff80074e0 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff8007640 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efffc15fac0 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff8004a20 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.525+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efffc160080 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.526+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efffc04f470 con 0x7efffc0d2b20 2024-03-24T10:37:08.528 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.526+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efff8004b80 con 0x7efffc0d2b20 2024-03-24T10:37:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.527+0000 7effee7fc640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7effe006b810 0x7effe006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.527+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efff80899f0 con 0x7efffc0d2b20 2024-03-24T10:37:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.527+0000 7f0001a36640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7effe006b810 0x7effe006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.527+0000 7f0001a36640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7effe006b810 0x7effe006dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efff0000f60 tx=0x7efff0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.531+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efff80540c0 con 0x7efffc0d2b20 2024-03-24T10:37:08.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.700+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7efffc0d0540 con 0x7efffc0d2b20 2024-03-24T10:37:08.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.701+0000 7effee7fc640 1 -- 172.21.15.72:0/4035078427 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7efff8057780 con 0x7efffc0d2b20 2024-03-24T10:37:08.701 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7effe006b810 msgr2=0x7effe006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7effe006b810 0x7effe006dcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efff0000f60 tx=0x7efff0009040 comp rx=0 tx=0).stop 2024-03-24T10:37:08.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 msgr2=0x7efffc0c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 0x7efffc0c82e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efff800c4d0 tx=0x7efff800c990 comp rx=0 tx=0).stop 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 shutdown_connections 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7effe006b810 0x7effe006dcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efffc15e240 0x7efffc0cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efffc0d2b20 0x7efffc0c82e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 --2- 172.21.15.72:0/4035078427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efffc0d0f70 0x7efffc1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 >> 172.21.15.72:0/4035078427 conn(0x7efffc0d3e30 msgr2=0x7efffc15d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 shutdown_connections 2024-03-24T10:37:08.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.703+0000 7f0003c9a640 1 -- 172.21.15.72:0/4035078427 wait complete. 2024-03-24T10:37:08.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:08.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 Processor -- start 2024-03-24T10:37:08.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 -- start start 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d1415e170 0x7f9d1415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d140d2450 0x7f9d140b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d140d4e50 con 0x7f9d140d4930 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9d140cf790 con 0x7f9d1415e170 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.816+0000 7f9d19c15640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9d140cfa70 con 0x7f9d140d2450 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d1415e170 0x7f9d1415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.818 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d1415e170 0x7f9d1415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41528/0 (socket says 172.21.15.72:41528) 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 -- 172.21.15.72:0/4044807414 learned_addr learned my addr 172.21.15.72:0/4044807414 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d13fff640 1 --2- 172.21.15.72:0/4044807414 >> v2:172.21.15.79:3300/0 conn(0x7f9d140d2450 0x7f9d140b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 -- 172.21.15.72:0/4044807414 >> v2:172.21.15.79:3300/0 conn(0x7f9d140d2450 msgr2=0x7f9d140b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 --2- 172.21.15.72:0/4044807414 >> v2:172.21.15.79:3300/0 conn(0x7f9d140d2450 0x7f9d140b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 -- 172.21.15.72:0/4044807414 >> v1:172.21.15.79:6789/0 conn(0x7f9d140d4930 legacy=0x7f9d140d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.817+0000 7f9d137fe640 1 -- 172.21.15.72:0/4044807414 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d140cfd50 con 0x7f9d1415e170 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d137fe640 1 --2- 172.21.15.72:0/4044807414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d1415e170 0x7f9d1415e550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d140ce640 tx=0x7f9d0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c313d61b8a6fe07 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d12ffd640 1 -- 172.21.15.72:0/4044807414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04031870 con 0x7f9d1415e170 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d12ffd640 1 -- 172.21.15.72:0/4044807414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d040319d0 con 0x7f9d1415e170 2024-03-24T10:37:08.819 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d12ffd640 1 -- 172.21.15.72:0/4044807414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04031d60 con 0x7f9d1415e170 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 -- 172.21.15.72:0/4044807414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d1415e170 msgr2=0x7f9d1415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 --2- 172.21.15.72:0/4044807414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d1415e170 0x7f9d1415e550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d140ce640 tx=0x7f9d0402b910 comp rx=0 tx=0).stop 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 -- 172.21.15.72:0/4044807414 shutdown_connections 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 --2- 172.21.15.72:0/4044807414 >> v2:172.21.15.79:3300/0 conn(0x7f9d140d2450 0x7f9d140b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 --2- 172.21.15.72:0/4044807414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d1415e170 0x7f9d1415e550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 -- 172.21.15.72:0/4044807414 >> 172.21.15.72:0/4044807414 conn(0x7f9d1409d310 msgr2=0x7f9d140d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:08.822 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 -- 172.21.15.72:0/4044807414 shutdown_connections 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.818+0000 7f9d19c15640 1 -- 172.21.15.72:0/4044807414 wait complete. 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.819+0000 7f9d19c15640 1 Processor -- start 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 -- start start 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140d2450 0x7f9d14158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 0x7f9d140cba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d1415e170 0x7f9d141571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9d140b6c20 con 0x7f9d140d4930 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d140b6f00 con 0x7f9d140d2450 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d19c15640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9d140b71e0 con 0x7f9d1415e170 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d0affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 0x7f9d140cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d0affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 0x7f9d140cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41540/0 (socket says 172.21.15.72:41540) 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d0affd640 1 -- 172.21.15.72:0/2587858003 learned_addr learned my addr 172.21.15.72:0/2587858003 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d13fff640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d1415e170 0x7f9d141571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.823 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.820+0000 7f9d137fe640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140d2450 0x7f9d14158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d0affd640 1 -- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d1415e170 msgr2=0x7f9d141571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d0affd640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d1415e170 0x7f9d141571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d0affd640 1 -- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140d2450 msgr2=0x7f9d14158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d0affd640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140d2450 0x7f9d14158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d0affd640 1 -- 172.21.15.72:0/2587858003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d040094d0 con 0x7f9d140d4930 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d0affd640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 0x7f9d140cba40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c400 tx=0x7f9cfc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc0052d0 con 0x7f9d140d4930 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cfc005450 con 0x7f9d140d4930 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d140b74c0 con 0x7f9d140d4930 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc007260 con 0x7f9d140d4930 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.821+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d140cc290 con 0x7f9d140d4930 2024-03-24T10:37:08.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.822+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d140b3f80 con 0x7f9d140d4930 2024-03-24T10:37:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.822+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9cfc0073c0 con 0x7f9d140d4930 2024-03-24T10:37:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.823+0000 7f9d10ff9640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9cf406b810 0x7f9cf406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.823+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9cfc0898e0 con 0x7f9d140d4930 2024-03-24T10:37:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.823+0000 7f9d137fe640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9cf406b810 0x7f9cf406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:08.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.823+0000 7f9d137fe640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9cf406b810 0x7f9cf406dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d04036000 tx=0x7f9d0403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:08.827 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.827+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9cfc054040 con 0x7f9d140d4930 2024-03-24T10:37:09.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:08.999+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d140b6d60 con 0x7f9d140d4930 2024-03-24T10:37:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.000+0000 7f9d10ff9640 1 -- 172.21.15.72:0/2587858003 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f9d140b6d60 con 0x7f9d140d4930 2024-03-24T10:37:09.001 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:09.001 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9cf406b810 msgr2=0x7f9cf406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9cf406b810 0x7f9cf406dcd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9d04036000 tx=0x7f9d0403c040 comp rx=0 tx=0).stop 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 msgr2=0x7f9d140cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 0x7f9d140cba40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00c400 tx=0x7f9cfc00c8c0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 shutdown_connections 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9cf406b810 0x7f9cf406dcd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d1415e170 0x7f9d141571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d140d4930 0x7f9d140cba40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 --2- 172.21.15.72:0/2587858003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d140d2450 0x7f9d14158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 >> 172.21.15.72:0/2587858003 conn(0x7f9d1409d310 msgr2=0x7f9d1406c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 shutdown_connections 2024-03-24T10:37:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.002+0000 7f9d19c15640 1 -- 172.21.15.72:0/2587858003 wait complete. 2024-03-24T10:37:09.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:09.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.117+0000 7fd190d77640 1 Processor -- start 2024-03-24T10:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.117+0000 7fd190d77640 1 -- start start 2024-03-24T10:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd190d77640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c142490 0x7fd18c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd190d77640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd18c0b2b10 0x7fd18c0cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd190d77640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd18c0ce1b0 0x7fd18c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd190d77640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd18c0b2f50 con 0x7fd18c0b2b10 2024-03-24T10:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd190d77640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd18c0b3210 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd190d77640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd18c0b34f0 con 0x7fd18c142490 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd189d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd18c0b2b10 0x7fd18c0cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd189d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd18c0b2b10 0x7fd18c0cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41544/0 (socket says 172.21.15.72:41544) 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd189d9b640 1 -- 172.21.15.72:0/1549988654 learned_addr learned my addr 172.21.15.72:0/1549988654 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd18a59c640 1 --2- 172.21.15.72:0/1549988654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c142490 0x7fd18c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.118+0000 7fd18ad9d640 1 --2- 172.21.15.72:0/1549988654 >> v2:172.21.15.79:3300/0 conn(0x7fd18c0ce1b0 0x7fd18c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.119+0000 7fd189d9b640 1 -- 172.21.15.72:0/1549988654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c142490 msgr2=0x7fd18c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.119+0000 7fd189d9b640 1 --2- 172.21.15.72:0/1549988654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c142490 0x7fd18c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.119+0000 7fd189d9b640 1 -- 172.21.15.72:0/1549988654 >> v2:172.21.15.79:3300/0 conn(0x7fd18c0ce1b0 msgr2=0x7fd18c0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.119+0000 7fd189d9b640 1 --2- 172.21.15.72:0/1549988654 >> v2:172.21.15.79:3300/0 conn(0x7fd18c0ce1b0 0x7fd18c0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.119+0000 7fd189d9b640 1 -- 172.21.15.72:0/1549988654 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18c0b37d0 con 0x7fd18c0b2b10 2024-03-24T10:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.119+0000 7fd189d9b640 1 --2- 172.21.15.72:0/1549988654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0b2b10 0x7fd18c0cf110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd18c070830 tx=0x7fd18002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242952741923d9ec server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd18959a640 1 -- 172.21.15.72:0/1549988654 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180031870 con 0x7fd18c0b2b10 2024-03-24T10:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd18959a640 1 -- 172.21.15.72:0/1549988654 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1800319d0 con 0x7fd18c0b2b10 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd18959a640 1 -- 172.21.15.72:0/1549988654 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180031d60 con 0x7fd18c0b2b10 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 -- 172.21.15.72:0/1549988654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0b2b10 msgr2=0x7fd18c0cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 --2- 172.21.15.72:0/1549988654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0b2b10 0x7fd18c0cf110 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd18c070830 tx=0x7fd18002b910 comp rx=0 tx=0).stop 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 -- 172.21.15.72:0/1549988654 shutdown_connections 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 --2- 172.21.15.72:0/1549988654 >> v2:172.21.15.79:3300/0 conn(0x7fd18c0ce1b0 0x7fd18c0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 --2- 172.21.15.72:0/1549988654 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0b2b10 0x7fd18c0cf110 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 --2- 172.21.15.72:0/1549988654 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c142490 0x7fd18c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 -- 172.21.15.72:0/1549988654 >> 172.21.15.72:0/1549988654 conn(0x7fd18c0b1810 msgr2=0x7fd18c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 -- 172.21.15.72:0/1549988654 shutdown_connections 2024-03-24T10:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.120+0000 7fd190d77640 1 -- 172.21.15.72:0/1549988654 wait complete. 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.121+0000 7fd190d77640 1 Processor -- start 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 -- start start 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c0b2b10 0x7fd18c13cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 0x7fd18c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c142490 0x7fd18c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c15cad0 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd18c13e2e0 con 0x7fd18c142490 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd190d77640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd18c13e5c0 con 0x7fd18c0b2b10 2024-03-24T10:37:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 0x7fd18c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd189d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 0x7fd18c159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41558/0 (socket says 172.21.15.72:41558) 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd189d9b640 1 -- 172.21.15.72:0/3850664175 learned_addr learned my addr 172.21.15.72:0/3850664175 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd18a59c640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c0b2b10 0x7fd18c13cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.122+0000 7fd18ad9d640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c142490 0x7fd18c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd189d9b640 1 -- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c0b2b10 msgr2=0x7fd18c13cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd189d9b640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c0b2b10 0x7fd18c13cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd189d9b640 1 -- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c142490 msgr2=0x7fd18c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd189d9b640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c142490 0x7fd18c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd189d9b640 1 -- 172.21.15.72:0/3850664175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1800094d0 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd189d9b640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 0x7fd18c159ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd18002b950 tx=0x7fd1800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18003ac60 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd18003adc0 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18c13e8a0 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd180044630 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.123+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18c13ee60 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.124+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18c0c4a80 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.124+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd18004d450 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.124+0000 7fd17affd640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd16c06b840 0x7fd16c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.125+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd18002d040 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.125+0000 7fd18a59c640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd16c06b840 0x7fd16c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.125+0000 7fd18a59c640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd16c06b840 0x7fd16c06dd00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd17c011340 tx=0x7fd17c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.129+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd18c0c4a80 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.300+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd18c0c4a80 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.300+0000 7fd17affd640 1 -- 172.21.15.72:0/3850664175 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fd180035020 con 0x7fd18c0ce1b0 2024-03-24T10:37:09.301 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd16c06b840 msgr2=0x7fd16c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd16c06b840 0x7fd16c06dd00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd17c011340 tx=0x7fd17c00b040 comp rx=0 tx=0).stop 2024-03-24T10:37:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 msgr2=0x7fd18c159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 0x7fd18c159ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd18002b950 tx=0x7fd1800046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 shutdown_connections 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd16c06b840 0x7fd16c06dd00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd18c142490 0x7fd18c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0ce1b0 0x7fd18c159ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 --2- 172.21.15.72:0/3850664175 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd18c0b2b10 0x7fd18c13cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 >> 172.21.15.72:0/3850664175 conn(0x7fd18c0b1810 msgr2=0x7fd18c06de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 shutdown_connections 2024-03-24T10:37:09.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.302+0000 7fd190d77640 1 -- 172.21.15.72:0/3850664175 wait complete. 2024-03-24T10:37:09.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:09.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.420+0000 7f76c46c0640 1 Processor -- start 2024-03-24T10:37:09.421 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.420+0000 7f76c46c0640 1 -- start start 2024-03-24T10:37:09.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c46c0640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f76bc06e8d0 0x7f76bc0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c46c0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76bc06ecb0 0x7f76bc15f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c46c0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc0b4190 0x7f76bc144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c46c0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc15f980 con 0x7f76bc06ecb0 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c46c0640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f76bc0b30f0 con 0x7f76bc06e8d0 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c46c0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc0b33d0 con 0x7f76bc0b4190 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76bc06ecb0 0x7f76bc15f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76bc06ecb0 0x7f76bc15f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41564/0 (socket says 172.21.15.72:41564) 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2749433987 learned_addr learned my addr 172.21.15.72:0/2749433987 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c245c640 1 --2- 172.21.15.72:0/2749433987 >> v2:172.21.15.79:3300/0 conn(0x7f76bc06e8d0 0x7f76bc0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c2c5d640 1 --2- 172.21.15.72:0/2749433987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc0b4190 0x7f76bc144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2749433987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc0b4190 msgr2=0x7f76bc144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 --2- 172.21.15.72:0/2749433987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc0b4190 0x7f76bc144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2749433987 >> v2:172.21.15.79:3300/0 conn(0x7f76bc06e8d0 msgr2=0x7f76bc0b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 --2- 172.21.15.72:0/2749433987 >> v2:172.21.15.79:3300/0 conn(0x7f76bc06e8d0 0x7f76bc0b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.421+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2749433987 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76bc0b36b0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.422+0000 7f76c1c5b640 1 --2- 172.21.15.72:0/2749433987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15f440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b5200 tx=0x7f76ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371ac6a8a1666207 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.422+0000 7f76c145a640 1 -- 172.21.15.72:0/2749433987 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac031870 con 0x7f76bc06ecb0 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.422+0000 7f76c145a640 1 -- 172.21.15.72:0/2749433987 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac0319d0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.422+0000 7f76c145a640 1 -- 172.21.15.72:0/2749433987 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac031d60 con 0x7f76bc06ecb0 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 -- 172.21.15.72:0/2749433987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 msgr2=0x7f76bc15f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2749433987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15f440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0b5200 tx=0x7f76ac02b910 comp rx=0 tx=0).stop 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 -- 172.21.15.72:0/2749433987 shutdown_connections 2024-03-24T10:37:09.425 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2749433987 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc0b4190 0x7f76bc144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2749433987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15f440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2749433987 >> v2:172.21.15.79:3300/0 conn(0x7f76bc06e8d0 0x7f76bc0b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 -- 172.21.15.72:0/2749433987 >> 172.21.15.72:0/2749433987 conn(0x7f76bc0b1810 msgr2=0x7f76bc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 -- 172.21.15.72:0/2749433987 shutdown_connections 2024-03-24T10:37:09.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.423+0000 7f76c46c0640 1 -- 172.21.15.72:0/2749433987 wait complete. 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.424+0000 7f76c46c0640 1 Processor -- start 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.424+0000 7f76c46c0640 1 -- start start 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc06e8d0 0x7f76bc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76bc0b4190 0x7f76bc0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc15aeb0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76bc15d4f0 con 0x7f76bc0b4190 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f76bc15d7d0 con 0x7f76bc06e8d0 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41574/0 (socket says 172.21.15.72:41574) 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2244241917 learned_addr learned my addr 172.21.15.72:0/2244241917 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c245c640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc06e8d0 0x7f76bc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c2c5d640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76bc0b4190 0x7f76bc0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc06e8d0 msgr2=0x7f76bc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc06e8d0 0x7f76bc15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76bc0b4190 msgr2=0x7f76bc0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76bc0b4190 0x7f76bc0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 -- 172.21.15.72:0/2244241917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ac0094d0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c2c5d640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76bc0b4190 0x7f76bc0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c1c5b640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15caa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f76ac02b950 tx=0x7f76ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac03ac60 con 0x7f76bc06ecb0 2024-03-24T10:37:09.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76ac03adc0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76bc15dab0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.425+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ac044630 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.426+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76bc15e070 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.426+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76bc15e260 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.427+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f76ac04d450 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.427+0000 7f76b2ffd640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f76a006b810 0x7f76a006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.427+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f76ac02d040 con 0x7f76bc06ecb0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.427+0000 7f76c245c640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f76a006b810 0x7f76a006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.428+0000 7f76c245c640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f76a006b810 0x7f76a006dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0c5180 tx=0x7f76b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.431+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f76ac0770c0 con 0x7f76bc06ecb0 2024-03-24T10:37:09.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.603+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f76bc04f470 con 0x7f76bc06ecb0 2024-03-24T10:37:09.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.603+0000 7f76b2ffd640 1 -- 172.21.15.72:0/2244241917 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f76ac035020 con 0x7f76bc06ecb0 2024-03-24T10:37:09.604 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:09.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f76a006b810 msgr2=0x7f76a006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f76a006b810 0x7f76a006dcd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0c5180 tx=0x7f76b8009190 comp rx=0 tx=0).stop 2024-03-24T10:37:09.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 msgr2=0x7f76bc15caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15caa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f76ac02b950 tx=0x7f76ac0046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 shutdown_connections 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f76a006b810 0x7f76a006dcd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76bc0b4190 0x7f76bc0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76bc06ecb0 0x7f76bc15caa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 --2- 172.21.15.72:0/2244241917 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f76bc06e8d0 0x7f76bc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 >> 172.21.15.72:0/2244241917 conn(0x7f76bc0b1810 msgr2=0x7f76bc06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 shutdown_connections 2024-03-24T10:37:09.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.605+0000 7f76c46c0640 1 -- 172.21.15.72:0/2244241917 wait complete. 2024-03-24T10:37:09.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:09.720 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.720+0000 7f82d654f640 1 Processor -- start 2024-03-24T10:37:09.721 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.720+0000 7f82d654f640 1 -- start start 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82d654f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f82d015e240 0x7f82d00d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82d654f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d00d4950 con 0x7f82d00cfa50 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82d654f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82d00cfe60 con 0x7f82d00d0f70 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82d654f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f82d00d2270 con 0x7f82d015e240 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82d4aec640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f82d00cfa50 0x7f82d00b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60012/0 (socket says 172.21.15.72:60012) 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82d4aec640 1 -- 172.21.15.72:0/1359245034 learned_addr learned my addr 172.21.15.72:0/1359245034 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82cffff640 1 --2- 172.21.15.72:0/1359245034 >> v2:172.21.15.79:3300/0 conn(0x7f82d015e240 0x7f82d00d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82ceffd640 1 -- 172.21.15.72:0/1359245034 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469099184 0 0) 0x7f82d00d4950 con 0x7f82d00cfa50 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82ceffd640 1 -- 172.21.15.72:0/1359245034 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82b8003520 con 0x7f82d00cfa50 2024-03-24T10:37:09.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82cffff640 1 -- 172.21.15.72:0/1359245034 >> v1:172.21.15.79:6789/0 conn(0x7f82d00d0f70 legacy=0x7f82d00b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82cffff640 1 -- 172.21.15.72:0/1359245034 >> v1:172.21.15.72:6789/0 conn(0x7f82d00cfa50 legacy=0x7f82d00b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.721+0000 7f82cffff640 1 -- 172.21.15.72:0/1359245034 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d00b38c0 con 0x7f82d015e240 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.722+0000 7f82cffff640 1 --2- 172.21.15.72:0/1359245034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d015e240 0x7f82d00d2410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82c00097a0 tx=0x7f82c002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b65a6b9efd7e60 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.722+0000 7f82ceffd640 1 -- 172.21.15.72:0/1359245034 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031830 con 0x7f82d015e240 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.722+0000 7f82ceffd640 1 -- 172.21.15.72:0/1359245034 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c0031990 con 0x7f82d015e240 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.722+0000 7f82ceffd640 1 -- 172.21.15.72:0/1359245034 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c0031d00 con 0x7f82d015e240 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 -- 172.21.15.72:0/1359245034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d015e240 msgr2=0x7f82d00d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 --2- 172.21.15.72:0/1359245034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d015e240 0x7f82d00d2410 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82c00097a0 tx=0x7f82c002b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 -- 172.21.15.72:0/1359245034 shutdown_connections 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 --2- 172.21.15.72:0/1359245034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d015e240 0x7f82d00d2410 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 -- 172.21.15.72:0/1359245034 >> 172.21.15.72:0/1359245034 conn(0x7f82d00d3e30 msgr2=0x7f82d00d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.724 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 -- 172.21.15.72:0/1359245034 shutdown_connections 2024-03-24T10:37:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.723+0000 7f82d654f640 1 -- 172.21.15.72:0/1359245034 wait complete. 2024-03-24T10:37:09.725 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.724+0000 7f82d654f640 1 Processor -- start 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.724+0000 7f82d654f640 1 -- start start 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82d00cfa50 0x7f82d00b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d00d0f70 0x7f82d00b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 0x7f82d01608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00b6f60 con 0x7f82d015e240 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82d00b7240 con 0x7f82d00d0f70 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f82d00b7520 con 0x7f82d00cfa50 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 0x7f82d01608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82cffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82d00cfa50 0x7f82d00b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 0x7f82d01608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41576/0 (socket says 172.21.15.72:41576) 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 -- 172.21.15.72:0/3367966549 learned_addr learned my addr 172.21.15.72:0/3367966549 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82cf7fe640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d00d0f70 0x7f82d00b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 -- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82d00cfa50 msgr2=0x7f82d00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82d00cfa50 0x7f82d00b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 -- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d00d0f70 msgr2=0x7f82d00b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d00d0f70 0x7f82d00b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 -- 172.21.15.72:0/3367966549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c0009400 con 0x7f82d015e240 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d4aec640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 0x7f82d01608e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f82c800cb40 tx=0x7f82c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c800aca0 con 0x7f82d015e240 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c800ae00 con 0x7f82d015e240 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82c8012620 con 0x7f82d015e240 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d00b7800 con 0x7f82d015e240 2024-03-24T10:37:09.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.725+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d00b6ad0 con 0x7f82d015e240 2024-03-24T10:37:09.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.726+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82d00b7d20 con 0x7f82d015e240 2024-03-24T10:37:09.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.727+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f82c8007070 con 0x7f82d015e240 2024-03-24T10:37:09.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.727+0000 7f82ccff9640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82bc06b810 0x7f82bc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:09.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.727+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f82c808a5a0 con 0x7f82d015e240 2024-03-24T10:37:09.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.727+0000 7f82cffff640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82bc06b810 0x7f82bc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:09.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.728+0000 7f82cffff640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82bc06b810 0x7f82bc06dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82c0036000 tx=0x7f82c003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:09.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.731+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f82d00b7d20 con 0x7f82d015e240 2024-03-24T10:37:09.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.903+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f82d00b7d20 con 0x7f82d015e240 2024-03-24T10:37:09.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.904+0000 7f82ccff9640 1 -- 172.21.15.72:0/3367966549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f82d00b7d20 con 0x7f82d015e240 2024-03-24T10:37:09.904 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:09.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.905+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82bc06b810 msgr2=0x7f82bc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.905+0000 7f82d654f640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82bc06b810 0x7f82bc06dcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82c0036000 tx=0x7f82c003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 msgr2=0x7f82d01608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 0x7f82d01608e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f82c800cb40 tx=0x7f82c800a060 comp rx=0 tx=0).stop 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 shutdown_connections 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f82bc06b810 0x7f82bc06dcd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f82d015e240 0x7f82d01608e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82d00d0f70 0x7f82d00b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 --2- 172.21.15.72:0/3367966549 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f82d00cfa50 0x7f82d00b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 >> 172.21.15.72:0/3367966549 conn(0x7f82d00d3e30 msgr2=0x7f82d006bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 shutdown_connections 2024-03-24T10:37:09.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:09.906+0000 7f82d654f640 1 -- 172.21.15.72:0/3367966549 wait complete. 2024-03-24T10:37:09.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.019+0000 7fa0c8a2e640 1 Processor -- start 2024-03-24T10:37:10.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.020+0000 7fa0c8a2e640 1 -- start start 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.020+0000 7fa0c8a2e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c40d2b20 0x7fa0c40cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.020+0000 7fa0c8a2e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c40d4950 con 0x7fa0c40d0f70 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.020+0000 7fa0c8a2e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0c40b38c0 con 0x7fa0c415e240 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.020+0000 7fa0c8a2e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c40d2270 con 0x7fa0c40d2b20 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c2d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa0c40d0f70 0x7fa0c40cef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60020/0 (socket says 172.21.15.72:60020) 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c2d9d640 1 -- 172.21.15.72:0/2054575313 learned_addr learned my addr 172.21.15.72:0/2054575313 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c1d9b640 1 --2- 172.21.15.72:0/2054575313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c40d2b20 0x7fa0c40cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c159a640 1 -- 172.21.15.72:0/2054575313 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321090039 0 0) 0x7fa0c40d4950 con 0x7fa0c40d0f70 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c159a640 1 -- 172.21.15.72:0/2054575313 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0ac003520 con 0x7fa0c40d0f70 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c159a640 1 -- 172.21.15.72:0/2054575313 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29099963 0 0) 0x7fa0c40b38c0 con 0x7fa0c415e240 2024-03-24T10:37:10.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c1d9b640 1 -- 172.21.15.72:0/2054575313 >> v1:172.21.15.79:6789/0 conn(0x7fa0c415e240 legacy=0x7fa0c40d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c1d9b640 1 -- 172.21.15.72:0/2054575313 >> v1:172.21.15.72:6789/0 conn(0x7fa0c40d0f70 legacy=0x7fa0c40cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.023 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.021+0000 7fa0c1d9b640 1 -- 172.21.15.72:0/2054575313 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c40b3550 con 0x7fa0c40d2b20 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c1d9b640 1 --2- 172.21.15.72:0/2054575313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c40d2b20 0x7fa0c40cea40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80097d0 tx=0x7fa0b802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27cd56339477f183 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c159a640 1 -- 172.21.15.72:0/2054575313 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031800 con 0x7fa0c40d2b20 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c159a640 1 -- 172.21.15.72:0/2054575313 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0b8031960 con 0x7fa0c40d2b20 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c159a640 1 -- 172.21.15.72:0/2054575313 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8031cd0 con 0x7fa0c40d2b20 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/2054575313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c40d2b20 msgr2=0x7fa0c40cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/2054575313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c40d2b20 0x7fa0c40cea40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80097d0 tx=0x7fa0b802b8a0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/2054575313 shutdown_connections 2024-03-24T10:37:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/2054575313 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c40d2b20 0x7fa0c40cea40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/2054575313 >> 172.21.15.72:0/2054575313 conn(0x7fa0c40d3e30 msgr2=0x7fa0c40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/2054575313 shutdown_connections 2024-03-24T10:37:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.022+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/2054575313 wait complete. 2024-03-24T10:37:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 Processor -- start 2024-03-24T10:37:10.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 -- start start 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 0x7fa0c4160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c40d2b20 0x7fa0c41f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c415e240 0x7fa0c41f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c4160eb0 con 0x7fa0c40d0f70 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c41f6cd0 con 0x7fa0c40d2b20 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.024+0000 7fa0c8a2e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa0c4161150 con 0x7fa0c415e240 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 0x7fa0c4160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 0x7fa0c4160970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41588/0 (socket says 172.21.15.72:41588) 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 -- 172.21.15.72:0/185779410 learned_addr learned my addr 172.21.15.72:0/185779410 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c2d9d640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c415e240 0x7fa0c41f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c1d9b640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c40d2b20 0x7fa0c41f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 -- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c415e240 msgr2=0x7fa0c41f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c415e240 0x7fa0c41f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 -- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c40d2b20 msgr2=0x7fa0c41f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c40d2b20 0x7fa0c41f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 -- 172.21.15.72:0/185779410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b8009400 con 0x7fa0c40d0f70 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c2d9d640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c415e240 0x7fa0c41f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c259c640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 0x7fa0c4160970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c7f0 tx=0x7fa0bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc003da0 con 0x7fa0c40d0f70 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0bc005070 con 0x7fa0c40d0f70 2024-03-24T10:37:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c4161430 con 0x7fa0c40d0f70 2024-03-24T10:37:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc005400 con 0x7fa0c40d0f70 2024-03-24T10:37:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.025+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c40cb280 con 0x7fa0c40d0f70 2024-03-24T10:37:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.026+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c404f470 con 0x7fa0c40d0f70 2024-03-24T10:37:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.027+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa0bc005560 con 0x7fa0c40d0f70 2024-03-24T10:37:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.027+0000 7fa0b2ffd640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa0a406b810 0x7fa0a406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.027+0000 7fa0c1d9b640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa0a406b810 0x7fa0a406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.027+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa0bc08a390 con 0x7fa0c40d0f70 2024-03-24T10:37:10.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.028+0000 7fa0c1d9b640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa0a406b810 0x7fa0a406dcd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8036000 tx=0x7fa0b803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.032+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa0bc054a60 con 0x7fa0c40d0f70 2024-03-24T10:37:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.205+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa0c40b45e0 con 0x7fa0c40d0f70 2024-03-24T10:37:10.206 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.206+0000 7fa0b2ffd640 1 -- 172.21.15.72:0/185779410 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa0bc005810 con 0x7fa0c40d0f70 2024-03-24T10:37:10.207 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:10.208 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa0a406b810 msgr2=0x7fa0a406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa0a406b810 0x7fa0a406dcd0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8036000 tx=0x7fa0b803c040 comp rx=0 tx=0).stop 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 msgr2=0x7fa0c4160970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 0x7fa0c4160970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00c7f0 tx=0x7fa0bc00ccb0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 shutdown_connections 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa0a406b810 0x7fa0a406dcd0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa0c415e240 0x7fa0c41f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0c40d2b20 0x7fa0c41f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 --2- 172.21.15.72:0/185779410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa0c40d0f70 0x7fa0c4160970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 >> 172.21.15.72:0/185779410 conn(0x7fa0c40d3e30 msgr2=0x7fa0c40b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 shutdown_connections 2024-03-24T10:37:10.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.208+0000 7fa0c8a2e640 1 -- 172.21.15.72:0/185779410 wait complete. 2024-03-24T10:37:10.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.322+0000 7f3671119640 1 Processor -- start 2024-03-24T10:37:10.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.322+0000 7f3671119640 1 -- start start 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3671119640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f366c1624d0 0x7f366c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3671119640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f366c06ffd0 0x7f366c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3671119640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f366c0d0260 con 0x7f366c0cde50 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3671119640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f366c0cd440 con 0x7f366c1624d0 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3671119640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f366c0d0500 con 0x7f366c06ffd0 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f366c1624d0 0x7f366c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f366c1624d0 0x7f366c06fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41600/0 (socket says 172.21.15.72:41600) 2024-03-24T10:37:10.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f366ad9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f366c0cde50 0x7f366c161dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60034/0 (socket says 172.21.15.72:60034) 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 -- 172.21.15.72:0/131450050 learned_addr learned my addr 172.21.15.72:0/131450050 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f366b59e640 1 --2- 172.21.15.72:0/131450050 >> v2:172.21.15.79:3300/0 conn(0x7f366c06ffd0 0x7f366c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 -- 172.21.15.72:0/131450050 >> v2:172.21.15.79:3300/0 conn(0x7f366c06ffd0 msgr2=0x7f366c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 --2- 172.21.15.72:0/131450050 >> v2:172.21.15.79:3300/0 conn(0x7f366c06ffd0 0x7f366c15da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 -- 172.21.15.72:0/131450050 >> v1:172.21.15.72:6789/0 conn(0x7f366c0cde50 legacy=0x7f366c161dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f3663fff640 1 -- 172.21.15.72:0/131450050 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f366c070460 con 0x7f366c1624d0 2024-03-24T10:37:10.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.323+0000 7f366a59c640 1 -- 172.21.15.72:0/131450050 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125756947 0 0) 0x7f366c0d0260 con 0x7f366c0cde50 2024-03-24T10:37:10.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.324+0000 7f3663fff640 1 --2- 172.21.15.72:0/131450050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c1624d0 0x7f366c06fa90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f366c072060 tx=0x7f365402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b1ffce795e6e6d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.324+0000 7f366a59c640 1 -- 172.21.15.72:0/131450050 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654030860 con 0x7f366c1624d0 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.324+0000 7f366a59c640 1 -- 172.21.15.72:0/131450050 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36540309c0 con 0x7f366c1624d0 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.324+0000 7f366a59c640 1 -- 172.21.15.72:0/131450050 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3654030d50 con 0x7f366c1624d0 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 -- 172.21.15.72:0/131450050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c1624d0 msgr2=0x7f366c06fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 --2- 172.21.15.72:0/131450050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c1624d0 0x7f366c06fa90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f366c072060 tx=0x7f365402b9a0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 -- 172.21.15.72:0/131450050 shutdown_connections 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 --2- 172.21.15.72:0/131450050 >> v2:172.21.15.79:3300/0 conn(0x7f366c06ffd0 0x7f366c15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 --2- 172.21.15.72:0/131450050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c1624d0 0x7f366c06fa90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 -- 172.21.15.72:0/131450050 >> 172.21.15.72:0/131450050 conn(0x7f366c0b3930 msgr2=0x7f366c0b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 -- 172.21.15.72:0/131450050 shutdown_connections 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.325+0000 7f3671119640 1 -- 172.21.15.72:0/131450050 wait complete. 2024-03-24T10:37:10.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.326+0000 7f3671119640 1 Processor -- start 2024-03-24T10:37:10.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.326+0000 7f3671119640 1 -- start start 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3671119640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 0x7f366c14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3671119640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c0cde50 0x7f366c0b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3671119640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f366c1624d0 0x7f366c0b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3671119640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f366c15fe40 con 0x7f366c06ffd0 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3671119640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f366c14fa20 con 0x7f366c0cde50 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3671119640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f366c0b6fd0 con 0x7f366c1624d0 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 0x7f366c14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 0x7f366c14f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41612/0 (socket says 172.21.15.72:41612) 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 -- 172.21.15.72:0/1346897255 learned_addr learned my addr 172.21.15.72:0/1346897255 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366b59e640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f366c1624d0 0x7f366c0b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f3663fff640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c0cde50 0x7f366c0b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 -- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f366c1624d0 msgr2=0x7f366c0b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f366c1624d0 0x7f366c0b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 -- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c0cde50 msgr2=0x7f366c0b63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c0cde50 0x7f366c0b63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 -- 172.21.15.72:0/1346897255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36540094d0 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.327+0000 7f366ad9d640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 0x7f366c14f120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c4d0 tx=0x7f365c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.328+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c0074e0 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.328+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365c007660 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.328+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f366c0b72b0 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.328+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f365c004a20 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.328+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f366c14ffa0 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.328+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f366c1501c0 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.329+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f365c004b80 con 0x7f366c06ffd0 2024-03-24T10:37:10.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.329+0000 7f36637fe640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f364c06b810 0x7f364c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.329+0000 7f3663fff640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f364c06b810 0x7f364c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.329+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f365c089a30 con 0x7f366c06ffd0 2024-03-24T10:37:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.330+0000 7f3663fff640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f364c06b810 0x7f364c06dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3654036000 tx=0x7f365403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.334+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f365c054100 con 0x7f366c06ffd0 2024-03-24T10:37:10.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.506+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f366c0cff50 con 0x7f366c06ffd0 2024-03-24T10:37:10.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.508+0000 7f36637fe640 1 -- 172.21.15.72:0/1346897255 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f365c0577c0 con 0x7f366c06ffd0 2024-03-24T10:37:10.508 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:10.509 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f364c06b810 msgr2=0x7f364c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f364c06b810 0x7f364c06dcd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3654036000 tx=0x7f365403b040 comp rx=0 tx=0).stop 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 msgr2=0x7f366c14f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 0x7f366c14f120 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f365c00c4d0 tx=0x7f365c00c990 comp rx=0 tx=0).stop 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 shutdown_connections 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f364c06b810 0x7f364c06dcd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f366c1624d0 0x7f366c0b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f366c0cde50 0x7f366c0b63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 --2- 172.21.15.72:0/1346897255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f366c06ffd0 0x7f366c14f120 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 >> 172.21.15.72:0/1346897255 conn(0x7f366c0b3930 msgr2=0x7f366c161b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 shutdown_connections 2024-03-24T10:37:10.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.510+0000 7f3671119640 1 -- 172.21.15.72:0/1346897255 wait complete. 2024-03-24T10:37:10.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:10.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:10.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.625+0000 7f327a46b640 1 Processor -- start 2024-03-24T10:37:10.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.626+0000 7f327a46b640 1 -- start start 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.626+0000 7f327a46b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f327415e240 0x7f32740d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.626+0000 7f327a46b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f32740cfa50 0x7f32740d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.626+0000 7f327a46b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32740d4950 con 0x7f32740d0f70 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.626+0000 7f327a46b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f32740d2270 con 0x7f32740cfa50 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.626+0000 7f327a46b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f32740b38c0 con 0x7f327415e240 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f32737fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f32740d0f70 0x7f32740b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60042/0 (socket says 172.21.15.72:60042) 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f32737fe640 1 -- 172.21.15.72:0/829196895 learned_addr learned my addr 172.21.15.72:0/829196895 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3273fff640 1 --2- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f327415e240 0x7f32740d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3278a08640 1 --2- 172.21.15.72:0/829196895 >> v2:172.21.15.79:3300/0 conn(0x7f32740cfa50 0x7f32740d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3272ffd640 1 -- 172.21.15.72:0/829196895 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2973166762 0 0) 0x7f32740d4950 con 0x7f32740d0f70 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3272ffd640 1 -- 172.21.15.72:0/829196895 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f325c003520 con 0x7f32740d0f70 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3278a08640 1 -- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f327415e240 msgr2=0x7f32740d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:10.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3278a08640 1 --2- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f327415e240 0x7f32740d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3278a08640 1 -- 172.21.15.72:0/829196895 >> v1:172.21.15.72:6789/0 conn(0x7f32740d0f70 legacy=0x7f32740b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.627+0000 7f3278a08640 1 -- 172.21.15.72:0/829196895 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32740b3550 con 0x7f32740cfa50 2024-03-24T10:37:10.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.628+0000 7f3278a08640 1 --2- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32740cfa50 0x7f32740d2950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f326c009d90 tx=0x7f326c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfd190062f49c754 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.628+0000 7f3272ffd640 1 -- 172.21.15.72:0/829196895 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c02cbc0 con 0x7f32740cfa50 2024-03-24T10:37:10.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.628+0000 7f3272ffd640 1 -- 172.21.15.72:0/829196895 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326c02cd20 con 0x7f32740cfa50 2024-03-24T10:37:10.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.628+0000 7f3272ffd640 1 -- 172.21.15.72:0/829196895 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326c034640 con 0x7f32740cfa50 2024-03-24T10:37:10.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 -- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32740cfa50 msgr2=0x7f32740d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 --2- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32740cfa50 0x7f32740d2950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f326c009d90 tx=0x7f326c02be10 comp rx=0 tx=0).stop 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 -- 172.21.15.72:0/829196895 shutdown_connections 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 --2- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f32740cfa50 0x7f32740d2950 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 --2- 172.21.15.72:0/829196895 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f327415e240 0x7f32740d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 -- 172.21.15.72:0/829196895 >> 172.21.15.72:0/829196895 conn(0x7f32740d3e30 msgr2=0x7f32740d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 -- 172.21.15.72:0/829196895 shutdown_connections 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.629+0000 7f327a46b640 1 -- 172.21.15.72:0/829196895 wait complete. 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.630+0000 7f327a46b640 1 Processor -- start 2024-03-24T10:37:10.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.630+0000 7f327a46b640 1 -- start start 2024-03-24T10:37:10.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f327a46b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 0x7f32741f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f327a46b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32740d0f70 0x7f3274160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f327a46b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f327415e240 0x7f327406bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f327a46b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f32740c89b0 con 0x7f32740cfa50 2024-03-24T10:37:10.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f327a46b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f32741f4440 con 0x7f327415e240 2024-03-24T10:37:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f327a46b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f32740c97d0 con 0x7f32740d0f70 2024-03-24T10:37:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 0x7f32741f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 0x7f32741f3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41620/0 (socket says 172.21.15.72:41620) 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 -- 172.21.15.72:0/497291774 learned_addr learned my addr 172.21.15.72:0/497291774 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3278a08640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f327415e240 0x7f327406bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f32737fe640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32740d0f70 0x7f3274160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 -- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32740d0f70 msgr2=0x7f3274160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32740d0f70 0x7f3274160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 -- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f327415e240 msgr2=0x7f327406bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f327415e240 0x7f327406bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 -- 172.21.15.72:0/497291774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326c009a70 con 0x7f32740cfa50 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3278a08640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f327415e240 0x7f327406bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3273fff640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 0x7f32741f3f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f326400e9b0 tx=0x7f326400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3264009670 con 0x7f32740cfa50 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.631+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326400c9a0 con 0x7f32740cfa50 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.632+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32740c8bc0 con 0x7f32740cfa50 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.632+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f326400cd50 con 0x7f32740cfa50 2024-03-24T10:37:10.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.632+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32740c9180 con 0x7f32740cfa50 2024-03-24T10:37:10.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.633+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327404f470 con 0x7f32740cfa50 2024-03-24T10:37:10.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.633+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3264013470 con 0x7f32740cfa50 2024-03-24T10:37:10.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.633+0000 7f3270ff9640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f326006b840 0x7f326006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.633+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f326408a6b0 con 0x7f32740cfa50 2024-03-24T10:37:10.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.633+0000 7f32737fe640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f326006b840 0x7f326006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.637 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.634+0000 7f32737fe640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f326006b840 0x7f326006dd00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32740d0770 tx=0x7f3268009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.638 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.638+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3264054e10 con 0x7f32740cfa50 2024-03-24T10:37:10.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.810+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32740ce0c0 con 0x7f32740cfa50 2024-03-24T10:37:10.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.811+0000 7f3270ff9640 1 -- 172.21.15.72:0/497291774 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f32640584d0 con 0x7f32740cfa50 2024-03-24T10:37:10.811 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f326006b840 msgr2=0x7f326006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f326006b840 0x7f326006dd00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f32740d0770 tx=0x7f3268009040 comp rx=0 tx=0).stop 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 msgr2=0x7f32741f3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 0x7f32741f3f00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f326400e9b0 tx=0x7f326400ee70 comp rx=0 tx=0).stop 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 shutdown_connections 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f326006b840 0x7f326006dd00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f327415e240 0x7f327406bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f32740d0f70 0x7f3274160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.814 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 --2- 172.21.15.72:0/497291774 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32740cfa50 0x7f32741f3f00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 >> 172.21.15.72:0/497291774 conn(0x7f32740d3e30 msgr2=0x7f327406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 shutdown_connections 2024-03-24T10:37:10.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.813+0000 7f327a46b640 1 -- 172.21.15.72:0/497291774 wait complete. 2024-03-24T10:37:10.825 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:10.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.928+0000 7f6b99181640 1 Processor -- start 2024-03-24T10:37:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.928+0000 7f6b99181640 1 -- start start 2024-03-24T10:37:10.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b99181640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f6b940ce8c0 0x7f6b940b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b99181640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b940b2b10 0x7f6b940cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b99181640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b940b3210 con 0x7f6b94142490 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b99181640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6b940b34f0 con 0x7f6b940b2b10 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b99181640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f6b940b37d0 con 0x7f6b940ce8c0 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b9359e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6b940b2b10 0x7f6b940cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b92d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6b94142490 0x7f6b940ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60052/0 (socket says 172.21.15.72:60052) 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b92d9d640 1 -- 172.21.15.72:0/3857868027 learned_addr learned my addr 172.21.15.72:0/3857868027 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b8bfff640 1 --2- 172.21.15.72:0/3857868027 >> v2:172.21.15.79:3300/0 conn(0x7f6b940ce8c0 0x7f6b940b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b9359e640 1 -- 172.21.15.72:0/3857868027 >> v2:172.21.15.79:3300/0 conn(0x7f6b940ce8c0 msgr2=0x7f6b940b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b9359e640 1 --2- 172.21.15.72:0/3857868027 >> v2:172.21.15.79:3300/0 conn(0x7f6b940ce8c0 0x7f6b940b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b9359e640 1 -- 172.21.15.72:0/3857868027 >> v1:172.21.15.72:6789/0 conn(0x7f6b94142490 legacy=0x7f6b940ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b9259c640 1 -- 172.21.15.72:0/3857868027 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649542308 0 0) 0x7f6b940b3210 con 0x7f6b94142490 2024-03-24T10:37:10.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.929+0000 7f6b9359e640 1 -- 172.21.15.72:0/3857868027 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b940b3ab0 con 0x7f6b940b2b10 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.930+0000 7f6b9359e640 1 --2- 172.21.15.72:0/3857868027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b940cf110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6b940b4ad0 tx=0x7f6b8c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcf68fdb4b1776d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.930+0000 7f6b9259c640 1 -- 172.21.15.72:0/3857868027 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c02cbf0 con 0x7f6b940b2b10 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.930+0000 7f6b9259c640 1 -- 172.21.15.72:0/3857868027 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c02cd50 con 0x7f6b940b2b10 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.930+0000 7f6b9259c640 1 -- 172.21.15.72:0/3857868027 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c034660 con 0x7f6b940b2b10 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.930+0000 7f6b99181640 1 -- 172.21.15.72:0/3857868027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 msgr2=0x7f6b940cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 --2- 172.21.15.72:0/3857868027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b940cf110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6b940b4ad0 tx=0x7f6b8c02be40 comp rx=0 tx=0).stop 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 -- 172.21.15.72:0/3857868027 shutdown_connections 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 --2- 172.21.15.72:0/3857868027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b940cf110 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 --2- 172.21.15.72:0/3857868027 >> v2:172.21.15.79:3300/0 conn(0x7f6b940ce8c0 0x7f6b940b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 -- 172.21.15.72:0/3857868027 >> 172.21.15.72:0/3857868027 conn(0x7f6b940b1810 msgr2=0x7f6b940b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 -- 172.21.15.72:0/3857868027 shutdown_connections 2024-03-24T10:37:10.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.931+0000 7f6b99181640 1 -- 172.21.15.72:0/3857868027 wait complete. 2024-03-24T10:37:10.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.932+0000 7f6b99181640 1 Processor -- start 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.932+0000 7f6b99181640 1 -- start start 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b94156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b940ce8c0 0x7f6b9413ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b94142490 0x7f6b94158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9413dbb0 con 0x7f6b940b2b10 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9413de90 con 0x7f6b940ce8c0 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9413e170 con 0x7f6b94142490 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b94156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b94156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41638/0 (socket says 172.21.15.72:41638) 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 -- 172.21.15.72:0/3829796490 learned_addr learned my addr 172.21.15.72:0/3829796490 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b9359e640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b94142490 0x7f6b94158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b8bfff640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b940ce8c0 0x7f6b9413ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 -- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b94142490 msgr2=0x7f6b94158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b94142490 0x7f6b94158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 -- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b940ce8c0 msgr2=0x7f6b9413ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b940ce8c0 0x7f6b9413ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 -- 172.21.15.72:0/3829796490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c009a70 con 0x7f6b940b2b10 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b92d9d640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b94156e20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c430 tx=0x7f6b8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b840074e0 con 0x7f6b940b2b10 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b84007660 con 0x7f6b940b2b10 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9413e450 con 0x7f6b940b2b10 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b84004a20 con 0x7f6b940b2b10 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.933+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9413ea10 con 0x7f6b940b2b10 2024-03-24T10:37:10.936 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.934+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9404f470 con 0x7f6b940b2b10 2024-03-24T10:37:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.935+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6b84004b80 con 0x7f6b940b2b10 2024-03-24T10:37:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.935+0000 7f6b8b7fe640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6b7406b840 0x7f6b7406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.935+0000 7f6b8bfff640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6b7406b840 0x7f6b7406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.935+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6b8408a1c0 con 0x7f6b940b2b10 2024-03-24T10:37:10.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.936+0000 7f6b8bfff640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6b7406b840 0x7f6b7406dd00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b9413ad70 tx=0x7f6b7c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:10.940 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:10.940+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6b84054920 con 0x7f6b940b2b10 2024-03-24T10:37:11.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.112+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6b940ccc70 con 0x7f6b940b2b10 2024-03-24T10:37:11.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.112+0000 7f6b8b7fe640 1 -- 172.21.15.72:0/3829796490 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6b84057fe0 con 0x7f6b940b2b10 2024-03-24T10:37:11.113 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6b7406b840 msgr2=0x7f6b7406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6b7406b840 0x7f6b7406dd00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6b9413ad70 tx=0x7f6b7c009190 comp rx=0 tx=0).stop 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 msgr2=0x7f6b94156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b94156e20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c430 tx=0x7f6b8400c8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 shutdown_connections 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f6b7406b840 0x7f6b7406dd00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f6b94142490 0x7f6b94158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b940ce8c0 0x7f6b9413ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 --2- 172.21.15.72:0/3829796490 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6b940b2b10 0x7f6b94156e20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 >> 172.21.15.72:0/3829796490 conn(0x7f6b940b1810 msgr2=0x7f6b9406ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 shutdown_connections 2024-03-24T10:37:11.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.114+0000 7f6b99181640 1 -- 172.21.15.72:0/3829796490 wait complete. 2024-03-24T10:37:11.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.229+0000 7f1f5293a640 1 Processor -- start 2024-03-24T10:37:11.230 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.229+0000 7f1f5293a640 1 -- start start 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f5293a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f1f4c0b4820 0x7f1f4c0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f5293a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f4c072350 0x7f1f4c0727a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f5293a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c15e490 con 0x7f1f4c15e0b0 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f5293a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f1f4c071590 con 0x7f1f4c072350 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f5293a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f1f4c071870 con 0x7f1f4c0b4820 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f50ed7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f4c072350 0x7f1f4c0727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f4bfff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1f4c15e0b0 0x7f1f4c0ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60068/0 (socket says 172.21.15.72:60068) 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f4bfff640 1 -- 172.21.15.72:0/2957096970 learned_addr learned my addr 172.21.15.72:0/2957096970 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:11.231 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f4b7fe640 1 --2- 172.21.15.72:0/2957096970 >> v2:172.21.15.79:3300/0 conn(0x7f1f4c0b4820 0x7f1f4c0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f50ed7640 1 -- 172.21.15.72:0/2957096970 >> v2:172.21.15.79:3300/0 conn(0x7f1f4c0b4820 msgr2=0x7f1f4c0b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f50ed7640 1 --2- 172.21.15.72:0/2957096970 >> v2:172.21.15.79:3300/0 conn(0x7f1f4c0b4820 0x7f1f4c0b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f50ed7640 1 -- 172.21.15.72:0/2957096970 >> v1:172.21.15.72:6789/0 conn(0x7f1f4c15e0b0 legacy=0x7f1f4c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f4affd640 1 -- 172.21.15.72:0/2957096970 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 83266069 0 0) 0x7f1f4c15e490 con 0x7f1f4c15e0b0 2024-03-24T10:37:11.232 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.230+0000 7f1f50ed7640 1 -- 172.21.15.72:0/2957096970 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c071b50 con 0x7f1f4c072350 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.231+0000 7f1f50ed7640 1 --2- 172.21.15.72:0/2957096970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c072350 0x7f1f4c0727a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06e810 tx=0x7f1f4402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440bffe1cf69a814 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.231+0000 7f1f4affd640 1 -- 172.21.15.72:0/2957096970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4402cbf0 con 0x7f1f4c072350 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.231+0000 7f1f4affd640 1 -- 172.21.15.72:0/2957096970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4402cd50 con 0x7f1f4c072350 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.231+0000 7f1f4affd640 1 -- 172.21.15.72:0/2957096970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f44034660 con 0x7f1f4c072350 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 -- 172.21.15.72:0/2957096970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c072350 msgr2=0x7f1f4c0727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2957096970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c072350 0x7f1f4c0727a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c06e810 tx=0x7f1f4402be40 comp rx=0 tx=0).stop 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 -- 172.21.15.72:0/2957096970 shutdown_connections 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2957096970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c072350 0x7f1f4c0727a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2957096970 >> v2:172.21.15.79:3300/0 conn(0x7f1f4c0b4820 0x7f1f4c0b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 -- 172.21.15.72:0/2957096970 >> 172.21.15.72:0/2957096970 conn(0x7f1f4c0b1810 msgr2=0x7f1f4c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 -- 172.21.15.72:0/2957096970 shutdown_connections 2024-03-24T10:37:11.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.232+0000 7f1f5293a640 1 -- 172.21.15.72:0/2957096970 wait complete. 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.233+0000 7f1f5293a640 1 Processor -- start 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.233+0000 7f1f5293a640 1 -- start start 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f5293a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f4c072350 0x7f1f4c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f5293a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 0x7f1f4c1f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f5293a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f4c15e0b0 0x7f1f4c159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f5293a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15e660 con 0x7f1f4c0b4820 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f5293a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f4c15c670 con 0x7f1f4c072350 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f5293a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f1f4c15e8b0 con 0x7f1f4c15e0b0 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 0x7f1f4c1f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 0x7f1f4c1f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41656/0 (socket says 172.21.15.72:41656) 2024-03-24T10:37:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 -- 172.21.15.72:0/2722141390 learned_addr learned my addr 172.21.15.72:0/2722141390 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f50ed7640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f4c15e0b0 0x7f1f4c159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4bfff640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f4c072350 0x7f1f4c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 -- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f4c15e0b0 msgr2=0x7f1f4c159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f4c15e0b0 0x7f1f4c159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 -- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f4c072350 msgr2=0x7f1f4c14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f4c072350 0x7f1f4c14b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 -- 172.21.15.72:0/2722141390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f44009a70 con 0x7f1f4c0b4820 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.234+0000 7f1f4b7fe640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 0x7f1f4c1f3cc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000e980 tx=0x7f1f4000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.235+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f40009670 con 0x7f1f4c0b4820 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.235+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f4000ca00 con 0x7f1f4c0b4820 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.235+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c15eb90 con 0x7f1f4c0b4820 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.235+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4000cd90 con 0x7f1f4c0b4820 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.235+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f4c14ba10 con 0x7f1f4c0b4820 2024-03-24T10:37:11.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.236+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f4c04f470 con 0x7f1f4c0b4820 2024-03-24T10:37:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.236+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f1f40013470 con 0x7f1f4c0b4820 2024-03-24T10:37:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.236+0000 7f1f48ff9640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1f3806b810 0x7f1f3806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.236+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1f4008a6d0 con 0x7f1f4c0b4820 2024-03-24T10:37:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.236+0000 7f1f4bfff640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1f3806b810 0x7f1f3806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.237+0000 7f1f4bfff640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1f3806b810 0x7f1f3806dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c007fd0 tx=0x7f1f3c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.241+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f1f40054e30 con 0x7f1f4c0b4820 2024-03-24T10:37:11.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.412+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1f4c070e80 con 0x7f1f4c0b4820 2024-03-24T10:37:11.412 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.412+0000 7f1f48ff9640 1 -- 172.21.15.72:0/2722141390 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f1f400584f0 con 0x7f1f4c0b4820 2024-03-24T10:37:11.413 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1f3806b810 msgr2=0x7f1f3806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1f3806b810 0x7f1f3806dcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c007fd0 tx=0x7f1f3c007de0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 msgr2=0x7f1f4c1f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 0x7f1f4c1f3cc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1f4000e980 tx=0x7f1f4000ee40 comp rx=0 tx=0).stop 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 shutdown_connections 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f1f3806b810 0x7f1f3806dcd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f1f4c15e0b0 0x7f1f4c159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f4c0b4820 0x7f1f4c1f3cc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 --2- 172.21.15.72:0/2722141390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f4c072350 0x7f1f4c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 >> 172.21.15.72:0/2722141390 conn(0x7f1f4c0b1810 msgr2=0x7f1f4c0adcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:11.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 shutdown_connections 2024-03-24T10:37:11.416 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.414+0000 7f1f5293a640 1 -- 172.21.15.72:0/2722141390 wait complete. 2024-03-24T10:37:11.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.528+0000 7fd227baf640 1 Processor -- start 2024-03-24T10:37:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.529+0000 7fd227baf640 1 -- start start 2024-03-24T10:37:11.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.529+0000 7fd227baf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2200d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.529+0000 7fd227baf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2200d0f70 0x7fd2200d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.529+0000 7fd227baf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2200d4950 con 0x7fd2200b3da0 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.529+0000 7fd227baf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd2200d2270 con 0x7fd2200d0f70 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.529+0000 7fd227baf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd2200b38c0 con 0x7fd22015e240 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22514a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2200d0f70 0x7fd2200d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22614c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd2200b3da0 0x7fd2200b4230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49008/0 (socket says 172.21.15.72:49008) 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22514a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd2200d0f70 0x7fd2200d2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40616/0 (socket says 172.21.15.72:40616) 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22614c640 1 -- 172.21.15.72:0/1092460092 learned_addr learned my addr 172.21.15.72:0/1092460092 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22594b640 1 --2- 172.21.15.72:0/1092460092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2200d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22514a640 1 -- 172.21.15.72:0/1092460092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 msgr2=0x7fd2200d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22514a640 1 --2- 172.21.15.72:0/1092460092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2200d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22514a640 1 -- 172.21.15.72:0/1092460092 >> v1:172.21.15.72:6789/0 conn(0x7fd2200b3da0 legacy=0x7fd2200b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd224949640 1 -- 172.21.15.72:0/1092460092 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224228592 0 0) 0x7fd2200d4950 con 0x7fd2200b3da0 2024-03-24T10:37:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.530+0000 7fd22514a640 1 -- 172.21.15.72:0/1092460092 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2200b3550 con 0x7fd2200d0f70 2024-03-24T10:37:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd22514a640 1 --2- 172.21.15.72:0/1092460092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200d0f70 0x7fd2200d2950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd2100097a0 tx=0x7fd21002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c17110f0c6aa7f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd224949640 1 -- 172.21.15.72:0/1092460092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21002e070 con 0x7fd2200d0f70 2024-03-24T10:37:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd224949640 1 -- 172.21.15.72:0/1092460092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2100315a0 con 0x7fd2200d0f70 2024-03-24T10:37:11.533 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd224949640 1 -- 172.21.15.72:0/1092460092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210031930 con 0x7fd2200d0f70 2024-03-24T10:37:11.536 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 -- 172.21.15.72:0/1092460092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200d0f70 msgr2=0x7fd2200d2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 --2- 172.21.15.72:0/1092460092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200d0f70 0x7fd2200d2950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd2100097a0 tx=0x7fd21002b840 comp rx=0 tx=0).stop 2024-03-24T10:37:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 -- 172.21.15.72:0/1092460092 shutdown_connections 2024-03-24T10:37:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 --2- 172.21.15.72:0/1092460092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200d0f70 0x7fd2200d2950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 --2- 172.21.15.72:0/1092460092 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2200d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 -- 172.21.15.72:0/1092460092 >> 172.21.15.72:0/1092460092 conn(0x7fd2200d3e30 msgr2=0x7fd2200d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:11.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 -- 172.21.15.72:0/1092460092 shutdown_connections 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.531+0000 7fd227baf640 1 -- 172.21.15.72:0/1092460092 wait complete. 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 Processor -- start 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 -- start start 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 0x7fd2200caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200d0f70 0x7fd2200c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2201f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd2200c89a0 con 0x7fd2200b3da0 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2200cc180 con 0x7fd2200d0f70 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd227baf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd2200cb600 con 0x7fd22015e240 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd22594b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 0x7fd2200caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd22594b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 0x7fd2200caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40618/0 (socket says 172.21.15.72:40618) 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd22594b640 1 -- 172.21.15.72:0/2769534503 learned_addr learned my addr 172.21.15.72:0/2769534503 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd22614c640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2201f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.533+0000 7fd22514a640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200d0f70 0x7fd2200c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22594b640 1 -- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 msgr2=0x7fd2201f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22594b640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2201f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22594b640 1 -- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200d0f70 msgr2=0x7fd2200c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22594b640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200d0f70 0x7fd2200c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22594b640 1 -- 172.21.15.72:0/2769534503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd210009400 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22614c640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2201f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd22594b640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 0x7fd2200caf00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd21800efc0 tx=0x7fd21800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218014480 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21800f040 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2200cb8e0 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd218014800 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.534+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2200cbea0 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.535+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd22004f470 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.535+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd218014960 con 0x7fd2200b3da0 2024-03-24T10:37:11.540 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.536+0000 7fd2167fc640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd20406b810 0x7fd20406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.536+0000 7fd22514a640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd20406b810 0x7fd20406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.536+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd21808b140 con 0x7fd2200b3da0 2024-03-24T10:37:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.536+0000 7fd22514a640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd20406b810 0x7fd20406dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd210036000 tx=0x7fd21003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.541 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.540+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd2180557f0 con 0x7fd2200b3da0 2024-03-24T10:37:11.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.711+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd2201f3610 con 0x7fd2200b3da0 2024-03-24T10:37:11.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.711+0000 7fd2167fc640 1 -- 172.21.15.72:0/2769534503 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fd218058eb0 con 0x7fd2200b3da0 2024-03-24T10:37:11.712 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd20406b810 msgr2=0x7fd20406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd20406b810 0x7fd20406dcd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd210036000 tx=0x7fd21003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:11.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 msgr2=0x7fd2200caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 0x7fd2200caf00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd21800efc0 tx=0x7fd21800c490 comp rx=0 tx=0).stop 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 shutdown_connections 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd20406b810 0x7fd20406dcd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd22015e240 0x7fd2201f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd2200d0f70 0x7fd2200c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 --2- 172.21.15.72:0/2769534503 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd2200b3da0 0x7fd2200caf00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.713+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 >> 172.21.15.72:0/2769534503 conn(0x7fd2200d3e30 msgr2=0x7fd2200b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.714+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 shutdown_connections 2024-03-24T10:37:11.715 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.714+0000 7fd227baf640 1 -- 172.21.15.72:0/2769534503 wait complete. 2024-03-24T10:37:11.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.825+0000 7ff23d284640 1 Processor -- start 2024-03-24T10:37:11.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.825+0000 7ff23d284640 1 -- start start 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff23d284640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff23d284640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2380d0760 con 0x7ff2380d10b0 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff23d284640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2380d1950 con 0x7ff238161c70 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff23d284640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff2380cf7c0 con 0x7ff238161890 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff236ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff2377fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff2380d10b0 0x7ff2380b37e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49010/0 (socket says 172.21.15.72:49010) 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff236ffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380d4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:54874/0 (socket says 172.21.15.72:54874) 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff2377fe640 1 -- 172.21.15.72:0/827029098 learned_addr learned my addr 172.21.15.72:0/827029098 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff235ffb640 1 -- 172.21.15.72:0/827029098 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236217075 0 0) 0x7ff2380d1950 con 0x7ff238161c70 2024-03-24T10:37:11.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff235ffb640 1 -- 172.21.15.72:0/827029098 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff220003520 con 0x7ff238161c70 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff235ffb640 1 -- 172.21.15.72:0/827029098 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961949322 0 0) 0x7ff2380d0760 con 0x7ff2380d10b0 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff236ffd640 1 -- 172.21.15.72:0/827029098 >> v1:172.21.15.79:6789/0 conn(0x7ff238161c70 legacy=0x7ff2380d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff236ffd640 1 -- 172.21.15.72:0/827029098 >> v1:172.21.15.72:6789/0 conn(0x7ff2380d10b0 legacy=0x7ff2380b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.826+0000 7ff236ffd640 1 -- 172.21.15.72:0/827029098 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2380d1670 con 0x7ff238161890 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.827+0000 7ff236ffd640 1 --2- 172.21.15.72:0/827029098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380d4ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097d0 tx=0x7ff22802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae26e87bc0392606 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.827+0000 7ff235ffb640 1 -- 172.21.15.72:0/827029098 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228031890 con 0x7ff238161890 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.827+0000 7ff235ffb640 1 -- 172.21.15.72:0/827029098 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2280319f0 con 0x7ff238161890 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.827+0000 7ff235ffb640 1 -- 172.21.15.72:0/827029098 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228031d60 con 0x7ff238161890 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 -- 172.21.15.72:0/827029098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 msgr2=0x7ff2380d4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 --2- 172.21.15.72:0/827029098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380d4ab0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff2280097d0 tx=0x7ff22802b930 comp rx=0 tx=0).stop 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 -- 172.21.15.72:0/827029098 shutdown_connections 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 --2- 172.21.15.72:0/827029098 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380d4ab0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 -- 172.21.15.72:0/827029098 >> 172.21.15.72:0/827029098 conn(0x7ff2380d3f90 msgr2=0x7ff2380d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 -- 172.21.15.72:0/827029098 shutdown_connections 2024-03-24T10:37:11.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.828+0000 7ff23d284640 1 -- 172.21.15.72:0/827029098 wait complete. 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.829+0000 7ff23d284640 1 Processor -- start 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.829+0000 7ff23d284640 1 -- start start 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff23d284640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 0x7ff238154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff23d284640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff23d284640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff238161c70 0x7ff2380cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff23d284640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff2380b9ae0 con 0x7ff2380d10b0 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff23d284640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2380c8c20 con 0x7ff238161c70 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff23d284640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff238154840 con 0x7ff238161890 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 0x7ff238154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.836 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 0x7ff238154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40630/0 (socket says 172.21.15.72:40630) 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 -- 172.21.15.72:0/294424264 learned_addr learned my addr 172.21.15.72:0/294424264 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff2367fc640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff2377fe640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff238161c70 0x7ff2380cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 -- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 msgr2=0x7ff2380cb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380cb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 -- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff238161c70 msgr2=0x7ff2380cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff238161c70 0x7ff2380cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 -- 172.21.15.72:0/294424264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff228009400 con 0x7ff2380d10b0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.830+0000 7ff236ffd640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 0x7ff238154300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff22802b970 tx=0x7ff2280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.831+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff22803ac60 con 0x7ff2380d10b0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.831+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22803adc0 con 0x7ff2380d10b0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.831+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2380b9520 con 0x7ff2380d10b0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.831+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228044610 con 0x7ff2380d10b0 2024-03-24T10:37:11.837 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.831+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2380cded0 con 0x7ff2380d10b0 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.832+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2380a1fc0 con 0x7ff2380d10b0 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.832+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff22804d430 con 0x7ff2380d10b0 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.832+0000 7ff21f7fe640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff22406b840 0x7ff22406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.832+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff2280acae0 con 0x7ff2380d10b0 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.832+0000 7ff2367fc640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff22406b840 0x7ff22406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.833+0000 7ff2367fc640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff22406b840 0x7ff22406dd00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2380cd190 tx=0x7ff22c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:11.838 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:11.837+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff2280771b0 con 0x7ff2380d10b0 2024-03-24T10:37:12.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.007+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff23808da50 con 0x7ff2380d10b0 2024-03-24T10:37:12.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.008+0000 7ff21f7fe640 1 -- 172.21.15.72:0/294424264 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7ff22807a870 con 0x7ff2380d10b0 2024-03-24T10:37:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:12.009 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff22406b840 msgr2=0x7ff22406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff22406b840 0x7ff22406dd00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff2380cd190 tx=0x7ff22c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 msgr2=0x7ff238154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 0x7ff238154300 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff22802b970 tx=0x7ff2280046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 shutdown_connections 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff22406b840 0x7ff22406dd00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff238161c70 0x7ff2380cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff238161890 0x7ff2380cb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.010+0000 7ff23d284640 1 --2- 172.21.15.72:0/294424264 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2380d10b0 0x7ff238154300 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.011+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 >> 172.21.15.72:0/294424264 conn(0x7ff2380d3f90 msgr2=0x7ff238160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.011+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 shutdown_connections 2024-03-24T10:37:12.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.011+0000 7ff23d284640 1 -- 172.21.15.72:0/294424264 wait complete. 2024-03-24T10:37:12.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:12.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.125+0000 7ff2603c7640 1 Processor -- start 2024-03-24T10:37:12.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.125+0000 7ff2603c7640 1 -- start start 2024-03-24T10:37:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff2603c7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff2580cf310 0x7ff25815b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff2603c7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff258154ea0 con 0x7ff258072470 2024-03-24T10:37:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff2603c7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff258071460 con 0x7ff2580b3580 2024-03-24T10:37:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff2603c7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff25815b9c0 con 0x7ff2580cf310 2024-03-24T10:37:12.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25d962640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff258072470 0x7ff25806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49016/0 (socket says 172.21.15.72:49016) 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25d962640 1 -- 172.21.15.72:0/4033951779 learned_addr learned my addr 172.21.15.72:0/4033951779 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25e964640 1 --2- 172.21.15.72:0/4033951779 >> v2:172.21.15.79:3300/0 conn(0x7ff2580cf310 0x7ff25815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25d161640 1 -- 172.21.15.72:0/4033951779 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263543490 0 0) 0x7ff258154ea0 con 0x7ff258072470 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25d161640 1 -- 172.21.15.72:0/4033951779 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff244003520 con 0x7ff258072470 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25e964640 1 -- 172.21.15.72:0/4033951779 >> v1:172.21.15.79:6789/0 conn(0x7ff2580b3580 legacy=0x7ff2580b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25e964640 1 -- 172.21.15.72:0/4033951779 >> v1:172.21.15.72:6789/0 conn(0x7ff258072470 legacy=0x7ff25806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25d161640 1 -- 172.21.15.72:0/4033951779 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1578432104 0 0) 0x7ff258071460 con 0x7ff2580b3580 2024-03-24T10:37:12.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.126+0000 7ff25e964640 1 -- 172.21.15.72:0/4033951779 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff258071fe0 con 0x7ff2580cf310 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.127+0000 7ff25e964640 1 --2- 172.21.15.72:0/4033951779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580cf310 0x7ff25815b480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff25000aea0 tx=0x7ff25002cfc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c8ada9d2e09886 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.127+0000 7ff25d161640 1 -- 172.21.15.72:0/4033951779 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25002db60 con 0x7ff2580cf310 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.127+0000 7ff25d161640 1 -- 172.21.15.72:0/4033951779 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25002dcc0 con 0x7ff2580cf310 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.127+0000 7ff25d161640 1 -- 172.21.15.72:0/4033951779 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff250008660 con 0x7ff2580cf310 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 -- 172.21.15.72:0/4033951779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580cf310 msgr2=0x7ff25815b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 --2- 172.21.15.72:0/4033951779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580cf310 0x7ff25815b480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff25000aea0 tx=0x7ff25002cfc0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 -- 172.21.15.72:0/4033951779 shutdown_connections 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 --2- 172.21.15.72:0/4033951779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2580cf310 0x7ff25815b480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 -- 172.21.15.72:0/4033951779 >> 172.21.15.72:0/4033951779 conn(0x7ff2580b1810 msgr2=0x7ff2580b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 -- 172.21.15.72:0/4033951779 shutdown_connections 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.128+0000 7ff2603c7640 1 -- 172.21.15.72:0/4033951779 wait complete. 2024-03-24T10:37:12.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.129+0000 7ff2603c7640 1 Processor -- start 2024-03-24T10:37:12.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.129+0000 7ff2603c7640 1 -- start start 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff2603c7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff258072470 0x7ff258159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff2603c7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 0x7ff2581e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff2603c7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2580cf310 0x7ff2581e45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff2603c7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff258151fc0 con 0x7ff2580b3580 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff2603c7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2581e4c20 con 0x7ff258072470 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff2603c7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff258150a80 con 0x7ff2580cf310 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 0x7ff2581e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 0x7ff2581e40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40646/0 (socket says 172.21.15.72:40646) 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 -- 172.21.15.72:0/1434736379 learned_addr learned my addr 172.21.15.72:0/1434736379 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25e964640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2580cf310 0x7ff2581e45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25e163640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff258072470 0x7ff258159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 -- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2580cf310 msgr2=0x7ff2581e45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2580cf310 0x7ff2581e45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 -- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff258072470 msgr2=0x7ff258159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff258072470 0x7ff258159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.130+0000 7ff25d962640 1 -- 172.21.15.72:0/1434736379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25000ab80 con 0x7ff2580b3580 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.131+0000 7ff25d962640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 0x7ff2581e40b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff248001eb0 tx=0x7ff24800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.131+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff248005ce0 con 0x7ff2580b3580 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.131+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff248005e60 con 0x7ff2580b3580 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.131+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff258150d60 con 0x7ff2580b3580 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.131+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2480072f0 con 0x7ff2580b3580 2024-03-24T10:37:12.136 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.131+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff258151320 con 0x7ff2580b3580 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.132+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff258151510 con 0x7ff2580b3580 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.132+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff248007450 con 0x7ff2580b3580 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.132+0000 7ff24effd640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff23c06b810 0x7ff23c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.133+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff248089b20 con 0x7ff2580b3580 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.133+0000 7ff25e163640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff23c06b810 0x7ff23c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.133+0000 7ff25e163640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff23c06b810 0x7ff23c06dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff254000f60 tx=0x7ff254009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.137+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff2480541f0 con 0x7ff2580b3580 2024-03-24T10:37:12.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.310+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff25804f470 con 0x7ff2580b3580 2024-03-24T10:37:12.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.311+0000 7ff24effd640 1 -- 172.21.15.72:0/1434736379 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff2480170a0 con 0x7ff2580b3580 2024-03-24T10:37:12.311 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:12.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.312+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff23c06b810 msgr2=0x7ff23c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.312+0000 7ff2603c7640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff23c06b810 0x7ff23c06dcd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff254000f60 tx=0x7ff254009040 comp rx=0 tx=0).stop 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.312+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 msgr2=0x7ff2581e40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.312+0000 7ff2603c7640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 0x7ff2581e40b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff248001eb0 tx=0x7ff24800c820 comp rx=0 tx=0).stop 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 shutdown_connections 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff23c06b810 0x7ff23c06dcd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff2580cf310 0x7ff2581e45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff2580b3580 0x7ff2581e40b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 --2- 172.21.15.72:0/1434736379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff258072470 0x7ff258159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 >> 172.21.15.72:0/1434736379 conn(0x7ff2580b1810 msgr2=0x7ff2580b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 shutdown_connections 2024-03-24T10:37:12.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.313+0000 7ff2603c7640 1 -- 172.21.15.72:0/1434736379 wait complete. 2024-03-24T10:37:12.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.428+0000 7f89163a0640 1 Processor -- start 2024-03-24T10:37:12.429 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.428+0000 7f89163a0640 1 -- start start 2024-03-24T10:37:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f89163a0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891006e8d0 0x7f89100b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f89163a0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f891015f440 0x7f8910144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f89163a0640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89100b30f0 con 0x7f891006ecb0 2024-03-24T10:37:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f89163a0640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f89100b48a0 con 0x7f891015f440 2024-03-24T10:37:12.430 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f89163a0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f89100b33d0 con 0x7f891006e8d0 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f891493d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f891015f440 0x7f8910144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f891493d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f891015f440 0x7f8910144030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40654/0 (socket says 172.21.15.72:40654) 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f890f7fe640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f891006ecb0 0x7f89100b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49020/0 (socket says 172.21.15.72:49020) 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f891493d640 1 -- 172.21.15.72:0/3279134556 learned_addr learned my addr 172.21.15.72:0/3279134556 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.429+0000 7f890ffff640 1 --2- 172.21.15.72:0/3279134556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891006e8d0 0x7f89100b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f891493d640 1 -- 172.21.15.72:0/3279134556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891006e8d0 msgr2=0x7f89100b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f891493d640 1 --2- 172.21.15.72:0/3279134556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891006e8d0 0x7f89100b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f891493d640 1 -- 172.21.15.72:0/3279134556 >> v1:172.21.15.72:6789/0 conn(0x7f891006ecb0 legacy=0x7f89100b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f891493d640 1 -- 172.21.15.72:0/3279134556 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89100b36b0 con 0x7f891015f440 2024-03-24T10:37:12.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f890effd640 1 -- 172.21.15.72:0/3279134556 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307156908 0 0) 0x7f89100b30f0 con 0x7f891006ecb0 2024-03-24T10:37:12.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f891493d640 1 --2- 172.21.15.72:0/3279134556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891015f440 0x7f8910144030 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f890800d150 tx=0x7f890802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef843af1e66d110 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f890effd640 1 -- 172.21.15.72:0/3279134556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890802ea80 con 0x7f891015f440 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f890effd640 1 -- 172.21.15.72:0/3279134556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f890802ebe0 con 0x7f891015f440 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.430+0000 7f890effd640 1 -- 172.21.15.72:0/3279134556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8908009600 con 0x7f891015f440 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 -- 172.21.15.72:0/3279134556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891015f440 msgr2=0x7f8910144030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 --2- 172.21.15.72:0/3279134556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891015f440 0x7f8910144030 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f890800d150 tx=0x7f890802e0e0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 -- 172.21.15.72:0/3279134556 shutdown_connections 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 --2- 172.21.15.72:0/3279134556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891015f440 0x7f8910144030 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 --2- 172.21.15.72:0/3279134556 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891006e8d0 0x7f89100b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 -- 172.21.15.72:0/3279134556 >> 172.21.15.72:0/3279134556 conn(0x7f89100b1810 msgr2=0x7f89100b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 -- 172.21.15.72:0/3279134556 shutdown_connections 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.431+0000 7f89163a0640 1 -- 172.21.15.72:0/3279134556 wait complete. 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.432+0000 7f89163a0640 1 Processor -- start 2024-03-24T10:37:12.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.432+0000 7f89163a0640 1 -- start start 2024-03-24T10:37:12.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f89163a0640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 0x7f89101f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f89163a0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891006ecb0 0x7f891013b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f89163a0640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891015f440 0x7f891013bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f89163a0640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f891013e510 con 0x7f891006e8d0 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f89163a0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8910137f00 con 0x7f891006ecb0 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f89163a0640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f891013d610 con 0x7f891015f440 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 0x7f89101f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 0x7f89101f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40668/0 (socket says 172.21.15.72:40668) 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 -- 172.21.15.72:0/945818943 learned_addr learned my addr 172.21.15.72:0/945818943 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890f7fe640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891006ecb0 0x7f891013b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f891493d640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891015f440 0x7f891013bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 -- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891015f440 msgr2=0x7f891013bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891015f440 0x7f891013bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 -- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891006ecb0 msgr2=0x7f891013b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891006ecb0 0x7f891013b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.433+0000 7f890ffff640 1 -- 172.21.15.72:0/945818943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890800bd40 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.434+0000 7f890ffff640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 0x7f89101f34e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f890000e9e0 tx=0x7f890000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.434+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900009670 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.434+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f890000c9d0 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.434+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891013d890 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.434+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890000cd80 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.434+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891013de50 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.435+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f891004f470 con 0x7f891006e8d0 2024-03-24T10:37:12.437 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.435+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8900013470 con 0x7f891006e8d0 2024-03-24T10:37:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.436+0000 7f890cff9640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88fc06b810 0x7f88fc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.436+0000 7f890f7fe640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88fc06b810 0x7f88fc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.436+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f890008a730 con 0x7f891006e8d0 2024-03-24T10:37:12.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.436+0000 7f890f7fe640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88fc06b810 0x7f88fc06dcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f891015ab10 tx=0x7f8904007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.440+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8900054e10 con 0x7f891006e8d0 2024-03-24T10:37:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.610+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f891006d240 con 0x7f891006e8d0 2024-03-24T10:37:12.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.611+0000 7f890cff9640 1 -- 172.21.15.72:0/945818943 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f89000584d0 con 0x7f891006e8d0 2024-03-24T10:37:12.612 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:12.613 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88fc06b810 msgr2=0x7f88fc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88fc06b810 0x7f88fc06dcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f891015ab10 tx=0x7f8904007d50 comp rx=0 tx=0).stop 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 msgr2=0x7f89101f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 0x7f89101f34e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f890000e9e0 tx=0x7f890000eea0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 shutdown_connections 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f88fc06b810 0x7f88fc06dcd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f891015f440 0x7f891013bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f891006ecb0 0x7f891013b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 --2- 172.21.15.72:0/945818943 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f891006e8d0 0x7f89101f34e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 >> 172.21.15.72:0/945818943 conn(0x7f89100b1810 msgr2=0x7f89101427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 shutdown_connections 2024-03-24T10:37:12.614 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.613+0000 7f89163a0640 1 -- 172.21.15.72:0/945818943 wait complete. 2024-03-24T10:37:12.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.727+0000 7ff637f5e640 1 Processor -- start 2024-03-24T10:37:12.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.727+0000 7ff637f5e640 1 -- start start 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff637f5e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff630144860 0x7ff6300b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff637f5e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6300b30f0 con 0x7ff63006e8d0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff637f5e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6300b33d0 con 0x7ff63006ecb0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff637f5e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff6300b48a0 con 0x7ff630144860 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff635cfa640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff63006e8d0 0x7ff6300b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49022/0 (socket says 172.21.15.72:49022) 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff635cfa640 1 -- 172.21.15.72:0/2159475984 learned_addr learned my addr 172.21.15.72:0/2159475984 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.728+0000 7ff6364fb640 1 --2- 172.21.15.72:0/2159475984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff630144860 0x7ff6300b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766439971 0 0) 0x7ff6300b30f0 con 0x7ff63006e8d0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff61c003520 con 0x7ff63006e8d0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895434952 0 0) 0x7ff6300b33d0 con 0x7ff63006ecb0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6300b30f0 con 0x7ff63006ecb0 2024-03-24T10:37:12.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff6364fb640 1 -- 172.21.15.72:0/2159475984 >> v1:172.21.15.79:6789/0 conn(0x7ff63006ecb0 legacy=0x7ff630144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff6364fb640 1 -- 172.21.15.72:0/2159475984 >> v1:172.21.15.72:6789/0 conn(0x7ff63006e8d0 legacy=0x7ff6300b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff6364fb640 1 -- 172.21.15.72:0/2159475984 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6300b36b0 con 0x7ff630144860 2024-03-24T10:37:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.729+0000 7ff6364fb640 1 --2- 172.21.15.72:0/2159475984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff630144860 0x7ff6300b2b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6280097d0 tx=0x7ff62802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c63acb94e32f323f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628031890 con 0x7ff630144860 2024-03-24T10:37:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6280319f0 con 0x7ff630144860 2024-03-24T10:37:12.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff634cf8640 1 -- 172.21.15.72:0/2159475984 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628031d80 con 0x7ff630144860 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff637f5e640 1 -- 172.21.15.72:0/2159475984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff630144860 msgr2=0x7ff6300b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2159475984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff630144860 0x7ff6300b2b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff6280097d0 tx=0x7ff62802b930 comp rx=0 tx=0).stop 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff637f5e640 1 -- 172.21.15.72:0/2159475984 shutdown_connections 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2159475984 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff630144860 0x7ff6300b2b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff637f5e640 1 -- 172.21.15.72:0/2159475984 >> 172.21.15.72:0/2159475984 conn(0x7ff6300b1810 msgr2=0x7ff6300b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.730+0000 7ff637f5e640 1 -- 172.21.15.72:0/2159475984 shutdown_connections 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.731+0000 7ff637f5e640 1 -- 172.21.15.72:0/2159475984 wait complete. 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 Processor -- start 2024-03-24T10:37:12.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 -- start start 2024-03-24T10:37:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff63006e8d0 0x7ff6300aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff63006ecb0 0x7ff63006d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 0x7ff63006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff63012d4b0 con 0x7ff630144860 2024-03-24T10:37:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6301300f0 con 0x7ff63006ecb0 2024-03-24T10:37:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff637f5e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff63012d770 con 0x7ff63006e8d0 2024-03-24T10:37:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.732+0000 7ff6364fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 0x7ff63006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 0x7ff63006db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40682/0 (socket says 172.21.15.72:40682) 2024-03-24T10:37:12.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 -- 172.21.15.72:0/2472925733 learned_addr learned my addr 172.21.15.72:0/2472925733 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff635cfa640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff63006e8d0 0x7ff6300aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6354f9640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff63006ecb0 0x7ff63006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 -- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff63006e8d0 msgr2=0x7ff6300aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff63006e8d0 0x7ff6300aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 -- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff63006ecb0 msgr2=0x7ff63006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff63006ecb0 0x7ff63006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 -- 172.21.15.72:0/2472925733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff628009400 con 0x7ff630144860 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6364fb640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 0x7ff63006db90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff628034040 tx=0x7ff6280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff62803ab60 con 0x7ff630144860 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff62803ace0 con 0x7ff630144860 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff63012da50 con 0x7ff630144860 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff628044630 con 0x7ff630144860 2024-03-24T10:37:12.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.733+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff63012f3c0 con 0x7ff630144860 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.734+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6300af580 con 0x7ff630144860 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.734+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff62804d450 con 0x7ff630144860 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.735+0000 7ff6267fc640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff61406b810 0x7ff61406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.735+0000 7ff635cfa640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff61406b810 0x7ff61406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.735+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff6280ac920 con 0x7ff630144860 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.735+0000 7ff635cfa640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff61406b810 0x7ff61406dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0012e0 tx=0x7ff62c001ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:12.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.739+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff628077060 con 0x7ff630144860 2024-03-24T10:37:12.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.911+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff63004f470 con 0x7ff630144860 2024-03-24T10:37:12.912 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.912+0000 7ff6267fc640 1 -- 172.21.15.72:0/2472925733 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff62807a720 con 0x7ff630144860 2024-03-24T10:37:12.912 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff61406b810 msgr2=0x7ff61406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff61406b810 0x7ff61406dcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0012e0 tx=0x7ff62c001ad0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 msgr2=0x7ff63006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 0x7ff63006db90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff628034040 tx=0x7ff6280046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 shutdown_connections 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff61406b810 0x7ff61406dcd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff630144860 0x7ff63006db90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff63006ecb0 0x7ff63006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.915 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 --2- 172.21.15.72:0/2472925733 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff63006e8d0 0x7ff6300aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 >> 172.21.15.72:0/2472925733 conn(0x7ff6300b1810 msgr2=0x7ff6300ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 shutdown_connections 2024-03-24T10:37:12.916 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:12.914+0000 7ff637f5e640 1 -- 172.21.15.72:0/2472925733 wait complete. 2024-03-24T10:37:12.926 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:13.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.029+0000 7f00d70ed640 1 Processor -- start 2024-03-24T10:37:13.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.029+0000 7f00d70ed640 1 -- start start 2024-03-24T10:37:13.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d70ed640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f00d0072470 0x7f00d00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d70ed640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00d015b480 0x7f00d006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d70ed640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d0154ea0 con 0x7f00d00b3580 2024-03-24T10:37:13.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d70ed640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f00d0071460 con 0x7f00d015b480 2024-03-24T10:37:13.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d70ed640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f00d0071fe0 con 0x7f00d0072470 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00d015b480 0x7f00d006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f00d015b480 0x7f00d006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40690/0 (socket says 172.21.15.72:40690) 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 -- 172.21.15.72:0/2968410887 learned_addr learned my addr 172.21.15.72:0/2968410887 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00cffff640 1 --2- 172.21.15.72:0/2968410887 >> v2:172.21.15.79:3300/0 conn(0x7f00d0072470 0x7f00d00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 -- 172.21.15.72:0/2968410887 >> v2:172.21.15.79:3300/0 conn(0x7f00d0072470 msgr2=0x7f00d00cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 --2- 172.21.15.72:0/2968410887 >> v2:172.21.15.79:3300/0 conn(0x7f00d0072470 0x7f00d00cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 -- 172.21.15.72:0/2968410887 >> v1:172.21.15.79:6789/0 conn(0x7f00d00b3580 legacy=0x7f00d00b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.030+0000 7f00d568a640 1 -- 172.21.15.72:0/2968410887 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d015b910 con 0x7f00d015b480 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d568a640 1 --2- 172.21.15.72:0/2968410887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d006d550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00d00b4eb0 tx=0x7f00c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25586ac08a3006c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00cf7fe640 1 -- 172.21.15.72:0/2968410887 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c802ca80 con 0x7f00d015b480 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00cf7fe640 1 -- 172.21.15.72:0/2968410887 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c802cbe0 con 0x7f00d015b480 2024-03-24T10:37:13.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00cf7fe640 1 -- 172.21.15.72:0/2968410887 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c80343f0 con 0x7f00d015b480 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 -- 172.21.15.72:0/2968410887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 msgr2=0x7f00d006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 --2- 172.21.15.72:0/2968410887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d006d550 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f00d00b4eb0 tx=0x7f00c802bee0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 -- 172.21.15.72:0/2968410887 shutdown_connections 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 --2- 172.21.15.72:0/2968410887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d006d550 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 --2- 172.21.15.72:0/2968410887 >> v2:172.21.15.79:3300/0 conn(0x7f00d0072470 0x7f00d00cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 -- 172.21.15.72:0/2968410887 >> 172.21.15.72:0/2968410887 conn(0x7f00d00b1810 msgr2=0x7f00d00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 -- 172.21.15.72:0/2968410887 shutdown_connections 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.031+0000 7f00d70ed640 1 -- 172.21.15.72:0/2968410887 wait complete. 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 Processor -- start 2024-03-24T10:37:13.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 -- start start 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00d0072470 0x7f00d014cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d00b3580 0x7f00d015c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d015ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f00d01f07e0 con 0x7f00d015b480 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00d014f060 con 0x7f00d00b3580 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.033+0000 7f00d70ed640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f00d014f340 con 0x7f00d0072470 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d015ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d015ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40694/0 (socket says 172.21.15.72:40694) 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 -- 172.21.15.72:0/3032383067 learned_addr learned my addr 172.21.15.72:0/3032383067 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00cffff640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d00b3580 0x7f00d015c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d4e89640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00d0072470 0x7f00d014cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 -- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00d0072470 msgr2=0x7f00d014cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00d0072470 0x7f00d014cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 -- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d00b3580 msgr2=0x7f00d015c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d00b3580 0x7f00d015c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 -- 172.21.15.72:0/3032383067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c8009b30 con 0x7f00d015b480 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d568a640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d015ce30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00c8036040 tx=0x7f00c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c8009510 con 0x7f00d015b480 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00c803e450 con 0x7f00d015b480 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d014f620 con 0x7f00d015b480 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c803e800 con 0x7f00d015b480 2024-03-24T10:37:13.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.034+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d014d440 con 0x7f00d015b480 2024-03-24T10:37:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.035+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d01f0930 con 0x7f00d015b480 2024-03-24T10:37:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.036+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f00c802cd50 con 0x7f00d015b480 2024-03-24T10:37:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.036+0000 7f00cd7fa640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f00b406b810 0x7f00b406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.036+0000 7f00d4e89640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f00b406b810 0x7f00b406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.036+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f00c80acf60 con 0x7f00d015b480 2024-03-24T10:37:13.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.037+0000 7f00d4e89640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f00b406b810 0x7f00b406dcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00d0165350 tx=0x7f00c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.040+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f00d01f0930 con 0x7f00d015b480 2024-03-24T10:37:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.211+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f00d01f0930 con 0x7f00d015b480 2024-03-24T10:37:13.212 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.211+0000 7f00cd7fa640 1 -- 172.21.15.72:0/3032383067 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f00c8043020 con 0x7f00d015b480 2024-03-24T10:37:13.212 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:13.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.213+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f00b406b810 msgr2=0x7f00b406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.213+0000 7f00d70ed640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f00b406b810 0x7f00b406dcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00d0165350 tx=0x7f00c4009040 comp rx=0 tx=0).stop 2024-03-24T10:37:13.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.213+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 msgr2=0x7f00d015ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.213+0000 7f00d70ed640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d015ce30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00c8036040 tx=0x7f00c8004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:13.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 shutdown_connections 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f00b406b810 0x7f00b406dcd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f00d015b480 0x7f00d015ce30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00d00b3580 0x7f00d015c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 --2- 172.21.15.72:0/3032383067 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f00d0072470 0x7f00d014cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 >> 172.21.15.72:0/3032383067 conn(0x7f00d00b1810 msgr2=0x7f00d015bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 shutdown_connections 2024-03-24T10:37:13.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.214+0000 7f00d70ed640 1 -- 172.21.15.72:0/3032383067 wait complete. 2024-03-24T10:37:13.265 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-24T10:37:13.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.365+0000 7f5c071f6640 1 Processor -- start 2024-03-24T10:37:13.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c071f6640 1 -- start start 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c071f6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c0015e170 0x7f5c0015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c071f6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5c000d2450 0x7f5c000b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c071f6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c000d4e50 con 0x7f5c000d4930 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c071f6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5c000cf790 con 0x7f5c0015e170 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c071f6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5c000cfa70 con 0x7f5c000d2450 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c04f92640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c0015e170 0x7f5c0015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5bfffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5c000d4930 0x7f5c000d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49032/0 (socket says 172.21.15.72:49032) 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5c04f92640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5c0015e170 0x7f5c0015e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40696/0 (socket says 172.21.15.72:40696) 2024-03-24T10:37:13.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.366+0000 7f5bfffff640 1 -- 172.21.15.72:0/1655554128 learned_addr learned my addr 172.21.15.72:0/1655554128 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5c05793640 1 --2- 172.21.15.72:0/1655554128 >> v2:172.21.15.79:3300/0 conn(0x7f5c000d2450 0x7f5c000b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5c04f92640 1 -- 172.21.15.72:0/1655554128 >> v2:172.21.15.79:3300/0 conn(0x7f5c000d2450 msgr2=0x7f5c000b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5c04f92640 1 --2- 172.21.15.72:0/1655554128 >> v2:172.21.15.79:3300/0 conn(0x7f5c000d2450 0x7f5c000b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5c04f92640 1 -- 172.21.15.72:0/1655554128 >> v1:172.21.15.72:6789/0 conn(0x7f5c000d4930 legacy=0x7f5c000d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5c04f92640 1 -- 172.21.15.72:0/1655554128 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c000cfd50 con 0x7f5c0015e170 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5bff7fe640 1 -- 172.21.15.72:0/1655554128 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726788095 0 0) 0x7f5c000d4e50 con 0x7f5c000d4930 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.367+0000 7f5c04f92640 1 --2- 172.21.15.72:0/1655554128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c0015e550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c000ce640 tx=0x7f5bf802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbcec36f97c99c36 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5bff7fe640 1 -- 172.21.15.72:0/1655554128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf802cbf0 con 0x7f5c0015e170 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5bff7fe640 1 -- 172.21.15.72:0/1655554128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf802cd50 con 0x7f5c0015e170 2024-03-24T10:37:13.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5bff7fe640 1 -- 172.21.15.72:0/1655554128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8034660 con 0x7f5c0015e170 2024-03-24T10:37:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 -- 172.21.15.72:0/1655554128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 msgr2=0x7f5c0015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1655554128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c0015e550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c000ce640 tx=0x7f5bf802be40 comp rx=0 tx=0).stop 2024-03-24T10:37:13.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 -- 172.21.15.72:0/1655554128 shutdown_connections 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1655554128 >> v2:172.21.15.79:3300/0 conn(0x7f5c000d2450 0x7f5c000b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1655554128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c0015e550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 -- 172.21.15.72:0/1655554128 >> 172.21.15.72:0/1655554128 conn(0x7f5c0009d310 msgr2=0x7f5c000d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 -- 172.21.15.72:0/1655554128 shutdown_connections 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.368+0000 7f5c071f6640 1 -- 172.21.15.72:0/1655554128 wait complete. 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.369+0000 7f5c071f6640 1 Processor -- start 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.369+0000 7f5c071f6640 1 -- start start 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c071f6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c000d2450 0x7f5c000b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c071f6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c000d4930 0x7f5c0015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c071f6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c00154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c071f6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5c000b8310 con 0x7f5c0015e170 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c071f6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5c000b85f0 con 0x7f5c000d2450 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c071f6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5c000b88d0 con 0x7f5c000d4930 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c05793640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c00154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c05793640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c00154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40704/0 (socket says 172.21.15.72:40704) 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c05793640 1 -- 172.21.15.72:0/1643094185 learned_addr learned my addr 172.21.15.72:0/1643094185 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5c04f92640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c000d2450 0x7f5c000b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.370+0000 7f5bfffff640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c000d4930 0x7f5c0015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c05793640 1 -- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c000d4930 msgr2=0x7f5c0015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c05793640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c000d4930 0x7f5c0015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c05793640 1 -- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c000d2450 msgr2=0x7f5c000b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c05793640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c000d2450 0x7f5c000b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c05793640 1 -- 172.21.15.72:0/1643094185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf8009a70 con 0x7f5c0015e170 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c05793640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c00154fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000e930 tx=0x7f5bf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0009690 con 0x7f5c0015e170 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf000c980 con 0x7f5c0015e170 2024-03-24T10:37:13.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c000a1030 con 0x7f5c0015e170 2024-03-24T10:37:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000cd30 con 0x7f5c0015e170 2024-03-24T10:37:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.371+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c000a0d20 con 0x7f5c0015e170 2024-03-24T10:37:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.372+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c000a1550 con 0x7f5c0015e170 2024-03-24T10:37:13.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.372+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5bf0013470 con 0x7f5c0015e170 2024-03-24T10:37:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.373+0000 7f5bfd7fa640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5bec06b840 0x7f5bec06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.373+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5bf008a6b0 con 0x7f5c0015e170 2024-03-24T10:37:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.373+0000 7f5c04f92640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5bec06b840 0x7f5bec06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.373+0000 7f5c04f92640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5bec06b840 0x7f5bec06dd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8036000 tx=0x7f5bf8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.377+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5c000a1550 con 0x7f5c0015e170 2024-03-24T10:37:13.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.549+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c000a1550 con 0x7f5c0015e170 2024-03-24T10:37:13.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.550+0000 7f5bfd7fa640 1 -- 172.21.15.72:0/1643094185 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f5c000a1550 con 0x7f5c0015e170 2024-03-24T10:37:13.551 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:13.551 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5bec06b840 msgr2=0x7f5bec06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5bec06b840 0x7f5bec06dd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8036000 tx=0x7f5bf8030000 comp rx=0 tx=0).stop 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 msgr2=0x7f5c00154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c00154fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000e930 tx=0x7f5bf000edf0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 shutdown_connections 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5bec06b840 0x7f5bec06dd00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.553 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5c0015e170 0x7f5c00154fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5c000d4930 0x7f5c0015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 --2- 172.21.15.72:0/1643094185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5c000d2450 0x7f5c000b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 >> 172.21.15.72:0/1643094185 conn(0x7f5c0009d310 msgr2=0x7f5c000b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 shutdown_connections 2024-03-24T10:37:13.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.552+0000 7f5c071f6640 1 -- 172.21.15.72:0/1643094185 wait complete. 2024-03-24T10:37:13.564 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:13.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:13.667 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.667+0000 7fd537455640 1 Processor -- start 2024-03-24T10:37:13.668 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.667+0000 7fd537455640 1 -- start start 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd537455640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd530072470 0x7fd5300cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd537455640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53015b480 0x7fd53006d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd537455640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd530154ea0 con 0x7fd5300b3580 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd537455640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd530071460 con 0x7fd530072470 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd537455640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd530071fe0 con 0x7fd53015b480 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd530072470 0x7fd5300cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd530072470 0x7fd5300cf310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40716/0 (socket says 172.21.15.72:40716) 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 -- 172.21.15.72:0/3848206930 learned_addr learned my addr 172.21.15.72:0/3848206930 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5359f2640 1 --2- 172.21.15.72:0/3848206930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53015b480 0x7fd53006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 -- 172.21.15.72:0/3848206930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53015b480 msgr2=0x7fd53006d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:13.669 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 --2- 172.21.15.72:0/3848206930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53015b480 0x7fd53006d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 -- 172.21.15.72:0/3848206930 >> v1:172.21.15.79:6789/0 conn(0x7fd5300b3580 legacy=0x7fd5300b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd527fff640 1 -- 172.21.15.72:0/3848206930 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409724164 0 0) 0x7fd530154ea0 con 0x7fd5300b3580 2024-03-24T10:37:13.670 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.668+0000 7fd5349f0640 1 -- 172.21.15.72:0/3848206930 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53015b910 con 0x7fd530072470 2024-03-24T10:37:13.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.669+0000 7fd5349f0640 1 --2- 172.21.15.72:0/3848206930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd5300cf310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd520009870 tx=0x7fd52002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd055114fc0da5b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.669+0000 7fd527fff640 1 -- 172.21.15.72:0/3848206930 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520031640 con 0x7fd530072470 2024-03-24T10:37:13.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.669+0000 7fd527fff640 1 -- 172.21.15.72:0/3848206930 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5200317a0 con 0x7fd530072470 2024-03-24T10:37:13.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.669+0000 7fd527fff640 1 -- 172.21.15.72:0/3848206930 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520031b30 con 0x7fd530072470 2024-03-24T10:37:13.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 -- 172.21.15.72:0/3848206930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 msgr2=0x7fd5300cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 --2- 172.21.15.72:0/3848206930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd5300cf310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd520009870 tx=0x7fd52002b8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 -- 172.21.15.72:0/3848206930 shutdown_connections 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 --2- 172.21.15.72:0/3848206930 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd53015b480 0x7fd53006d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 --2- 172.21.15.72:0/3848206930 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd5300cf310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 -- 172.21.15.72:0/3848206930 >> 172.21.15.72:0/3848206930 conn(0x7fd5300b1810 msgr2=0x7fd5300b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 -- 172.21.15.72:0/3848206930 shutdown_connections 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.670+0000 7fd537455640 1 -- 172.21.15.72:0/3848206930 wait complete. 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.671+0000 7fd537455640 1 Processor -- start 2024-03-24T10:37:13.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.671+0000 7fd537455640 1 -- start start 2024-03-24T10:37:13.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd53014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5300b3580 0x7fd53014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53015b480 0x7fd53014a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd53014ada0 con 0x7fd530072470 2024-03-24T10:37:13.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd53014aff0 con 0x7fd53015b480 2024-03-24T10:37:13.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd53014b2d0 con 0x7fd5300b3580 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd53014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd53014c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40720/0 (socket says 172.21.15.72:40720) 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 -- 172.21.15.72:0/4040984074 learned_addr learned my addr 172.21.15.72:0/4040984074 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5359f2640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53015b480 0x7fd53014a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5349f0640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5300b3580 0x7fd53014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 -- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5300b3580 msgr2=0x7fd53014a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5300b3580 0x7fd53014a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 -- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53015b480 msgr2=0x7fd53014a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53015b480 0x7fd53014a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 -- 172.21.15.72:0/4040984074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5200094d0 con 0x7fd530072470 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd5351f1640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd53014c090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c410 tx=0x7fd52c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0035f0 con 0x7fd530072470 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd52c003770 con 0x7fd530072470 2024-03-24T10:37:13.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53014b5b0 con 0x7fd530072470 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.672+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52c003b20 con 0x7fd530072470 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.673+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd53014bb70 con 0x7fd530072470 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.674+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53004f470 con 0x7fd530072470 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.674+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd52c003c80 con 0x7fd530072470 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.674+0000 7fd525ffb640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd51406b810 0x7fd51406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.674+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd52c089ac0 con 0x7fd530072470 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.674+0000 7fd5349f0640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd51406b810 0x7fd51406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.675+0000 7fd5349f0640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd51406b810 0x7fd51406dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd520036000 tx=0x7fd52003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.679 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.679+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd52c054220 con 0x7fd530072470 2024-03-24T10:37:13.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.849+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd5300710e0 con 0x7fd530072470 2024-03-24T10:37:13.850 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.850+0000 7fd525ffb640 1 -- 172.21.15.72:0/4040984074 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fd52c089e60 con 0x7fd530072470 2024-03-24T10:37:13.851 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd51406b810 msgr2=0x7fd51406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd51406b810 0x7fd51406dcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd520036000 tx=0x7fd52003c040 comp rx=0 tx=0).stop 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 msgr2=0x7fd53014c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd53014c090 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00c410 tx=0x7fd52c00c8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 shutdown_connections 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd51406b810 0x7fd51406dcd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd53015b480 0x7fd53014a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd5300b3580 0x7fd53014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 --2- 172.21.15.72:0/4040984074 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd530072470 0x7fd53014c090 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 >> 172.21.15.72:0/4040984074 conn(0x7fd5300b1810 msgr2=0x7fd53015bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 shutdown_connections 2024-03-24T10:37:13.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.852+0000 7fd537455640 1 -- 172.21.15.72:0/4040984074 wait complete. 2024-03-24T10:37:13.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:13.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.966+0000 7f93fc66f640 1 Processor -- start 2024-03-24T10:37:13.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.966+0000 7f93fc66f640 1 -- start start 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fc66f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93f406ba90 0x7f93f415ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fc66f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f4161ae0 0x7f93f40b3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fc66f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f93f4161f40 0x7f93f40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fc66f640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f93f406be70 con 0x7f93f406ba90 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fc66f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f93f415e4f0 con 0x7f93f4161f40 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fc66f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f93f415f440 con 0x7f93f4161ae0 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93f406ba90 0x7f93f415ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93f406ba90 0x7f93f415ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40730/0 (socket says 172.21.15.72:40730) 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 -- 172.21.15.72:0/3783527321 learned_addr learned my addr 172.21.15.72:0/3783527321 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fac0c640 1 --2- 172.21.15.72:0/3783527321 >> v2:172.21.15.79:3300/0 conn(0x7f93f4161f40 0x7f93f40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93f9c0a640 1 --2- 172.21.15.72:0/3783527321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f4161ae0 0x7f93f40b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 -- 172.21.15.72:0/3783527321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f4161ae0 msgr2=0x7f93f40b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 --2- 172.21.15.72:0/3783527321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f4161ae0 0x7f93f40b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 -- 172.21.15.72:0/3783527321 >> v2:172.21.15.79:3300/0 conn(0x7f93f4161f40 msgr2=0x7f93f40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 --2- 172.21.15.72:0/3783527321 >> v2:172.21.15.79:3300/0 conn(0x7f93f4161f40 0x7f93f40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.967+0000 7f93fa40b640 1 -- 172.21.15.72:0/3783527321 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f41624c0 con 0x7f93f406ba90 2024-03-24T10:37:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.968+0000 7f93fa40b640 1 --2- 172.21.15.72:0/3783527321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f406ba90 0x7f93f415ef00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f93f4072a70 tx=0x7f93f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2241c8499084fa6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.968+0000 7f93f9409640 1 -- 172.21.15.72:0/3783527321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f002ca70 con 0x7f93f406ba90 2024-03-24T10:37:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.968+0000 7f93f9409640 1 -- 172.21.15.72:0/3783527321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f002cbd0 con 0x7f93f406ba90 2024-03-24T10:37:13.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.968+0000 7f93f9409640 1 -- 172.21.15.72:0/3783527321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f00343f0 con 0x7f93f406ba90 2024-03-24T10:37:13.972 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 -- 172.21.15.72:0/3783527321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f406ba90 msgr2=0x7f93f415ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 --2- 172.21.15.72:0/3783527321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f406ba90 0x7f93f415ef00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f93f4072a70 tx=0x7f93f002bed0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 -- 172.21.15.72:0/3783527321 shutdown_connections 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 --2- 172.21.15.72:0/3783527321 >> v2:172.21.15.79:3300/0 conn(0x7f93f4161f40 0x7f93f40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 --2- 172.21.15.72:0/3783527321 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f4161ae0 0x7f93f40b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 --2- 172.21.15.72:0/3783527321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f406ba90 0x7f93f415ef00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 -- 172.21.15.72:0/3783527321 >> 172.21.15.72:0/3783527321 conn(0x7f93f40b2100 msgr2=0x7f93f40b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:13.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 -- 172.21.15.72:0/3783527321 shutdown_connections 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.969+0000 7f93fc66f640 1 -- 172.21.15.72:0/3783527321 wait complete. 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.970+0000 7f93fc66f640 1 Processor -- start 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.970+0000 7f93fc66f640 1 -- start start 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fc66f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f406ba90 0x7f93f4146070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fc66f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f4161ae0 0x7f93f4137b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fc66f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 0x7f93f40ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fc66f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f93f4147260 con 0x7f93f4161f40 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fc66f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f93f4138090 con 0x7f93f4161ae0 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fc66f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f93f4146650 con 0x7f93f406ba90 2024-03-24T10:37:13.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 0x7f93f40ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 0x7f93f40ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40746/0 (socket says 172.21.15.72:40746) 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 -- 172.21.15.72:0/753019525 learned_addr learned my addr 172.21.15.72:0/753019525 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93f9c0a640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f4161ae0 0x7f93f4137b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fa40b640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f406ba90 0x7f93f4146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 -- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f406ba90 msgr2=0x7f93f4146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f406ba90 0x7f93f4146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 -- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f4161ae0 msgr2=0x7f93f4137b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f4161ae0 0x7f93f4137b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.971+0000 7f93fac0c640 1 -- 172.21.15.72:0/753019525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93f0009b30 con 0x7f93f4161f40 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.972+0000 7f93fac0c640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 0x7f93f40ae890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00e930 tx=0x7f93ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.972+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec009690 con 0x7f93f4161f40 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.972+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ec00c980 con 0x7f93f4161f40 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.972+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93f4146930 con 0x7f93f4161f40 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.972+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00cd30 con 0x7f93f4161f40 2024-03-24T10:37:13.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.972+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93f4146ef0 con 0x7f93f4161f40 2024-03-24T10:37:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.973+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93f4147410 con 0x7f93f4161f40 2024-03-24T10:37:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.973+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f93ec013470 con 0x7f93f4161f40 2024-03-24T10:37:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.973+0000 7f93eaffd640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f93d806b810 0x7f93d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:13.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.974+0000 7f93fa40b640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f93d806b810 0x7f93d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.974+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f93ec08a790 con 0x7f93f4161f40 2024-03-24T10:37:13.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.974+0000 7f93fa40b640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f93d806b810 0x7f93d806dcd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f93f0035000 tx=0x7f93f0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:13.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:13.978+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f93f4147410 con 0x7f93f4161f40 2024-03-24T10:37:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.148+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f93f40b5420 con 0x7f93f4161f40 2024-03-24T10:37:14.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.148+0000 7f93eaffd640 1 -- 172.21.15.72:0/753019525 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f93ec054f20 con 0x7f93f4161f40 2024-03-24T10:37:14.149 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f93d806b810 msgr2=0x7f93d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f93d806b810 0x7f93d806dcd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f93f0035000 tx=0x7f93f0030000 comp rx=0 tx=0).stop 2024-03-24T10:37:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 msgr2=0x7f93f40ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 0x7f93f40ae890 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00e930 tx=0x7f93ec00edf0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 shutdown_connections 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f93d806b810 0x7f93d806dcd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93f4161f40 0x7f93f40ae890 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f93f4161ae0 0x7f93f4137b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.150+0000 7f93fc66f640 1 --2- 172.21.15.72:0/753019525 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f93f406ba90 0x7f93f4146070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.151+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 >> 172.21.15.72:0/753019525 conn(0x7f93f40b2100 msgr2=0x7f93f4143bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.151+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 shutdown_connections 2024-03-24T10:37:14.152 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.151+0000 7f93fc66f640 1 -- 172.21.15.72:0/753019525 wait complete. 2024-03-24T10:37:14.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:14.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.267+0000 7feb008d4640 1 Processor -- start 2024-03-24T10:37:14.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.267+0000 7feb008d4640 1 -- start start 2024-03-24T10:37:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feb008d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feafc06ecb0 0x7feafc0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feb008d4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feafc0b30f0 con 0x7feafc06e8d0 2024-03-24T10:37:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feb008d4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feafc0b33d0 con 0x7feafc15f440 2024-03-24T10:37:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feb008d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7feafc0b48a0 con 0x7feafc06ecb0 2024-03-24T10:37:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feaf9d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feafc06ecb0 0x7feafc0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feafa59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feafc06e8d0 0x7feafc0b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49040/0 (socket says 172.21.15.72:49040) 2024-03-24T10:37:14.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.268+0000 7feafa59c640 1 -- 172.21.15.72:0/726017521 learned_addr learned my addr 172.21.15.72:0/726017521 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf9d9b640 1 -- 172.21.15.72:0/726017521 >> v1:172.21.15.79:6789/0 conn(0x7feafc15f440 legacy=0x7feafc144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf9d9b640 1 -- 172.21.15.72:0/726017521 >> v1:172.21.15.72:6789/0 conn(0x7feafc06e8d0 legacy=0x7feafc0b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf959a640 1 -- 172.21.15.72:0/726017521 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114456718 0 0) 0x7feafc0b30f0 con 0x7feafc06e8d0 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf9d9b640 1 -- 172.21.15.72:0/726017521 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc0b36b0 con 0x7feafc06ecb0 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf9d9b640 1 --2- 172.21.15.72:0/726017521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06ecb0 0x7feafc0b2b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feae40097d0 tx=0x7feae402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f155bc42a2223c68 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf959a640 1 -- 172.21.15.72:0/726017521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4030610 con 0x7feafc06ecb0 2024-03-24T10:37:14.281 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf959a640 1 -- 172.21.15.72:0/726017521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feae4030770 con 0x7feafc06ecb0 2024-03-24T10:37:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.269+0000 7feaf959a640 1 -- 172.21.15.72:0/726017521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae4030b00 con 0x7feafc06ecb0 2024-03-24T10:37:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 -- 172.21.15.72:0/726017521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06ecb0 msgr2=0x7feafc0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 --2- 172.21.15.72:0/726017521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06ecb0 0x7feafc0b2b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feae40097d0 tx=0x7feae402b960 comp rx=0 tx=0).stop 2024-03-24T10:37:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 -- 172.21.15.72:0/726017521 shutdown_connections 2024-03-24T10:37:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 --2- 172.21.15.72:0/726017521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06ecb0 0x7feafc0b2b10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 -- 172.21.15.72:0/726017521 >> 172.21.15.72:0/726017521 conn(0x7feafc0b1810 msgr2=0x7feafc0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 -- 172.21.15.72:0/726017521 shutdown_connections 2024-03-24T10:37:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.270+0000 7feb008d4640 1 -- 172.21.15.72:0/726017521 wait complete. 2024-03-24T10:37:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.271+0000 7feb008d4640 1 Processor -- start 2024-03-24T10:37:14.283 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.271+0000 7feb008d4640 1 -- start start 2024-03-24T10:37:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feb008d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 0x7feafc139140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feb008d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feafc06ecb0 0x7feafc0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feb008d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc15f440 0x7feafc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feb008d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7feafc0c5c30 con 0x7feafc06e8d0 2024-03-24T10:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feb008d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feafc0aea40 con 0x7feafc06ecb0 2024-03-24T10:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feb008d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7feafc0c5950 con 0x7feafc15f440 2024-03-24T10:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 0x7feafc139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 0x7feafc139140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40752/0 (socket says 172.21.15.72:40752) 2024-03-24T10:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 -- 172.21.15.72:0/2402688427 learned_addr learned my addr 172.21.15.72:0/2402688427 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feaf9d9b640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feafc06ecb0 0x7feafc0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafad9d640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc15f440 0x7feafc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 -- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc15f440 msgr2=0x7feafc070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc15f440 0x7feafc070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 -- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feafc06ecb0 msgr2=0x7feafc0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feafc06ecb0 0x7feafc0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.286 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feafa59c640 1 -- 172.21.15.72:0/2402688427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae4009400 con 0x7feafc06e8d0 2024-03-24T10:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.272+0000 7feaf9d9b640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feafc06ecb0 0x7feafc0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.273+0000 7feafa59c640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 0x7feafc139140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c8c0 tx=0x7feaf400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.273+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf400a640 con 0x7feafc06e8d0 2024-03-24T10:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.273+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf400a7a0 con 0x7feafc06e8d0 2024-03-24T10:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.273+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf400ab50 con 0x7feafc06e8d0 2024-03-24T10:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.273+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc0ae3f0 con 0x7feafc06e8d0 2024-03-24T10:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.273+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc0af410 con 0x7feafc06e8d0 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.274+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc0ae250 con 0x7feafc06e8d0 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.274+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7feaf400acb0 con 0x7feafc06e8d0 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.274+0000 7feaf2ffd640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feadc06b810 0x7feadc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.275+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7feaf4089d40 con 0x7feafc06e8d0 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.275+0000 7feaf9d9b640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feadc06b810 0x7feadc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.275+0000 7feaf9d9b640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feadc06b810 0x7feadc06dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feae4036000 tx=0x7feae4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.279+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7feafc0ae250 con 0x7feafc06e8d0 2024-03-24T10:37:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.453+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feafc0ae250 con 0x7feafc06e8d0 2024-03-24T10:37:14.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.454+0000 7feaf2ffd640 1 -- 172.21.15.72:0/2402688427 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7feafc0ae250 con 0x7feafc06e8d0 2024-03-24T10:37:14.455 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feadc06b810 msgr2=0x7feadc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feadc06b810 0x7feadc06dcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7feae4036000 tx=0x7feae4008030 comp rx=0 tx=0).stop 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 msgr2=0x7feafc139140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 0x7feafc139140 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7feaf400c8c0 tx=0x7feaf400cd80 comp rx=0 tx=0).stop 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 shutdown_connections 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7feadc06b810 0x7feadc06dcd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7feafc15f440 0x7feafc070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feafc06ecb0 0x7feafc0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 --2- 172.21.15.72:0/2402688427 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feafc06e8d0 0x7feafc139140 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 >> 172.21.15.72:0/2402688427 conn(0x7feafc0b1810 msgr2=0x7feafc15e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 shutdown_connections 2024-03-24T10:37:14.457 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.456+0000 7feb008d4640 1 -- 172.21.15.72:0/2402688427 wait complete. 2024-03-24T10:37:14.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:14.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.571+0000 7fa9f75b5640 1 Processor -- start 2024-03-24T10:37:14.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.571+0000 7fa9f75b5640 1 -- start start 2024-03-24T10:37:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f75b5640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9f0159ac0 0x7fa9f006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f75b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f0160390 0x7fa9f006b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f75b5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00afca0 con 0x7fa9f006b670 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f75b5640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f015c390 con 0x7fa9f0159ac0 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f75b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0160930 con 0x7fa9f0160390 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9f0159ac0 0x7fa9f006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa9f0159ac0 0x7fa9f006f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40760/0 (socket says 172.21.15.72:40760) 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 -- 172.21.15.72:0/3334055967 learned_addr learned my addr 172.21.15.72:0/3334055967 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f4b50640 1 --2- 172.21.15.72:0/3334055967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f0160390 0x7fa9f006b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 -- 172.21.15.72:0/3334055967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f0160390 msgr2=0x7fa9f006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 --2- 172.21.15.72:0/3334055967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f0160390 0x7fa9f006b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 -- 172.21.15.72:0/3334055967 >> v1:172.21.15.79:6789/0 conn(0x7fa9f006b670 legacy=0x7fa9f00715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.572+0000 7fa9f5351640 1 -- 172.21.15.72:0/3334055967 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f015c5a0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.573+0000 7fa9f5351640 1 --2- 172.21.15.72:0/3334055967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f006f0e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009870 tx=0x7fa9ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92df80a0d399c07 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.573+0000 7fa9e7fff640 1 -- 172.21.15.72:0/3334055967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec031640 con 0x7fa9f0159ac0 2024-03-24T10:37:14.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.573+0000 7fa9e7fff640 1 -- 172.21.15.72:0/3334055967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9ec0317a0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.575 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.573+0000 7fa9e7fff640 1 -- 172.21.15.72:0/3334055967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec031b30 con 0x7fa9f0159ac0 2024-03-24T10:37:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.573+0000 7fa9f75b5640 1 -- 172.21.15.72:0/3334055967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 msgr2=0x7fa9f006f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.573+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/3334055967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f006f0e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec009870 tx=0x7fa9ec02b8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.574+0000 7fa9f75b5640 1 -- 172.21.15.72:0/3334055967 shutdown_connections 2024-03-24T10:37:14.577 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.574+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/3334055967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f0160390 0x7fa9f006b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.574+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/3334055967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f006f0e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.574+0000 7fa9f75b5640 1 -- 172.21.15.72:0/3334055967 >> 172.21.15.72:0/3334055967 conn(0x7fa9f00b2100 msgr2=0x7fa9f00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.574+0000 7fa9f75b5640 1 -- 172.21.15.72:0/3334055967 shutdown_connections 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.574+0000 7fa9f75b5640 1 -- 172.21.15.72:0/3334055967 wait complete. 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 Processor -- start 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 -- start start 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f006b670 0x7fa9f014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f00b4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f0160390 0x7fa9f00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f014a810 con 0x7fa9f0159ac0 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f0159ea0 con 0x7fa9f0160390 2024-03-24T10:37:14.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.575+0000 7fa9f75b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f015b850 con 0x7fa9f006b670 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f00b4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f00b4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40774/0 (socket says 172.21.15.72:40774) 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 -- 172.21.15.72:0/2548585861 learned_addr learned my addr 172.21.15.72:0/2548585861 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f5351640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f006b670 0x7fa9f014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f5b52640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f0160390 0x7fa9f00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 -- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f006b670 msgr2=0x7fa9f014d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f006b670 0x7fa9f014d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 -- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f0160390 msgr2=0x7fa9f00b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f0160390 0x7fa9f00b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 -- 172.21.15.72:0/2548585861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec0094d0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f4b50640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f00b4940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000e9b0 tx=0x7fa9e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0009670 con 0x7fa9f0159ac0 2024-03-24T10:37:14.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e000c9a0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9f015a3d0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e000cd50 con 0x7fa9f0159ac0 2024-03-24T10:37:14.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.576+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9f015baf0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.577+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9f00ad840 con 0x7fa9f0159ac0 2024-03-24T10:37:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.578+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa9e0013470 con 0x7fa9f0159ac0 2024-03-24T10:37:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.578+0000 7fa9e5ffb640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa9d406b810 0x7fa9d406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.578+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa9e008a6b0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.578+0000 7fa9f5351640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa9d406b810 0x7fa9d406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.579+0000 7fa9f5351640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa9d406b810 0x7fa9d406dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec036000 tx=0x7fa9ec03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.583+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa9e0054e10 con 0x7fa9f0159ac0 2024-03-24T10:37:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.752+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa9f004f470 con 0x7fa9f0159ac0 2024-03-24T10:37:14.753 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.753+0000 7fa9e5ffb640 1 -- 172.21.15.72:0/2548585861 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa9e00584d0 con 0x7fa9f0159ac0 2024-03-24T10:37:14.754 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:14.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa9d406b810 msgr2=0x7fa9d406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa9d406b810 0x7fa9d406dcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec036000 tx=0x7fa9ec03c040 comp rx=0 tx=0).stop 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 msgr2=0x7fa9f00b4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f00b4940 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa9e000e9b0 tx=0x7fa9e000ee70 comp rx=0 tx=0).stop 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 shutdown_connections 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa9d406b810 0x7fa9d406dcd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9f0160390 0x7fa9f00b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa9f0159ac0 0x7fa9f00b4940 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 --2- 172.21.15.72:0/2548585861 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa9f006b670 0x7fa9f014d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 >> 172.21.15.72:0/2548585861 conn(0x7fa9f00b2100 msgr2=0x7fa9f00ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 shutdown_connections 2024-03-24T10:37:14.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.755+0000 7fa9f75b5640 1 -- 172.21.15.72:0/2548585861 wait complete. 2024-03-24T10:37:14.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-24T10:37:14.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 Processor -- start 2024-03-24T10:37:14.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 -- start start 2024-03-24T10:37:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fcb7c15e170 0x7fcb7c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7c0d2450 0x7fcb7c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb7c0d4e50 con 0x7fcb7c0d4930 2024-03-24T10:37:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0cf790 con 0x7fcb7c0d2450 2024-03-24T10:37:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.867+0000 7fcb817a7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fcb7c0cfa70 con 0x7fcb7c15e170 2024-03-24T10:37:14.869 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7c0d2450 0x7fcb7c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcb7c0d2450 0x7fcb7c0b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40784/0 (socket says 172.21.15.72:40784) 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 -- 172.21.15.72:0/734387773 learned_addr learned my addr 172.21.15.72:0/734387773 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7affd640 1 --2- 172.21.15.72:0/734387773 >> v2:172.21.15.79:3300/0 conn(0x7fcb7c15e170 0x7fcb7c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 -- 172.21.15.72:0/734387773 >> v2:172.21.15.79:3300/0 conn(0x7fcb7c15e170 msgr2=0x7fcb7c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 --2- 172.21.15.72:0/734387773 >> v2:172.21.15.79:3300/0 conn(0x7fcb7c15e170 0x7fcb7c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 -- 172.21.15.72:0/734387773 >> v1:172.21.15.79:6789/0 conn(0x7fcb7c0d4930 legacy=0x7fcb7c0d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7b7fe640 1 -- 172.21.15.72:0/734387773 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c0cfd50 con 0x7fcb7c0d2450 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.868+0000 7fcb7affd640 1 --2- 172.21.15.72:0/734387773 >> v2:172.21.15.79:3300/0 conn(0x7fcb7c15e170 0x7fcb7c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb7b7fe640 1 --2- 172.21.15.72:0/734387773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d2450 0x7fcb7c0b3c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0b6b20 tx=0x7fcb7402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9279a59498849e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb7a7fc640 1 -- 172.21.15.72:0/734387773 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb7402ca80 con 0x7fcb7c0d2450 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb7a7fc640 1 -- 172.21.15.72:0/734387773 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7402cbe0 con 0x7fcb7c0d2450 2024-03-24T10:37:14.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb7a7fc640 1 -- 172.21.15.72:0/734387773 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb740343f0 con 0x7fcb7c0d2450 2024-03-24T10:37:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 -- 172.21.15.72:0/734387773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d2450 msgr2=0x7fcb7c0b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 --2- 172.21.15.72:0/734387773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d2450 0x7fcb7c0b3c80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0b6b20 tx=0x7fcb7402bee0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 -- 172.21.15.72:0/734387773 shutdown_connections 2024-03-24T10:37:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 --2- 172.21.15.72:0/734387773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d2450 0x7fcb7c0b3c80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 --2- 172.21.15.72:0/734387773 >> v2:172.21.15.79:3300/0 conn(0x7fcb7c15e170 0x7fcb7c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 -- 172.21.15.72:0/734387773 >> 172.21.15.72:0/734387773 conn(0x7fcb7c09d310 msgr2=0x7fcb7c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 -- 172.21.15.72:0/734387773 shutdown_connections 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.869+0000 7fcb817a7640 1 -- 172.21.15.72:0/734387773 wait complete. 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.870+0000 7fcb817a7640 1 Processor -- start 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 -- start start 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb7c0d2450 0x7fcb7c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 0x7fcb7c06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c15e170 0x7fcb7c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c06cf90 con 0x7fcb7c0d4930 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c06c9d0 con 0x7fcb7c15e170 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb817a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c06ccb0 con 0x7fcb7c0d2450 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.871+0000 7fcb727fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 0x7fcb7c06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 0x7fcb7c06bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40796/0 (socket says 172.21.15.72:40796) 2024-03-24T10:37:14.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 -- 172.21.15.72:0/2315315087 learned_addr learned my addr 172.21.15.72:0/2315315087 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb7affd640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb7c0d2450 0x7fcb7c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb7b7fe640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c15e170 0x7fcb7c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 -- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb7c0d2450 msgr2=0x7fcb7c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb7c0d2450 0x7fcb7c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 -- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c15e170 msgr2=0x7fcb7c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c15e170 0x7fcb7c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 -- 172.21.15.72:0/2315315087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb74009b30 con 0x7fcb7c0d4930 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb727fc640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 0x7fcb7c06bff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c400 tx=0x7fcb6400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640052d0 con 0x7fcb7c0d4930 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64005450 con 0x7fcb7c0d4930 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64007260 con 0x7fcb7c0d4930 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c0ccf70 con 0x7fcb7c0d4930 2024-03-24T10:37:14.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.872+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c1f3a00 con 0x7fcb7c0d4930 2024-03-24T10:37:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.873+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c0cd490 con 0x7fcb7c0d4930 2024-03-24T10:37:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.874+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fcb640073c0 con 0x7fcb7c0d4930 2024-03-24T10:37:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.874+0000 7fcb73fff640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.874+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fcb640898b0 con 0x7fcb7c0d4930 2024-03-24T10:37:14.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.874+0000 7fcb7affd640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:14.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.874+0000 7fcb7affd640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0b2fa0 tx=0x7fcb6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:14.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:14.878+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fcb7c0cd490 con 0x7fcb7c0d4930 2024-03-24T10:37:15.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.114+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fcb7c0cd490 con 0x7fcb7c0d4930 2024-03-24T10:37:15.386 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.386+0000 7fcb73fff640 1 -- 172.21.15.72:0/2315315087 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v71) ==== 147+0+0 (secure 0 0 0) 0x7fcb7c0cd490 con 0x7fcb7c0d4930 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb5c06b810 msgr2=0x7fcb5c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0b2fa0 tx=0x7fcb6c008040 comp rx=0 tx=0).stop 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 msgr2=0x7fcb7c06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 0x7fcb7c06bff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400c400 tx=0x7fcb6400c8c0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 shutdown_connections 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcb5c06b810 0x7fcb5c06dcd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb7c15e170 0x7fcb7c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcb7c0d4930 0x7fcb7c06bff0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 --2- 172.21.15.72:0/2315315087 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fcb7c0d2450 0x7fcb7c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 >> 172.21.15.72:0/2315315087 conn(0x7fcb7c09d310 msgr2=0x7fcb7c0b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 shutdown_connections 2024-03-24T10:37:15.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.388+0000 7fcb817a7640 1 -- 172.21.15.72:0/2315315087 wait complete. 2024-03-24T10:37:15.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-24T10:37:15.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.504+0000 7f7929a84640 1 Processor -- start 2024-03-24T10:37:15.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 -- start start 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7924142490 0x7f79240b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f79240b2b10 0x7f79240cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79240ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f79240b2f80 con 0x7f7924142490 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f79240b3210 con 0x7f79240b2b10 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f7929a84640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f79240b34f0 con 0x7f79240ce1b0 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.505+0000 7f79237fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7924142490 0x7f79240b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7924142490 0x7f79240b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40798/0 (socket says 172.21.15.72:40798) 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 -- 172.21.15.72:0/2772957575 learned_addr learned my addr 172.21.15.72:0/2772957575 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f7922ffd640 1 --2- 172.21.15.72:0/2772957575 >> v2:172.21.15.79:3300/0 conn(0x7f79240b2b10 0x7f79240cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f7923fff640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79240ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 -- 172.21.15.72:0/2772957575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 msgr2=0x7f79240ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79240ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 -- 172.21.15.72:0/2772957575 >> v2:172.21.15.79:3300/0 conn(0x7f79240b2b10 msgr2=0x7f79240cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 --2- 172.21.15.72:0/2772957575 >> v2:172.21.15.79:3300/0 conn(0x7f79240b2b10 0x7f79240cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 -- 172.21.15.72:0/2772957575 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79240b37d0 con 0x7f7924142490 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f7923fff640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79240ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.506+0000 7f79237fe640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79240b42b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f79240b4ad0 tx=0x7f791402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee4f5b3d7edf9a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f79227fc640 1 -- 172.21.15.72:0/2772957575 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914031870 con 0x7f7924142490 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f79227fc640 1 -- 172.21.15.72:0/2772957575 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79140319d0 con 0x7f7924142490 2024-03-24T10:37:15.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f79227fc640 1 -- 172.21.15.72:0/2772957575 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914031d60 con 0x7f7924142490 2024-03-24T10:37:15.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 -- 172.21.15.72:0/2772957575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 msgr2=0x7f79240b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79240b42b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f79240b4ad0 tx=0x7f791402b910 comp rx=0 tx=0).stop 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 -- 172.21.15.72:0/2772957575 shutdown_connections 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79240ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 --2- 172.21.15.72:0/2772957575 >> v2:172.21.15.79:3300/0 conn(0x7f79240b2b10 0x7f79240cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 --2- 172.21.15.72:0/2772957575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79240b42b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 -- 172.21.15.72:0/2772957575 >> 172.21.15.72:0/2772957575 conn(0x7f79240b1810 msgr2=0x7f79240b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:15.512 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 -- 172.21.15.72:0/2772957575 shutdown_connections 2024-03-24T10:37:15.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.507+0000 7f7929a84640 1 -- 172.21.15.72:0/2772957575 wait complete. 2024-03-24T10:37:15.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.508+0000 7f7929a84640 1 Processor -- start 2024-03-24T10:37:15.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 -- start start 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b2b10 0x7f79241394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79241f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79241f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f79241399f0 con 0x7f7924142490 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f79241f22c0 con 0x7f79240b2b10 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7929a84640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f79241f1fb0 con 0x7f79240ce1b0 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7923fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79241f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7923fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79241f2750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40806/0 (socket says 172.21.15.72:40806) 2024-03-24T10:37:15.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f7923fff640 1 -- 172.21.15.72:0/1244197206 learned_addr learned my addr 172.21.15.72:0/1244197206 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.509+0000 7f79237fe640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b2b10 0x7f79241394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7922ffd640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79241f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7923fff640 1 -- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 msgr2=0x7f79241f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7923fff640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79241f55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7923fff640 1 -- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b2b10 msgr2=0x7f79241394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7923fff640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b2b10 0x7f79241394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7923fff640 1 -- 172.21.15.72:0/1244197206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79140094d0 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7923fff640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79241f2750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f791c007ef0 tx=0x7f791c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c003b90 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f791c00f040 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79241f5ae0 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f791c00de80 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.510+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79241f6040 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.511+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f792404f470 con 0x7f7924142490 2024-03-24T10:37:15.515 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.511+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f791c004030 con 0x7f7924142490 2024-03-24T10:37:15.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.512+0000 7f790bfff640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f791006b810 0x7f791006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:15.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.512+0000 7f79237fe640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f791006b810 0x7f791006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:15.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.512+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f791c08a870 con 0x7f7924142490 2024-03-24T10:37:15.516 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.512+0000 7f79237fe640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f791006b810 0x7f791006dcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7914036000 tx=0x7f791403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:15.517 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.516+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f791c054f40 con 0x7f7924142490 2024-03-24T10:37:15.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.686+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f79241f2400 con 0x7f7924142490 2024-03-24T10:37:15.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.692+0000 7f790bfff640 1 -- 172.21.15.72:0/1244197206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f791c058600 con 0x7f7924142490 2024-03-24T10:37:15.694 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f791006b810 msgr2=0x7f791006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f791006b810 0x7f791006dcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7914036000 tx=0x7f791403c040 comp rx=0 tx=0).stop 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 msgr2=0x7f79241f2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79241f2750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f791c007ef0 tx=0x7f791c00d4a0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 shutdown_connections 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f791006b810 0x7f791006dcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7924142490 0x7f79241f2750 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f79240ce1b0 0x7f79241f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 --2- 172.21.15.72:0/1244197206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f79240b2b10 0x7f79241394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 >> 172.21.15.72:0/1244197206 conn(0x7f79240b1810 msgr2=0x7f792406e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 shutdown_connections 2024-03-24T10:37:15.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:15.694+0000 7f7929a84640 1 -- 172.21.15.72:0/1244197206 wait complete. 2024-03-24T10:37:15.706 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-24T10:37:15.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-24T10:37:15.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-24T10:37:15.789 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-24T10:37:15.789 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:15.789 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:15.806 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:15.807 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:15.862 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:15.862 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:15.917 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:16.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.056+0000 7f46c30eb640 1 Processor -- start 2024-03-24T10:37:16.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.056+0000 7f46c30eb640 1 -- start start 2024-03-24T10:37:16.058 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c30eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 0x7f46bc071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c30eb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46bc0cee90 0x7f46bc0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c30eb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46bc071630 con 0x7f46bc15f930 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c30eb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f46bc160940 con 0x7f46bc0cee90 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c30eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc0cf850 con 0x7f46bc06e500 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c0e87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 0x7f46bc071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46bbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f46bc0cee90 0x7f46bc0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c0e87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 0x7f46bc071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55022/0 (socket says 172.21.15.72:55022) 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c0e87640 1 -- 172.21.15.72:0/1430072417 learned_addr learned my addr 172.21.15.72:0/1430072417 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.057+0000 7f46c1688640 1 --1- 172.21.15.72:0/1430072417 >> v1:172.21.15.79:6789/0 conn(0x7f46bc15f930 0x7f46bc15fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:35340/0 (socket says 172.21.15.72:35340) 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.058+0000 7f46c0e87640 1 -- 172.21.15.72:0/1430072417 >> v2:172.21.15.79:3300/0 conn(0x7f46bc0cee90 msgr2=0x7f46bc0cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.058+0000 7f46c0e87640 1 --2- 172.21.15.72:0/1430072417 >> v2:172.21.15.79:3300/0 conn(0x7f46bc0cee90 0x7f46bc0cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.058+0000 7f46c0e87640 1 -- 172.21.15.72:0/1430072417 >> v1:172.21.15.79:6789/0 conn(0x7f46bc15f930 legacy=0x7f46bc15fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.059 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.058+0000 7f46c0e87640 1 -- 172.21.15.72:0/1430072417 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46bc15c220 con 0x7f46bc06e500 2024-03-24T10:37:16.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.058+0000 7f46c0e87640 1 --2- 172.21.15.72:0/1430072417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 0x7f46bc071ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009870 tx=0x7f46ac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acfe4cb7a2c6d22e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46bb7fe640 1 -- 172.21.15.72:0/1430072417 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac030840 con 0x7f46bc06e500 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46bb7fe640 1 -- 172.21.15.72:0/1430072417 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46ac0309a0 con 0x7f46bc06e500 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46bb7fe640 1 -- 172.21.15.72:0/1430072417 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac030d30 con 0x7f46bc06e500 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 -- 172.21.15.72:0/1430072417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 msgr2=0x7f46bc071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 --2- 172.21.15.72:0/1430072417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 0x7f46bc071ac0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009870 tx=0x7f46ac02b980 comp rx=0 tx=0).stop 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 -- 172.21.15.72:0/1430072417 shutdown_connections 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 --2- 172.21.15.72:0/1430072417 >> v2:172.21.15.79:3300/0 conn(0x7f46bc0cee90 0x7f46bc0cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 --2- 172.21.15.72:0/1430072417 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc06e500 0x7f46bc071ac0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 -- 172.21.15.72:0/1430072417 >> 172.21.15.72:0/1430072417 conn(0x7f46bc0b1920 msgr2=0x7f46bc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 -- 172.21.15.72:0/1430072417 shutdown_connections 2024-03-24T10:37:16.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.059+0000 7f46c30eb640 1 -- 172.21.15.72:0/1430072417 wait complete. 2024-03-24T10:37:16.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.060+0000 7f46c30eb640 1 Processor -- start 2024-03-24T10:37:16.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.060+0000 7f46c30eb640 1 -- start start 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c30eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc06e500 0x7f46bc09d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c30eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 0x7f46bc0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c30eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc15f930 0x7f46bc0cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c30eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc09d790 con 0x7f46bc0cee90 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c30eb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f46bc0b0100 con 0x7f46bc06e500 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c30eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f46bc0b03e0 con 0x7f46bc15f930 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46bbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 0x7f46bc0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46bbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 0x7f46bc0af7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40820/0 (socket says 172.21.15.72:40820) 2024-03-24T10:37:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46bbfff640 1 -- 172.21.15.72:0/2453927308 learned_addr learned my addr 172.21.15.72:0/2453927308 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c1688640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc15f930 0x7f46bc0cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.061+0000 7f46c0e87640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc06e500 0x7f46bc09d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46bbfff640 1 -- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc15f930 msgr2=0x7f46bc0cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46bbfff640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc15f930 0x7f46bc0cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46bbfff640 1 -- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc06e500 msgr2=0x7f46bc09d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46bbfff640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc06e500 0x7f46bc09d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46bbfff640 1 -- 172.21.15.72:0/2453927308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac0094d0 con 0x7f46bc0cee90 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46bbfff640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 0x7f46bc0af7b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e930 tx=0x7f46b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b0009690 con 0x7f46bc0cee90 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46b000ca00 con 0x7f46bc0cee90 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46bc0b06c0 con 0x7f46bc0cee90 2024-03-24T10:37:16.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46b000cdb0 con 0x7f46bc0cee90 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.062+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46bc0afcf0 con 0x7f46bc0cee90 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.063+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46bc0b0be0 con 0x7f46bc0cee90 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.063+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f46b0013470 con 0x7f46bc0cee90 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.064+0000 7f46b97fa640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f46a806b810 0x7f46a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.064+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f46b008a7e0 con 0x7f46bc0cee90 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.064+0000 7f46c0e87640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f46a806b810 0x7f46a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.064+0000 7f46c0e87640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f46a806b810 0x7f46a806dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46ac036000 tx=0x7f46ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.068+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f46bc0b0be0 con 0x7f46bc0cee90 2024-03-24T10:37:16.242 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.242+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46bc0b0be0 con 0x7f46bc0cee90 2024-03-24T10:37:16.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.243+0000 7f46b97fa640 1 -- 172.21.15.72:0/2453927308 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f46bc0b0be0 con 0x7f46bc0cee90 2024-03-24T10:37:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:16.244 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:16.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f46a806b810 msgr2=0x7f46a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f46a806b810 0x7f46a806dcd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f46ac036000 tx=0x7f46ac008030 comp rx=0 tx=0).stop 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 msgr2=0x7f46bc0af7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 0x7f46bc0af7b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e930 tx=0x7f46b000edf0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 shutdown_connections 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f46a806b810 0x7f46a806dcd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46bc15f930 0x7f46bc0cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46bc0cee90 0x7f46bc0af7b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 --2- 172.21.15.72:0/2453927308 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f46bc06e500 0x7f46bc09d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 >> 172.21.15.72:0/2453927308 conn(0x7f46bc0b1920 msgr2=0x7f46bc15a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 shutdown_connections 2024-03-24T10:37:16.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.245+0000 7f46c30eb640 1 -- 172.21.15.72:0/2453927308 wait complete. 2024-03-24T10:37:16.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:16.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:16.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.362+0000 7f40b4977640 1 Processor -- start 2024-03-24T10:37:16.363 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.362+0000 7f40b4977640 1 -- start start 2024-03-24T10:37:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40b4977640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b006e8d0 0x7f40b00b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40b4977640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40b006ecb0 0x7f40b015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40b4977640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f40b00b4190 0x7f40b0144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40b4977640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f40b015f980 con 0x7f40b006ecb0 2024-03-24T10:37:16.365 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40b4977640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f40b00b30f0 con 0x7f40b00b4190 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40b4977640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f40b00b33d0 con 0x7f40b006e8d0 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40b006ecb0 0x7f40b015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f40b006ecb0 0x7f40b015f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40834/0 (socket says 172.21.15.72:40834) 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 -- 172.21.15.72:0/1267580364 learned_addr learned my addr 172.21.15.72:0/1267580364 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40ae59c640 1 --2- 172.21.15.72:0/1267580364 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b006e8d0 0x7f40b00b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40aed9d640 1 --2- 172.21.15.72:0/1267580364 >> v2:172.21.15.79:3300/0 conn(0x7f40b00b4190 0x7f40b0144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 -- 172.21.15.72:0/1267580364 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b006e8d0 msgr2=0x7f40b00b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 --2- 172.21.15.72:0/1267580364 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b006e8d0 0x7f40b00b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 -- 172.21.15.72:0/1267580364 >> v2:172.21.15.79:3300/0 conn(0x7f40b00b4190 msgr2=0x7f40b0144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 --2- 172.21.15.72:0/1267580364 >> v2:172.21.15.79:3300/0 conn(0x7f40b00b4190 0x7f40b0144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.363+0000 7f40a7fff640 1 -- 172.21.15.72:0/1267580364 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40b00b36b0 con 0x7f40b006ecb0 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40a7fff640 1 --2- 172.21.15.72:0/1267580364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b015f440 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f40b00ccc20 tx=0x7f409802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d87c237a1dd7ff server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40add9b640 1 -- 172.21.15.72:0/1267580364 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40980317e0 con 0x7f40b006ecb0 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40add9b640 1 -- 172.21.15.72:0/1267580364 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4098031940 con 0x7f40b006ecb0 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40add9b640 1 -- 172.21.15.72:0/1267580364 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098031cd0 con 0x7f40b006ecb0 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40b4977640 1 -- 172.21.15.72:0/1267580364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 msgr2=0x7f40b015f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40b4977640 1 --2- 172.21.15.72:0/1267580364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b015f440 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f40b00ccc20 tx=0x7f409802b880 comp rx=0 tx=0).stop 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40b4977640 1 -- 172.21.15.72:0/1267580364 shutdown_connections 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40b4977640 1 --2- 172.21.15.72:0/1267580364 >> v2:172.21.15.79:3300/0 conn(0x7f40b00b4190 0x7f40b0144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40b4977640 1 --2- 172.21.15.72:0/1267580364 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b015f440 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.364+0000 7f40b4977640 1 --2- 172.21.15.72:0/1267580364 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b006e8d0 0x7f40b00b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.365+0000 7f40b4977640 1 -- 172.21.15.72:0/1267580364 >> 172.21.15.72:0/1267580364 conn(0x7f40b00b1810 msgr2=0x7f40b00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.365+0000 7f40b4977640 1 -- 172.21.15.72:0/1267580364 shutdown_connections 2024-03-24T10:37:16.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.365+0000 7f40b4977640 1 -- 172.21.15.72:0/1267580364 wait complete. 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.366+0000 7f40b4977640 1 Processor -- start 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.366+0000 7f40b4977640 1 -- start start 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b006e8d0 0x7f40b014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b01391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b00b4190 0x7f40b013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f40b01f7200 con 0x7f40b006ecb0 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40b0138be0 con 0x7f40b006e8d0 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f40b014fca0 con 0x7f40b00b4190 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b01391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b01391a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40850/0 (socket says 172.21.15.72:40850) 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 -- 172.21.15.72:0/3945156934 learned_addr learned my addr 172.21.15.72:0/3945156934 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40ae59c640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b006e8d0 0x7f40b014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40aed9d640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b00b4190 0x7f40b013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 -- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b00b4190 msgr2=0x7f40b013baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b00b4190 0x7f40b013baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 -- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b006e8d0 msgr2=0x7f40b014f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b006e8d0 0x7f40b014f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 -- 172.21.15.72:0/3945156934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40980094d0 con 0x7f40b006ecb0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a7fff640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b01391a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4098000c00 tx=0x7f40980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098032880 con 0x7f40b006ecb0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40980329e0 con 0x7f40b006ecb0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4098032d90 con 0x7f40b006ecb0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40b014ff80 con 0x7f40b006ecb0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.367+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40b0150540 con 0x7f40b006ecb0 2024-03-24T10:37:16.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.368+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40b01f7340 con 0x7f40b006ecb0 2024-03-24T10:37:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.369+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f409804e450 con 0x7f40b006ecb0 2024-03-24T10:37:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.369+0000 7f40a6ffd640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f409006b810 0x7f409006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.369+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f40980ac400 con 0x7f40b006ecb0 2024-03-24T10:37:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.369+0000 7f40ae59c640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f409006b810 0x7f409006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.370+0000 7f40ae59c640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f409006b810 0x7f409006dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009aa0 tx=0x7f40a0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.373+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f40b01f7340 con 0x7f40b006ecb0 2024-03-24T10:37:16.546 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.546+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f40b01f7340 con 0x7f40b006ecb0 2024-03-24T10:37:16.547 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.546+0000 7f40a6ffd640 1 -- 172.21.15.72:0/3945156934 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f40b01f7340 con 0x7f40b006ecb0 2024-03-24T10:37:16.547 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f409006b810 msgr2=0x7f409006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f409006b810 0x7f409006dcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009aa0 tx=0x7f40a0009190 comp rx=0 tx=0).stop 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 msgr2=0x7f40b01391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b01391a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4098000c00 tx=0x7f40980046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 shutdown_connections 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f409006b810 0x7f409006dcd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f40b00b4190 0x7f40b013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f40b006ecb0 0x7f40b01391a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 --2- 172.21.15.72:0/3945156934 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f40b006e8d0 0x7f40b014f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 >> 172.21.15.72:0/3945156934 conn(0x7f40b00b1810 msgr2=0x7f40b006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 shutdown_connections 2024-03-24T10:37:16.550 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.548+0000 7f40b4977640 1 -- 172.21.15.72:0/3945156934 wait complete. 2024-03-24T10:37:16.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 Processor -- start 2024-03-24T10:37:16.663 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 -- start start 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd05806e8d0 0x7fd0580b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd05815f440 0x7fd058144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0580b30f0 con 0x7fd05806ecb0 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd0580b48a0 con 0x7fd05806e8d0 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.663+0000 7fd05e3f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd0580b33d0 con 0x7fd05815f440 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd05806e8d0 0x7fd0580b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.665 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd05806e8d0 0x7fd0580b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40860/0 (socket says 172.21.15.72:40860) 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 -- 172.21.15.72:0/3648068350 learned_addr learned my addr 172.21.15.72:0/3648068350 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd05c991640 1 --2- 172.21.15.72:0/3648068350 >> v2:172.21.15.79:3300/0 conn(0x7fd05815f440 0x7fd058144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 -- 172.21.15.72:0/3648068350 >> v2:172.21.15.79:3300/0 conn(0x7fd05815f440 msgr2=0x7fd058144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 --2- 172.21.15.72:0/3648068350 >> v2:172.21.15.79:3300/0 conn(0x7fd05815f440 0x7fd058144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 -- 172.21.15.72:0/3648068350 >> v1:172.21.15.72:6789/0 conn(0x7fd05806ecb0 legacy=0x7fd0580b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd057fff640 1 -- 172.21.15.72:0/3648068350 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0580b36b0 con 0x7fd05806e8d0 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.664+0000 7fd056ffd640 1 -- 172.21.15.72:0/3648068350 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985777462 0 0) 0x7fd0580b30f0 con 0x7fd05806ecb0 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd057fff640 1 --2- 172.21.15.72:0/3648068350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd0580b2b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13038defd0a92c88 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd056ffd640 1 -- 172.21.15.72:0/3648068350 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040030860 con 0x7fd05806e8d0 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd056ffd640 1 -- 172.21.15.72:0/3648068350 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0400309c0 con 0x7fd05806e8d0 2024-03-24T10:37:16.666 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd056ffd640 1 -- 172.21.15.72:0/3648068350 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040030d50 con 0x7fd05806e8d0 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3648068350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 msgr2=0x7fd0580b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3648068350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd0580b2b10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd040009870 tx=0x7fd04002b9a0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3648068350 shutdown_connections 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3648068350 >> v2:172.21.15.79:3300/0 conn(0x7fd05815f440 0x7fd058144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3648068350 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd0580b2b10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3648068350 >> 172.21.15.72:0/3648068350 conn(0x7fd0580b1810 msgr2=0x7fd0580b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3648068350 shutdown_connections 2024-03-24T10:37:16.671 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.665+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3648068350 wait complete. 2024-03-24T10:37:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.666+0000 7fd05e3f4640 1 Processor -- start 2024-03-24T10:37:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 -- start start 2024-03-24T10:37:16.672 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd05813f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd05806ecb0 0x7fd0580af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd05815f440 0x7fd0581f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581f1bc0 con 0x7fd05806e8d0 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd05813f970 con 0x7fd05815f440 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd05e3f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd0581f59b0 con 0x7fd05806ecb0 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd057fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd05813f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd057fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd05813f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40874/0 (socket says 172.21.15.72:40874) 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.667+0000 7fd057fff640 1 -- 172.21.15.72:0/3606902153 learned_addr learned my addr 172.21.15.72:0/3606902153 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd05c991640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd05815f440 0x7fd0581f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd0577fe640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd05806ecb0 0x7fd0580af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd057fff640 1 -- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd05806ecb0 msgr2=0x7fd0580af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd057fff640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd05806ecb0 0x7fd0580af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd057fff640 1 -- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd05815f440 msgr2=0x7fd0581f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd057fff640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd05815f440 0x7fd0581f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd057fff640 1 -- 172.21.15.72:0/3606902153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0400094d0 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd057fff640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd05813f430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040039c90 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd040039df0 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581f5c90 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd040043640 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.668+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0580a97b0 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.669+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05804f470 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.670+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd0400437a0 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.670+0000 7fd054ff9640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd03806b810 0x7fd03806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.670+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd04003e070 con 0x7fd05806e8d0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.670+0000 7fd0577fe640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd03806b810 0x7fd03806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.670+0000 7fd0577fe640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd03806b810 0x7fd03806dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0580b0070 tx=0x7fd048009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.674+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd040077c40 con 0x7fd05806e8d0 2024-03-24T10:37:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.850+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd05806d240 con 0x7fd05806e8d0 2024-03-24T10:37:16.851 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.850+0000 7fd054ff9640 1 -- 172.21.15.72:0/3606902153 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fd04007b300 con 0x7fd05806e8d0 2024-03-24T10:37:16.851 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd03806b810 msgr2=0x7fd03806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd03806b810 0x7fd03806dcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd0580b0070 tx=0x7fd048009040 comp rx=0 tx=0).stop 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 msgr2=0x7fd05813f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd05813f430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd040000c00 tx=0x7fd040004730 comp rx=0 tx=0).stop 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 shutdown_connections 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd03806b810 0x7fd03806dcd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd05815f440 0x7fd0581f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd05806ecb0 0x7fd0580af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 --2- 172.21.15.72:0/3606902153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd05806e8d0 0x7fd05813f430 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 >> 172.21.15.72:0/3606902153 conn(0x7fd0580b1810 msgr2=0x7fd05815d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 shutdown_connections 2024-03-24T10:37:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.852+0000 7fd05e3f4640 1 -- 172.21.15.72:0/3606902153 wait complete. 2024-03-24T10:37:16.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.966+0000 7ff8cab25640 1 Processor -- start 2024-03-24T10:37:16.967 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.966+0000 7ff8cab25640 1 -- start start 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8cab25640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff8c406e8d0 0x7ff8c40b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8cab25640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c4144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8cab25640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8c40b30f0 con 0x7ff8c406ecb0 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8cab25640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff8c40b48a0 con 0x7ff8c406e8d0 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8cab25640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c40b33d0 con 0x7ff8c415f440 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8c3fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff8c406ecb0 0x7ff8c40b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49046/0 (socket says 172.21.15.72:49046) 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8c3fff640 1 -- 172.21.15.72:0/1781456023 learned_addr learned my addr 172.21.15.72:0/1781456023 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8c90c2640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c4144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.969 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.967+0000 7ff8c88c1640 1 --2- 172.21.15.72:0/1781456023 >> v2:172.21.15.79:3300/0 conn(0x7ff8c406e8d0 0x7ff8c40b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c37fe640 1 -- 172.21.15.72:0/1781456023 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131145460 0 0) 0x7ff8c40b30f0 con 0x7ff8c406ecb0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c37fe640 1 -- 172.21.15.72:0/1781456023 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8ac005730 con 0x7ff8c406ecb0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c88c1640 1 -- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 msgr2=0x7ff8c4144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c88c1640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c4144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c88c1640 1 -- 172.21.15.72:0/1781456023 >> v1:172.21.15.72:6789/0 conn(0x7ff8c406ecb0 legacy=0x7ff8c40b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c88c1640 1 -- 172.21.15.72:0/1781456023 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40b36b0 con 0x7ff8c406e8d0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c90c2640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c4144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.968+0000 7ff8c88c1640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c40b2b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40097a0 tx=0x7ff8b402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ed4440a08303e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8c37fe640 1 -- 172.21.15.72:0/1781456023 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4031830 con 0x7ff8c406e8d0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8c37fe640 1 -- 172.21.15.72:0/1781456023 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b4031990 con 0x7ff8c406e8d0 2024-03-24T10:37:16.970 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8c37fe640 1 -- 172.21.15.72:0/1781456023 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4031d20 con 0x7ff8c406e8d0 2024-03-24T10:37:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 -- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 msgr2=0x7ff8c40b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.973 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c40b2b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff8b40097a0 tx=0x7ff8b402b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 -- 172.21.15.72:0/1781456023 shutdown_connections 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c4144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 --2- 172.21.15.72:0/1781456023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c40b2b10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 -- 172.21.15.72:0/1781456023 >> 172.21.15.72:0/1781456023 conn(0x7ff8c40b1810 msgr2=0x7ff8c40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 -- 172.21.15.72:0/1781456023 shutdown_connections 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.969+0000 7ff8cab25640 1 -- 172.21.15.72:0/1781456023 wait complete. 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.970+0000 7ff8cab25640 1 Processor -- start 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.970+0000 7ff8cab25640 1 -- start start 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8cab25640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c415b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8cab25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 0x7ff8c41594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8cab25640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c413dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.974 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8cab25640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c415b680 con 0x7ff8c406ecb0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8cab25640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c415b8b0 con 0x7ff8c406e8d0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8cab25640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff8c415bb90 con 0x7ff8c415f440 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 0x7ff8c41594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8c3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 0x7ff8c41594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40886/0 (socket says 172.21.15.72:40886) 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8c3fff640 1 -- 172.21.15.72:0/885468363 learned_addr learned my addr 172.21.15.72:0/885468363 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8c90c2640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c413dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.971+0000 7ff8c88c1640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c415b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c3fff640 1 -- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 msgr2=0x7ff8c413dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c3fff640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c413dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c3fff640 1 -- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 msgr2=0x7ff8c415b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c3fff640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c415b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c3fff640 1 -- 172.21.15.72:0/885468363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8bc009a70 con 0x7ff8c406ecb0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c3fff640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 0x7ff8c41594e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c430 tx=0x7ff8b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.975 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8005ce0 con 0x7ff8c406ecb0 2024-03-24T10:37:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b4009400 con 0x7ff8c406ecb0 2024-03-24T10:37:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8b8005e40 con 0x7ff8c406ecb0 2024-03-24T10:37:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80072f0 con 0x7ff8c406ecb0 2024-03-24T10:37:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.972+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c415c150 con 0x7ff8c406ecb0 2024-03-24T10:37:16.976 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.973+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8c404f470 con 0x7ff8c406ecb0 2024-03-24T10:37:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.973+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff8b8007450 con 0x7ff8c406ecb0 2024-03-24T10:37:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.974+0000 7ff8c17fa640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8b006b840 0x7ff8b006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.974+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff8b8089b90 con 0x7ff8c406ecb0 2024-03-24T10:37:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.974+0000 7ff8c88c1640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8b006b840 0x7ff8b006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:16.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.974+0000 7ff8c88c1640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8b006b840 0x7ff8b006dd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4036000 tx=0x7ff8b403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:16.978 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:16.978+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff8b80541e0 con 0x7ff8c406ecb0 2024-03-24T10:37:17.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.148+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff8c415e800 con 0x7ff8c406ecb0 2024-03-24T10:37:17.149 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.148+0000 7ff8c17fa640 1 -- 172.21.15.72:0/885468363 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ff8b8017020 con 0x7ff8c406ecb0 2024-03-24T10:37:17.149 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8b006b840 msgr2=0x7ff8b006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8b006b840 0x7ff8b006dd00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4036000 tx=0x7ff8b403c040 comp rx=0 tx=0).stop 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 msgr2=0x7ff8c41594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 0x7ff8c41594e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff8b800c430 tx=0x7ff8b800c830 comp rx=0 tx=0).stop 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 shutdown_connections 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff8b006b840 0x7ff8b006dd00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff8c415f440 0x7ff8c413dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff8c406ecb0 0x7ff8c41594e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 --2- 172.21.15.72:0/885468363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff8c406e8d0 0x7ff8c415b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 >> 172.21.15.72:0/885468363 conn(0x7ff8c40b1810 msgr2=0x7ff8c4072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 shutdown_connections 2024-03-24T10:37:17.151 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.150+0000 7ff8cab25640 1 -- 172.21.15.72:0/885468363 wait complete. 2024-03-24T10:37:17.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:17.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.267+0000 7fa74a1b6640 1 Processor -- start 2024-03-24T10:37:17.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.267+0000 7fa74a1b6640 1 -- start start 2024-03-24T10:37:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa74a1b6640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa74406e8d0 0x7fa7440b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.269 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa74a1b6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa74415f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa74a1b6640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74415f980 con 0x7fa7440b4190 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa74a1b6640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa7440b30f0 con 0x7fa74406e8d0 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa74a1b6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa7440b33d0 con 0x7fa74406ecb0 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa743fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7440b4190 0x7fa744144150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49048/0 (socket says 172.21.15.72:49048) 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa743fff640 1 -- 172.21.15.72:0/3237329771 learned_addr learned my addr 172.21.15.72:0/3237329771 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa742ffd640 1 --2- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa74415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7437fe640 1 --2- 172.21.15.72:0/3237329771 >> v2:172.21.15.79:3300/0 conn(0x7fa74406e8d0 0x7fa7440b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7427fc640 1 -- 172.21.15.72:0/3237329771 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634042151 0 0) 0x7fa73c001490 con 0x7fa7440b4190 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7427fc640 1 -- 172.21.15.72:0/3237329771 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa730003520 con 0x7fa7440b4190 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7437fe640 1 -- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 msgr2=0x7fa74415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7437fe640 1 --2- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa74415f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7437fe640 1 -- 172.21.15.72:0/3237329771 >> v1:172.21.15.72:6789/0 conn(0x7fa7440b4190 legacy=0x7fa744144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.268+0000 7fa7437fe640 1 -- 172.21.15.72:0/3237329771 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7440b36b0 con 0x7fa74406e8d0 2024-03-24T10:37:17.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.269+0000 7fa7437fe640 1 --2- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa7440b2b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0097a0 tx=0x7fa72c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39741f9187b952ca server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:17.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.269+0000 7fa7427fc640 1 -- 172.21.15.72:0/3237329771 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c02e070 con 0x7fa74406e8d0 2024-03-24T10:37:17.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.269+0000 7fa7427fc640 1 -- 172.21.15.72:0/3237329771 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c0315a0 con 0x7fa74406e8d0 2024-03-24T10:37:17.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.269+0000 7fa7427fc640 1 -- 172.21.15.72:0/3237329771 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c031930 con 0x7fa74406e8d0 2024-03-24T10:37:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 -- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 msgr2=0x7fa7440b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa7440b2b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0097a0 tx=0x7fa72c02b840 comp rx=0 tx=0).stop 2024-03-24T10:37:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 -- 172.21.15.72:0/3237329771 shutdown_connections 2024-03-24T10:37:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa74415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.274 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/3237329771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa7440b2b10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 -- 172.21.15.72:0/3237329771 >> 172.21.15.72:0/3237329771 conn(0x7fa7440b1810 msgr2=0x7fa7440b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 -- 172.21.15.72:0/3237329771 shutdown_connections 2024-03-24T10:37:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.270+0000 7fa74a1b6640 1 -- 172.21.15.72:0/3237329771 wait complete. 2024-03-24T10:37:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.271+0000 7fa74a1b6640 1 Processor -- start 2024-03-24T10:37:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.271+0000 7fa74a1b6640 1 -- start start 2024-03-24T10:37:17.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa744134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa7440cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 0x7fa7440cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa744138d40 con 0x7fa7440b4190 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa74415c1b0 con 0x7fa74406e8d0 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa74415c490 con 0x7fa74406ecb0 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 0x7fa7440cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 0x7fa7440cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40902/0 (socket says 172.21.15.72:40902) 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 -- 172.21.15.72:0/2912781517 learned_addr learned my addr 172.21.15.72:0/2912781517 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa742ffd640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa7440cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa7437fe640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa744134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 -- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 msgr2=0x7fa7440cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa7440cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 -- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 msgr2=0x7fa744134b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa744134b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 -- 172.21.15.72:0/2912781517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c009400 con 0x7fa7440b4190 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa743fff640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 0x7fa7440cfe10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00cae0 tx=0x7fa73c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00ac40 con 0x7fa7440b4190 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa73c00ada0 con 0x7fa7440b4190 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74415c770 con 0x7fa7440b4190 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c012620 con 0x7fa7440b4190 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.272+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74415cd30 con 0x7fa7440b4190 2024-03-24T10:37:17.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.273+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74415cf50 con 0x7fa7440b4190 2024-03-24T10:37:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.274+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa73c007070 con 0x7fa7440b4190 2024-03-24T10:37:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.274+0000 7fa73bfff640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa72406b810 0x7fa72406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.274+0000 7fa7437fe640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa72406b810 0x7fa72406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.275+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa73c08a320 con 0x7fa7440b4190 2024-03-24T10:37:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.275+0000 7fa7437fe640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa72406b810 0x7fa72406dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa72c036000 tx=0x7fa72c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:17.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.279+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa73c0549f0 con 0x7fa7440b4190 2024-03-24T10:37:17.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.450+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa74415f980 con 0x7fa7440b4190 2024-03-24T10:37:17.451 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.451+0000 7fa73bfff640 1 -- 172.21.15.72:0/2912781517 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa74415f980 con 0x7fa7440b4190 2024-03-24T10:37:17.452 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa72406b810 msgr2=0x7fa72406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa72406b810 0x7fa72406dcd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa72c036000 tx=0x7fa72c03d040 comp rx=0 tx=0).stop 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 msgr2=0x7fa7440cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 0x7fa7440cfe10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00cae0 tx=0x7fa73c00a060 comp rx=0 tx=0).stop 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 shutdown_connections 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa72406b810 0x7fa72406dcd0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7440b4190 0x7fa7440cfe10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.454 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa74406ecb0 0x7fa7440cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 --2- 172.21.15.72:0/2912781517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa74406e8d0 0x7fa744134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 >> 172.21.15.72:0/2912781517 conn(0x7fa7440b1810 msgr2=0x7fa74413deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 shutdown_connections 2024-03-24T10:37:17.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.453+0000 7fa74a1b6640 1 -- 172.21.15.72:0/2912781517 wait complete. 2024-03-24T10:37:17.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:37:17.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.565+0000 7efe4078a640 1 Processor -- start 2024-03-24T10:37:17.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.565+0000 7efe4078a640 1 -- start start 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe4078a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 0x7efe380716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe4078a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 0x7efe380b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe4078a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe38071d00 con 0x7efe380cf430 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe4078a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7efe380b31e0 con 0x7efe380b3cc0 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe4078a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efe380b34c0 con 0x7efe38158170 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3e526640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 0x7efe380716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3ed27640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 0x7efe380b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3ed27640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 0x7efe380b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:45480/0 (socket says 172.21.15.72:45480) 2024-03-24T10:37:17.568 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3e526640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 0x7efe380716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:55098/0 (socket says 172.21.15.72:55098) 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3ed27640 1 -- 172.21.15.72:0/1089051806 learned_addr learned my addr 172.21.15.72:0/1089051806 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3e526640 1 -- 172.21.15.72:0/1089051806 >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 msgr2=0x7efe380b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3e526640 1 --2- 172.21.15.72:0/1089051806 >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 0x7efe380b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3e526640 1 -- 172.21.15.72:0/1089051806 >> v1:172.21.15.79:6789/0 conn(0x7efe380cf430 legacy=0x7efe3806d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3e526640 1 -- 172.21.15.72:0/1089051806 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe380b37a0 con 0x7efe38158170 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.566+0000 7efe3ed27640 1 --2- 172.21.15.72:0/1089051806 >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 0x7efe380b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.567+0000 7efe3e526640 1 --2- 172.21.15.72:0/1089051806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 0x7efe380716f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe340097a0 tx=0x7efe3402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eff2ae6c8b75fc server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.567+0000 7efe3d524640 1 -- 172.21.15.72:0/1089051806 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34031830 con 0x7efe38158170 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.567+0000 7efe3d524640 1 -- 172.21.15.72:0/1089051806 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe34031990 con 0x7efe38158170 2024-03-24T10:37:17.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.567+0000 7efe3d524640 1 -- 172.21.15.72:0/1089051806 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34031d20 con 0x7efe38158170 2024-03-24T10:37:17.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 -- 172.21.15.72:0/1089051806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 msgr2=0x7efe380716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 --2- 172.21.15.72:0/1089051806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 0x7efe380716f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7efe340097a0 tx=0x7efe3402b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 -- 172.21.15.72:0/1089051806 shutdown_connections 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 --2- 172.21.15.72:0/1089051806 >> v2:172.21.15.79:3300/0 conn(0x7efe380b3cc0 0x7efe380b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 --2- 172.21.15.72:0/1089051806 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe38158170 0x7efe380716f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 -- 172.21.15.72:0/1089051806 >> 172.21.15.72:0/1089051806 conn(0x7efe380b1810 msgr2=0x7efe380b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 -- 172.21.15.72:0/1089051806 shutdown_connections 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.568+0000 7efe4078a640 1 -- 172.21.15.72:0/1089051806 wait complete. 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.569+0000 7efe4078a640 1 Processor -- start 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.569+0000 7efe4078a640 1 -- start start 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe4078a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe380b3cc0 0x7efe38155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe4078a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 0x7efe381532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe4078a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe38158170 0x7efe38153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.580 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe4078a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efe380af800 con 0x7efe380cf430 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe4078a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efe380afae0 con 0x7efe38158170 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe4078a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efe380afdc0 con 0x7efe380b3cc0 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 0x7efe381532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 0x7efe381532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40904/0 (socket says 172.21.15.72:40904) 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 -- 172.21.15.72:0/962189245 learned_addr learned my addr 172.21.15.72:0/962189245 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3ed27640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe38158170 0x7efe38153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3e526640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe380b3cc0 0x7efe38155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 -- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe380b3cc0 msgr2=0x7efe38155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe380b3cc0 0x7efe38155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 -- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe38158170 msgr2=0x7efe38153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe38158170 0x7efe38153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 -- 172.21.15.72:0/962189245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3000bd40 con 0x7efe380cf430 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3ed27640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe38158170 0x7efe38153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:17.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.570+0000 7efe3dd25640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 0x7efe381532f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe2800c400 tx=0x7efe2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.571+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe280052d0 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.571+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe28005450 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.571+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe34009400 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.571+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe28007260 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.571+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3806dbb0 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.572+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe380b0280 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.572+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efe280073c0 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.572+0000 7efe2effd640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efe1c06b810 0x7efe1c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.572+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efe28089940 con 0x7efe380cf430 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.573+0000 7efe3e526640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efe1c06b810 0x7efe1c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.573+0000 7efe3e526640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efe1c06b810 0x7efe1c06dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe3403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:17.582 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.577+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efe28054010 con 0x7efe380cf430 2024-03-24T10:37:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.760+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efe38073d50 con 0x7efe380cf430 2024-03-24T10:37:17.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.760+0000 7efe2effd640 1 -- 172.21.15.72:0/962189245 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7efe280576d0 con 0x7efe380cf430 2024-03-24T10:37:17.761 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efe1c06b810 msgr2=0x7efe1c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efe1c06b810 0x7efe1c06dcd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe34036000 tx=0x7efe3403c040 comp rx=0 tx=0).stop 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 msgr2=0x7efe381532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 0x7efe381532f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7efe2800c400 tx=0x7efe2800c8c0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 shutdown_connections 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efe1c06b810 0x7efe1c06dcd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efe38158170 0x7efe38153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efe380cf430 0x7efe381532f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 --2- 172.21.15.72:0/962189245 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efe380b3cc0 0x7efe38155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 >> 172.21.15.72:0/962189245 conn(0x7efe380b1810 msgr2=0x7efe38152710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:17.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 shutdown_connections 2024-03-24T10:37:17.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:17.762+0000 7efe4078a640 1 -- 172.21.15.72:0/962189245 wait complete. 2024-03-24T10:37:17.774 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-24T10:37:17.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:17.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-24T10:37:17.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:37:17.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:17.805 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-24T10:37:17.860 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:17.861 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:17.877 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:17.878 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:17.932 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:17.933 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:17.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.088+0000 7f949773a640 1 Processor -- start 2024-03-24T10:37:18.089 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.088+0000 7f949773a640 1 -- start start 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f949773a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f949015ae80 0x7f949006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f949773a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94900725b0 con 0x7f9490071550 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f949773a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9490071a10 con 0x7f949006e680 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f949773a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f949015b260 con 0x7f949015ae80 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f94954d6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f949015ae80 0x7f949006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f9495cd7640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9490071550 0x7f94900ad850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49064/0 (socket says 172.21.15.72:49064) 2024-03-24T10:37:18.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f94954d6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f949015ae80 0x7f949006cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40906/0 (socket says 172.21.15.72:40906) 2024-03-24T10:37:18.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.089+0000 7f9495cd7640 1 -- 172.21.15.72:0/1989579805 learned_addr learned my addr 172.21.15.72:0/1989579805 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:18.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f94954d6640 1 -- 172.21.15.72:0/1989579805 >> v1:172.21.15.79:6789/0 conn(0x7f949006e680 legacy=0x7f9490070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f94954d6640 1 -- 172.21.15.72:0/1989579805 >> v1:172.21.15.72:6789/0 conn(0x7f9490071550 legacy=0x7f94900ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f94954d6640 1 -- 172.21.15.72:0/1989579805 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9490071c80 con 0x7f949015ae80 2024-03-24T10:37:18.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f9487fff640 1 -- 172.21.15.72:0/1989579805 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508443708 0 0) 0x7f94900725b0 con 0x7f9490071550 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f94954d6640 1 --2- 172.21.15.72:0/1989579805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006cce0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d90 tx=0x7f948c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52de2f7fa68caa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f9487fff640 1 -- 172.21.15.72:0/1989579805 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c02cd00 con 0x7f949015ae80 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f9487fff640 1 -- 172.21.15.72:0/1989579805 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948c02ce60 con 0x7f949015ae80 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.090+0000 7f9487fff640 1 -- 172.21.15.72:0/1989579805 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c034660 con 0x7f949015ae80 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 -- 172.21.15.72:0/1989579805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 msgr2=0x7f949006cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 --2- 172.21.15.72:0/1989579805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006cce0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f948c009d90 tx=0x7f948c02bf50 comp rx=0 tx=0).stop 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 -- 172.21.15.72:0/1989579805 shutdown_connections 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 --2- 172.21.15.72:0/1989579805 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006cce0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 -- 172.21.15.72:0/1989579805 >> 172.21.15.72:0/1989579805 conn(0x7f94900b1920 msgr2=0x7f94900b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:18.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 -- 172.21.15.72:0/1989579805 shutdown_connections 2024-03-24T10:37:18.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.091+0000 7f949773a640 1 -- 172.21.15.72:0/1989579805 wait complete. 2024-03-24T10:37:18.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.092+0000 7f949773a640 1 Processor -- start 2024-03-24T10:37:18.094 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.092+0000 7f949773a640 1 -- start start 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f949773a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949006e680 0x7f949014d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f949773a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9490071550 0x7f94900cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f949773a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f949773a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f949015b8d0 con 0x7f949015ae80 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f949773a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f94900cc600 con 0x7f949006e680 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f949773a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f94900cd110 con 0x7f9490071550 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40908/0 (socket says 172.21.15.72:40908) 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 -- 172.21.15.72:0/2840992918 learned_addr learned my addr 172.21.15.72:0/2840992918 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f94954d6640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949006e680 0x7f949014d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9494cd5640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9490071550 0x7f94900cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 -- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9490071550 msgr2=0x7f94900cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.095 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9490071550 0x7f94900cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 -- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949006e680 msgr2=0x7f949014d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949006e680 0x7f949014d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.093+0000 7f9495cd7640 1 -- 172.21.15.72:0/2840992918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948c009a70 con 0x7f949015ae80 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.094+0000 7f9495cd7640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006d570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f948800c4b0 tx=0x7f948800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.094+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488007ea0 con 0x7f949015ae80 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.094+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94880074e0 con 0x7f949015ae80 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.094+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488004a20 con 0x7f949015ae80 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.094+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94900cc7e0 con 0x7f949015ae80 2024-03-24T10:37:18.096 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.094+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94900ccda0 con 0x7f949015ae80 2024-03-24T10:37:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.095+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94900cd280 con 0x7f949015ae80 2024-03-24T10:37:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.095+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9488004b80 con 0x7f949015ae80 2024-03-24T10:37:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.095+0000 7f9485ffb640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f947406b840 0x7f947406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.096+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f9488089970 con 0x7f949015ae80 2024-03-24T10:37:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.096+0000 7f94954d6640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f947406b840 0x7f947406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.096+0000 7f94954d6640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f947406b840 0x7f947406dd00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f948c036000 tx=0x7f948c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.100+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9488054040 con 0x7f949015ae80 2024-03-24T10:37:18.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.275+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f949009e080 con 0x7f949015ae80 2024-03-24T10:37:18.277 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.276+0000 7f9485ffb640 1 -- 172.21.15.72:0/2840992918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f9488057700 con 0x7f949015ae80 2024-03-24T10:37:18.277 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:18.277 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f947406b840 msgr2=0x7f947406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f947406b840 0x7f947406dd00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f948c036000 tx=0x7f948c030000 comp rx=0 tx=0).stop 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 msgr2=0x7f949006d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006d570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f948800c4b0 tx=0x7f948800c970 comp rx=0 tx=0).stop 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 shutdown_connections 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f947406b840 0x7f947406dd00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f949015ae80 0x7f949006d570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9490071550 0x7f94900cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 --2- 172.21.15.72:0/2840992918 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f949006e680 0x7f949014d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 >> 172.21.15.72:0/2840992918 conn(0x7f94900b1920 msgr2=0x7f94900b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:18.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 shutdown_connections 2024-03-24T10:37:18.280 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.278+0000 7f949773a640 1 -- 172.21.15.72:0/2840992918 wait complete. 2024-03-24T10:37:18.291 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:18.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:18.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.396+0000 7fa7ceb81640 1 Processor -- start 2024-03-24T10:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.396+0000 7fa7ceb81640 1 -- start start 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7ceb81640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa7c8142490 0x7fa7c80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7ceb81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c80b2b10 0x7fa7c80cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7ceb81640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7c80ce1b0 0x7fa7c80ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7ceb81640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c80b2f50 con 0x7fa7c80ce1b0 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7ceb81640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa7c80b3210 con 0x7fa7c8142490 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7ceb81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c80b34f0 con 0x7fa7c80b2b10 2024-03-24T10:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7c80ce1b0 0x7fa7c80ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa7c80ce1b0 0x7fa7c80ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40914/0 (socket says 172.21.15.72:40914) 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 -- 172.21.15.72:0/3852198672 learned_addr learned my addr 172.21.15.72:0/3852198672 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cc91d640 1 --2- 172.21.15.72:0/3852198672 >> v2:172.21.15.79:3300/0 conn(0x7fa7c8142490 0x7fa7c80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7c7fff640 1 --2- 172.21.15.72:0/3852198672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c80b2b10 0x7fa7c80cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 -- 172.21.15.72:0/3852198672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c80b2b10 msgr2=0x7fa7c80cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 --2- 172.21.15.72:0/3852198672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c80b2b10 0x7fa7c80cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 -- 172.21.15.72:0/3852198672 >> v2:172.21.15.79:3300/0 conn(0x7fa7c8142490 msgr2=0x7fa7c80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 --2- 172.21.15.72:0/3852198672 >> v2:172.21.15.79:3300/0 conn(0x7fa7c8142490 0x7fa7c80b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.397+0000 7fa7cd11e640 1 -- 172.21.15.72:0/3852198672 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c80b37d0 con 0x7fa7c80ce1b0 2024-03-24T10:37:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.398+0000 7fa7cd11e640 1 --2- 172.21.15.72:0/3852198672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c80ce620 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8070800 tx=0x7fa7c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b79a44b306585f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.398+0000 7fa7c77fe640 1 -- 172.21.15.72:0/3852198672 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c002ca70 con 0x7fa7c80ce1b0 2024-03-24T10:37:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.398+0000 7fa7c77fe640 1 -- 172.21.15.72:0/3852198672 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7c002cbd0 con 0x7fa7c80ce1b0 2024-03-24T10:37:18.400 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.398+0000 7fa7c77fe640 1 -- 172.21.15.72:0/3852198672 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00343f0 con 0x7fa7c80ce1b0 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 -- 172.21.15.72:0/3852198672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80ce1b0 msgr2=0x7fa7c80ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/3852198672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c80ce620 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8070800 tx=0x7fa7c002bed0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 -- 172.21.15.72:0/3852198672 shutdown_connections 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/3852198672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c80ce620 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/3852198672 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c80b2b10 0x7fa7c80cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/3852198672 >> v2:172.21.15.79:3300/0 conn(0x7fa7c8142490 0x7fa7c80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 -- 172.21.15.72:0/3852198672 >> 172.21.15.72:0/3852198672 conn(0x7fa7c80b1810 msgr2=0x7fa7c80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 -- 172.21.15.72:0/3852198672 shutdown_connections 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.399+0000 7fa7ceb81640 1 -- 172.21.15.72:0/3852198672 wait complete. 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.400+0000 7fa7ceb81640 1 Processor -- start 2024-03-24T10:37:18.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.400+0000 7fa7ceb81640 1 -- start start 2024-03-24T10:37:18.403 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 0x7fa7c815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c815e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c8142490 0x7fa7c815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.404 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c815e6b0 con 0x7fa7c80b2b10 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa7c815e8a0 con 0x7fa7c80ce1b0 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa7c815eb80 con 0x7fa7c8142490 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 0x7fa7c815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 0x7fa7c815d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40930/0 (socket says 172.21.15.72:40930) 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 -- 172.21.15.72:0/1440954114 learned_addr learned my addr 172.21.15.72:0/1440954114 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7c7fff640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c815e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cd11e640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c8142490 0x7fa7c815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 -- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c8142490 msgr2=0x7fa7c815a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c8142490 0x7fa7c815a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 -- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7c80ce1b0 msgr2=0x7fa7c815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c815e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 -- 172.21.15.72:0/1440954114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7c0009b30 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7cc91d640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 0x7fa7c815d1e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00e9b0 tx=0x7fa7bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc009670 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7bc00c9a0 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7c815ee60 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc00cd50 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.401+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7c815ad30 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.402+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7c804f470 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.403+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa7bc013470 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.403+0000 7fa7c57fa640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa7ac06b840 0x7fa7ac06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.403+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa7bc08a6d0 con 0x7fa7c80b2b10 2024-03-24T10:37:18.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.403+0000 7fa7c7fff640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa7ac06b840 0x7fa7ac06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.404+0000 7fa7c7fff640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa7ac06b840 0x7fa7ac06dd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80b2a50 tx=0x7fa7b4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.407+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa7bc054e30 con 0x7fa7c80b2b10 2024-03-24T10:37:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.580+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7c80ccc70 con 0x7fa7c80b2b10 2024-03-24T10:37:18.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.581+0000 7fa7c57fa640 1 -- 172.21.15.72:0/1440954114 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fa7bc0584f0 con 0x7fa7c80b2b10 2024-03-24T10:37:18.582 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:18.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa7ac06b840 msgr2=0x7fa7ac06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa7ac06b840 0x7fa7ac06dd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80b2a50 tx=0x7fa7b4009190 comp rx=0 tx=0).stop 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 msgr2=0x7fa7c815d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 0x7fa7c815d1e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00e9b0 tx=0x7fa7bc00ee70 comp rx=0 tx=0).stop 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 shutdown_connections 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa7ac06b840 0x7fa7ac06dd00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa7c8142490 0x7fa7c815a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa7c80ce1b0 0x7fa7c815e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 --2- 172.21.15.72:0/1440954114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7c80b2b10 0x7fa7c815d1e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 >> 172.21.15.72:0/1440954114 conn(0x7fa7c80b1810 msgr2=0x7fa7c80cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 shutdown_connections 2024-03-24T10:37:18.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.583+0000 7fa7ceb81640 1 -- 172.21.15.72:0/1440954114 wait complete. 2024-03-24T10:37:18.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:18.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.696+0000 7f65fc91e640 1 Processor -- start 2024-03-24T10:37:18.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65fc91e640 1 -- start start 2024-03-24T10:37:18.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65fc91e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f65f80d2b20 0x7f65f80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65fc91e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65f80d0f70 0x7f65f80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65fc91e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f80d4950 con 0x7f65f815e240 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65fc91e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f65f80d2270 con 0x7f65f80d0f70 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65fc91e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f65f80b38c0 con 0x7f65f80d2b20 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65f6d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65f80d0f70 0x7f65f80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65f6d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65f80d0f70 0x7f65f80cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40932/0 (socket says 172.21.15.72:40932) 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.697+0000 7f65f6d9d640 1 -- 172.21.15.72:0/3036263847 learned_addr learned my addr 172.21.15.72:0/3036263847 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.698+0000 7f65effff640 1 --2- 172.21.15.72:0/3036263847 >> v2:172.21.15.79:3300/0 conn(0x7f65f80d2b20 0x7f65f80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.698+0000 7f65f6d9d640 1 -- 172.21.15.72:0/3036263847 >> v2:172.21.15.79:3300/0 conn(0x7f65f80d2b20 msgr2=0x7f65f80cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.698+0000 7f65f6d9d640 1 --2- 172.21.15.72:0/3036263847 >> v2:172.21.15.79:3300/0 conn(0x7f65f80d2b20 0x7f65f80cea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.698+0000 7f65f6d9d640 1 -- 172.21.15.72:0/3036263847 >> v1:172.21.15.79:6789/0 conn(0x7f65f815e240 legacy=0x7f65f80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.698+0000 7f65f6d9d640 1 -- 172.21.15.72:0/3036263847 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f80b3550 con 0x7f65f80d0f70 2024-03-24T10:37:18.699 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.698+0000 7f65f6d9d640 1 --2- 172.21.15.72:0/3036263847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d0f70 0x7f65f80cef80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65f80b69b0 tx=0x7f65f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298007f9031766d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65f5d9b640 1 -- 172.21.15.72:0/3036263847 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f002ca80 con 0x7f65f80d0f70 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65f5d9b640 1 -- 172.21.15.72:0/3036263847 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65f002cbe0 con 0x7f65f80d0f70 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65f5d9b640 1 -- 172.21.15.72:0/3036263847 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00343f0 con 0x7f65f80d0f70 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 -- 172.21.15.72:0/3036263847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d0f70 msgr2=0x7f65f80cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3036263847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d0f70 0x7f65f80cef80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f65f80b69b0 tx=0x7f65f002bee0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 -- 172.21.15.72:0/3036263847 shutdown_connections 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3036263847 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d0f70 0x7f65f80cef80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3036263847 >> v2:172.21.15.79:3300/0 conn(0x7f65f80d2b20 0x7f65f80cea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 -- 172.21.15.72:0/3036263847 >> 172.21.15.72:0/3036263847 conn(0x7f65f80d3e30 msgr2=0x7f65f80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:18.701 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 -- 172.21.15.72:0/3036263847 shutdown_connections 2024-03-24T10:37:18.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.699+0000 7f65fc91e640 1 -- 172.21.15.72:0/3036263847 wait complete. 2024-03-24T10:37:18.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.700+0000 7f65fc91e640 1 Processor -- start 2024-03-24T10:37:18.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 -- start start 2024-03-24T10:37:18.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f80d0f70 0x7f65f815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 0x7f65f80cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f815e240 0x7f65f80cd610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f65f80b80f0 con 0x7f65f80d2b20 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65f81f38e0 con 0x7f65f815e240 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65fc91e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f65f81f3bc0 con 0x7f65f80d0f70 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65effff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 0x7f65f80cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65effff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 0x7f65f80cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40934/0 (socket says 172.21.15.72:40934) 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65effff640 1 -- 172.21.15.72:0/3628315995 learned_addr learned my addr 172.21.15.72:0/3628315995 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65f6d9d640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f815e240 0x7f65f80cd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.701+0000 7f65f659c640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f80d0f70 0x7f65f815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65effff640 1 -- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f80d0f70 msgr2=0x7f65f815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65effff640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f80d0f70 0x7f65f815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65effff640 1 -- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f815e240 msgr2=0x7f65f80cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.706 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65effff640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f815e240 0x7f65f80cd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65effff640 1 -- 172.21.15.72:0/3628315995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0009b30 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65effff640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 0x7f65f80cd0d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65e000e870 tx=0x7f65e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e00094f0 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e000c940 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f81f3ea0 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e000ccf0 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.702+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81f35f0 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.703+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f804f470 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.703+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f65e0013470 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.704+0000 7f65eeffd640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65d806b810 0x7f65d806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.704+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f65e008a560 con 0x7f65f80d2b20 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.704+0000 7f65f659c640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65d806b810 0x7f65d806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.704+0000 7f65f659c640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65d806b810 0x7f65d806dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65f80d1710 tx=0x7f65e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:18.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.708+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f65e0054cc0 con 0x7f65f80d2b20 2024-03-24T10:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.878+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f65f8074770 con 0x7f65f80d2b20 2024-03-24T10:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.878+0000 7f65eeffd640 1 -- 172.21.15.72:0/3628315995 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f65e0058380 con 0x7f65f80d2b20 2024-03-24T10:37:18.879 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65d806b810 msgr2=0x7f65d806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65d806b810 0x7f65d806dcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f65f80d1710 tx=0x7f65e8009040 comp rx=0 tx=0).stop 2024-03-24T10:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 msgr2=0x7f65f80cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 0x7f65f80cd0d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f65e000e870 tx=0x7f65e000ed30 comp rx=0 tx=0).stop 2024-03-24T10:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 shutdown_connections 2024-03-24T10:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f65d806b810 0x7f65d806dcd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f65f815e240 0x7f65f80cd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65f80d2b20 0x7f65f80cd0d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 --2- 172.21.15.72:0/3628315995 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f65f80d0f70 0x7f65f815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 >> 172.21.15.72:0/3628315995 conn(0x7f65f80d3e30 msgr2=0x7f65f80d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 shutdown_connections 2024-03-24T10:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.880+0000 7f65fc91e640 1 -- 172.21.15.72:0/3628315995 wait complete. 2024-03-24T10:37:18.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:18.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.995+0000 7f57ab9af640 1 Processor -- start 2024-03-24T10:37:18.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.995+0000 7f57ab9af640 1 -- start start 2024-03-24T10:37:18.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57ab9af640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a40b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:18.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57ab9af640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57a40b4700 con 0x7f57a40ce8c0 2024-03-24T10:37:18.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57ab9af640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57a40b3210 con 0x7f57a4142490 2024-03-24T10:37:18.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57ab9af640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f57a40b34f0 con 0x7f57a40b42b0 2024-03-24T10:37:18.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57a8f4a640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f57a40ce8c0 0x7f57a4142e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49076/0 (socket says 172.21.15.72:49076) 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57a8f4a640 1 -- 172.21.15.72:0/1728016244 learned_addr learned my addr 172.21.15.72:0/1728016244 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57a9f4c640 1 --2- 172.21.15.72:0/1728016244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a40b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283710327 0 0) 0x7f57a40b4700 con 0x7f57a40ce8c0 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5790003520 con 0x7f57a40ce8c0 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204628030 0 0) 0x7f57a40b3210 con 0x7f57a4142490 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57a40b4700 con 0x7f57a4142490 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57a9f4c640 1 -- 172.21.15.72:0/1728016244 >> v1:172.21.15.79:6789/0 conn(0x7f57a4142490 legacy=0x7f57a40ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57a9f4c640 1 -- 172.21.15.72:0/1728016244 >> v1:172.21.15.72:6789/0 conn(0x7f57a40ce8c0 legacy=0x7f57a4142e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:18.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.996+0000 7f57a9f4c640 1 -- 172.21.15.72:0/1728016244 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a40b37d0 con 0x7f57a40b42b0 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.997+0000 7f57a9f4c640 1 --2- 172.21.15.72:0/1728016244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a40b2b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f579c009dc0 tx=0x7f579c02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2173651fb850148 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.997+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c02cc40 con 0x7f57a40b42b0 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.997+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f579c02cda0 con 0x7f57a40b42b0 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.997+0000 7f579bfff640 1 -- 172.21.15.72:0/1728016244 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c034640 con 0x7f57a40b42b0 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 -- 172.21.15.72:0/1728016244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 msgr2=0x7f57a40b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 --2- 172.21.15.72:0/1728016244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a40b2b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f579c009dc0 tx=0x7f579c02be90 comp rx=0 tx=0).stop 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 -- 172.21.15.72:0/1728016244 shutdown_connections 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 --2- 172.21.15.72:0/1728016244 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a40b2b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 -- 172.21.15.72:0/1728016244 >> 172.21.15.72:0/1728016244 conn(0x7f57a40b1810 msgr2=0x7f57a40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 -- 172.21.15.72:0/1728016244 shutdown_connections 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.998+0000 7f57ab9af640 1 -- 172.21.15.72:0/1728016244 wait complete. 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.999+0000 7f57ab9af640 1 Processor -- start 2024-03-24T10:37:19.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:18.999+0000 7f57ab9af640 1 -- start start 2024-03-24T10:37:19.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57ab9af640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a415a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57ab9af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40ce8c0 0x7f57a413ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57ab9af640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 0x7f57a4159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57ab9af640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f57a415a3a0 con 0x7f57a4142490 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57ab9af640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4159e80 con 0x7f57a40ce8c0 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57ab9af640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f57a413d100 con 0x7f57a40b42b0 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 0x7f57a4159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 0x7f57a4159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40942/0 (socket says 172.21.15.72:40942) 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 -- 172.21.15.72:0/488330575 learned_addr learned my addr 172.21.15.72:0/488330575 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a974b640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a415a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a8f4a640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40ce8c0 0x7f57a413ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 -- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 msgr2=0x7f57a415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a415a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 -- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40ce8c0 msgr2=0x7f57a413ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40ce8c0 0x7f57a413ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a9f4c640 1 -- 172.21.15.72:0/488330575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c009a70 con 0x7f57a4142490 2024-03-24T10:37:19.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a8f4a640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40ce8c0 0x7f57a413ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:19.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.000+0000 7f57a974b640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:19.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.001+0000 7f57a9f4c640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 0x7f57a4159940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f579c009ee0 tx=0x7f579c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.001+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c007000 con 0x7f57a4142490 2024-03-24T10:37:19.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.001+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f579c040650 con 0x7f57a4142490 2024-03-24T10:37:19.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.001+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a4071670 con 0x7f57a4142490 2024-03-24T10:37:19.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.001+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c040a00 con 0x7f57a4142490 2024-03-24T10:37:19.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.001+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a4071c30 con 0x7f57a4142490 2024-03-24T10:37:19.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.002+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a404f470 con 0x7f57a4142490 2024-03-24T10:37:19.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.002+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f579c040b60 con 0x7f57a4142490 2024-03-24T10:37:19.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.003+0000 7f5799ffb640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f578806b810 0x7f578806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.003+0000 7f57a974b640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f578806b810 0x7f578806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.003+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f579c0ad110 con 0x7f57a4142490 2024-03-24T10:37:19.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.003+0000 7f57a974b640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f578806b810 0x7f578806dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007fd0 tx=0x7f57a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.007+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f579c077a50 con 0x7f57a4142490 2024-03-24T10:37:19.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.176+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f57a40ccc70 con 0x7f57a4142490 2024-03-24T10:37:19.177 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.177+0000 7f5799ffb640 1 -- 172.21.15.72:0/488330575 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f579c009450 con 0x7f57a4142490 2024-03-24T10:37:19.177 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:19.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.178+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f578806b810 msgr2=0x7f578806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.178+0000 7f57ab9af640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f578806b810 0x7f578806dcd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f57a0007fd0 tx=0x7f57a0009040 comp rx=0 tx=0).stop 2024-03-24T10:37:19.179 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 msgr2=0x7f57a4159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 0x7f57a4159940 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f579c009ee0 tx=0x7f579c004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 shutdown_connections 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f578806b810 0x7f578806dcd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f57a4142490 0x7f57a4159940 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57a40ce8c0 0x7f57a413ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 --2- 172.21.15.72:0/488330575 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f57a40b42b0 0x7f57a415a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 >> 172.21.15.72:0/488330575 conn(0x7f57a40b1810 msgr2=0x7f57a40ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 shutdown_connections 2024-03-24T10:37:19.180 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.179+0000 7f57ab9af640 1 -- 172.21.15.72:0/488330575 wait complete. 2024-03-24T10:37:19.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.296+0000 7fc73daeb640 1 Processor -- start 2024-03-24T10:37:19.296 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.296+0000 7fc73daeb640 1 -- start start 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc73daeb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7380cf310 0x7fc73815b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc73daeb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738154ea0 con 0x7fc7380b3580 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc73daeb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc738071460 con 0x7fc738072470 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc73daeb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc73815b9c0 con 0x7fc7380cf310 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc737fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc7380cf310 0x7fc73815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc736ffd640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fc738072470 0x7fc73806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:35386/0 (socket says 172.21.15.72:35386) 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc736ffd640 1 -- 172.21.15.72:0/3650859414 learned_addr learned my addr 172.21.15.72:0/3650859414 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc7377fe640 1 --1- 172.21.15.72:0/3650859414 >> v1:172.21.15.72:6789/0 conn(0x7fc7380b3580 0x7fc7380b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49078/0 (socket says 172.21.15.72:49078) 2024-03-24T10:37:19.298 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc737fff640 1 -- 172.21.15.72:0/3650859414 >> v1:172.21.15.79:6789/0 conn(0x7fc738072470 legacy=0x7fc73806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc737fff640 1 -- 172.21.15.72:0/3650859414 >> v1:172.21.15.72:6789/0 conn(0x7fc7380b3580 legacy=0x7fc7380b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc7367fc640 1 -- 172.21.15.72:0/3650859414 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4260177540 0 0) 0x7fc738071460 con 0x7fc738072470 2024-03-24T10:37:19.299 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.297+0000 7fc737fff640 1 -- 172.21.15.72:0/3650859414 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc738071fe0 con 0x7fc7380cf310 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc737fff640 1 --2- 172.21.15.72:0/3650859414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380cf310 0x7fc73815b480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc730009d90 tx=0x7fc73002bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b63fcb8953eb3f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc7367fc640 1 -- 172.21.15.72:0/3650859414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc73002ca20 con 0x7fc7380cf310 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc7367fc640 1 -- 172.21.15.72:0/3650859414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc73002cb80 con 0x7fc7380cf310 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc7367fc640 1 -- 172.21.15.72:0/3650859414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc730034440 con 0x7fc7380cf310 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc73daeb640 1 -- 172.21.15.72:0/3650859414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380cf310 msgr2=0x7fc73815b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc73daeb640 1 --2- 172.21.15.72:0/3650859414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380cf310 0x7fc73815b480 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc730009d90 tx=0x7fc73002bcf0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.300 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc73daeb640 1 -- 172.21.15.72:0/3650859414 shutdown_connections 2024-03-24T10:37:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc73daeb640 1 --2- 172.21.15.72:0/3650859414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380cf310 0x7fc73815b480 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.298+0000 7fc73daeb640 1 -- 172.21.15.72:0/3650859414 >> 172.21.15.72:0/3650859414 conn(0x7fc7380b1810 msgr2=0x7fc7380b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.299+0000 7fc73daeb640 1 -- 172.21.15.72:0/3650859414 shutdown_connections 2024-03-24T10:37:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.299+0000 7fc73daeb640 1 -- 172.21.15.72:0/3650859414 wait complete. 2024-03-24T10:37:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.300+0000 7fc73daeb640 1 Processor -- start 2024-03-24T10:37:19.301 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.300+0000 7fc73daeb640 1 -- start start 2024-03-24T10:37:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.300+0000 7fc73daeb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc738072470 0x7fc738150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.300+0000 7fc73daeb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 0x7fc7381f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.303 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.300+0000 7fc73daeb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7380cf310 0x7fc7381596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.300+0000 7fc73daeb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc738151490 con 0x7fc7380b3580 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc73daeb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc7381f4cb0 con 0x7fc7380cf310 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc73daeb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc738150910 con 0x7fc738072470 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 0x7fc7381f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 0x7fc7381f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40952/0 (socket says 172.21.15.72:40952) 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 -- 172.21.15.72:0/1542429431 learned_addr learned my addr 172.21.15.72:0/1542429431 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc737fff640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7380cf310 0x7fc7381596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc7377fe640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc738072470 0x7fc738150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 -- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc738072470 msgr2=0x7fc738150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc738072470 0x7fc738150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 -- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7380cf310 msgr2=0x7fc7381596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7380cf310 0x7fc7381596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.304 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 -- 172.21.15.72:0/1542429431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc730009a70 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc736ffd640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 0x7fc7381f4770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c410 tx=0x7fc72c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c0074e0 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc72c007660 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc738150bf0 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc72c004a20 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.301+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7381511b0 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.302+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc73804f470 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.303+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc72c004b80 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.303+0000 7fc71ffff640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc72406b810 0x7fc72406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.303+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc72c08a200 con 0x7fc7380b3580 2024-03-24T10:37:19.305 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.303+0000 7fc7377fe640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc72406b810 0x7fc72406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.306 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.304+0000 7fc7377fe640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc72406b810 0x7fc72406dcd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f60 tx=0x7fc728007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.307+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc72c054960 con 0x7fc7380b3580 2024-03-24T10:37:19.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.480+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc7380710e0 con 0x7fc7380b3580 2024-03-24T10:37:19.480 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.480+0000 7fc71ffff640 1 -- 172.21.15.72:0/1542429431 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fc72c058020 con 0x7fc7380b3580 2024-03-24T10:37:19.481 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc72406b810 msgr2=0x7fc72406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc72406b810 0x7fc72406dcd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc728000f60 tx=0x7fc728007e00 comp rx=0 tx=0).stop 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 msgr2=0x7fc7381f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 0x7fc7381f4770 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00c410 tx=0x7fc72c00c8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 shutdown_connections 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc72406b810 0x7fc72406dcd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc7380cf310 0x7fc7381596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc7380b3580 0x7fc7381f4770 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 --2- 172.21.15.72:0/1542429431 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc738072470 0x7fc738150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 >> 172.21.15.72:0/1542429431 conn(0x7fc7380b1810 msgr2=0x7fc73815dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:19.483 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 shutdown_connections 2024-03-24T10:37:19.484 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.482+0000 7fc73daeb640 1 -- 172.21.15.72:0/1542429431 wait complete. 2024-03-24T10:37:19.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:37:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.595+0000 7fd08ce9d640 1 Processor -- start 2024-03-24T10:37:19.596 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.595+0000 7fd08ce9d640 1 -- start start 2024-03-24T10:37:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd08ce9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd088145700 0x7fd08806de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd08ce9d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08806d9c0 con 0x7fd08815fa20 2024-03-24T10:37:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd08ce9d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd08806e390 con 0x7fd08806edf0 2024-03-24T10:37:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd08ce9d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd0880cf710 con 0x7fd088145700 2024-03-24T10:37:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd086d9d640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd08815fa20 0x7fd088070d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49090/0 (socket says 172.21.15.72:49090) 2024-03-24T10:37:19.597 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd086d9d640 1 -- 172.21.15.72:0/2855606041 learned_addr learned my addr 172.21.15.72:0/2855606041 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.596+0000 7fd08659c640 1 --2- 172.21.15.72:0/2855606041 >> v2:172.21.15.79:3300/0 conn(0x7fd088145700 0x7fd08806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.597+0000 7fd08559a640 1 -- 172.21.15.72:0/2855606041 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828360132 0 0) 0x7fd08806d9c0 con 0x7fd08815fa20 2024-03-24T10:37:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.597+0000 7fd08559a640 1 -- 172.21.15.72:0/2855606041 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd070003520 con 0x7fd08815fa20 2024-03-24T10:37:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.597+0000 7fd08659c640 1 -- 172.21.15.72:0/2855606041 >> v1:172.21.15.79:6789/0 conn(0x7fd08806edf0 legacy=0x7fd0880cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.597+0000 7fd08659c640 1 -- 172.21.15.72:0/2855606041 >> v1:172.21.15.72:6789/0 conn(0x7fd08815fa20 legacy=0x7fd088070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.598 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.597+0000 7fd08659c640 1 -- 172.21.15.72:0/2855606041 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd08806d090 con 0x7fd088145700 2024-03-24T10:37:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.597+0000 7fd08659c640 1 --2- 172.21.15.72:0/2855606041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd088145700 0x7fd08806de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd07802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859e49279f32b085 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.599 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08559a640 1 -- 172.21.15.72:0/2855606041 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd07802cc60 con 0x7fd088145700 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08559a640 1 -- 172.21.15.72:0/2855606041 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd07802cdc0 con 0x7fd088145700 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08559a640 1 -- 172.21.15.72:0/2855606041 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078034660 con 0x7fd088145700 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 -- 172.21.15.72:0/2855606041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd088145700 msgr2=0x7fd08806de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/2855606041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd088145700 0x7fd08806de50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd07802beb0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 -- 172.21.15.72:0/2855606041 shutdown_connections 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/2855606041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd088145700 0x7fd08806de50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.600 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 -- 172.21.15.72:0/2855606041 >> 172.21.15.72:0/2855606041 conn(0x7fd0880b1810 msgr2=0x7fd0880b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 -- 172.21.15.72:0/2855606041 shutdown_connections 2024-03-24T10:37:19.601 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.598+0000 7fd08ce9d640 1 -- 172.21.15.72:0/2855606041 wait complete. 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 Processor -- start 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 -- start start 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 0x7fd0881514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd088145700 0x7fd08813fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08815fa20 0x7fd088140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd0880aa1d0 con 0x7fd08806edf0 2024-03-24T10:37:19.604 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd08813ce40 con 0x7fd08815fa20 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08ce9d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd0881f1b90 con 0x7fd088145700 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 0x7fd0881514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 0x7fd0881514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40968/0 (socket says 172.21.15.72:40968) 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd08659c640 1 -- 172.21.15.72:0/725438083 learned_addr learned my addr 172.21.15.72:0/725438083 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd086d9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08815fa20 0x7fd088140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.600+0000 7fd085d9b640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd088145700 0x7fd08813fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08659c640 1 -- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd088145700 msgr2=0x7fd08813fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08659c640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd088145700 0x7fd08813fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08659c640 1 -- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08815fa20 msgr2=0x7fd088140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08659c640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08815fa20 0x7fd088140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08659c640 1 -- 172.21.15.72:0/725438083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd078009a70 con 0x7fd08806edf0 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08659c640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 0x7fd0881514e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078040650 con 0x7fd08806edf0 2024-03-24T10:37:19.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0780407b0 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd088151a20 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd078040b60 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.601+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd088144080 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.602+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd088073d50 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.603+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd078040cc0 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.603+0000 7fd076ffd640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd06806b810 0x7fd06806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.603+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd0780ad250 con 0x7fd08806edf0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.603+0000 7fd085d9b640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd06806b810 0x7fd06806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:19.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.603+0000 7fd085d9b640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd06806b810 0x7fd06806dcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd088140c00 tx=0x7fd07c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:19.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.607+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd078077ad0 con 0x7fd08806edf0 2024-03-24T10:37:19.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.790+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd088072d60 con 0x7fd08806edf0 2024-03-24T10:37:19.791 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.791+0000 7fd076ffd640 1 -- 172.21.15.72:0/725438083 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fd07807b190 con 0x7fd08806edf0 2024-03-24T10:37:19.791 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.792+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd06806b810 msgr2=0x7fd06806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.792+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd06806b810 0x7fd06806dcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd088140c00 tx=0x7fd07c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.792+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 msgr2=0x7fd0881514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.792+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 0x7fd0881514e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd078004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 shutdown_connections 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd06806b810 0x7fd06806dcd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd08815fa20 0x7fd088140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd088145700 0x7fd08813fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.794 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 --2- 172.21.15.72:0/725438083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08806edf0 0x7fd0881514e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:19.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 >> 172.21.15.72:0/725438083 conn(0x7fd0880b1810 msgr2=0x7fd0880b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:19.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 shutdown_connections 2024-03-24T10:37:19.795 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:19.793+0000 7fd08ce9d640 1 -- 172.21.15.72:0/725438083 wait complete. 2024-03-24T10:37:19.804 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-24T10:37:19.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:19.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-24T10:37:19.833 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:37:19.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:19.834 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-24T10:37:19.896 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:19.896 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:19.912 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:19.912 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:19.967 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:19.968 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:20.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 Processor -- start 2024-03-24T10:37:20.162 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 -- start start 2024-03-24T10:37:20.163 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4e900d4930 0x7f4e9015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d2450 0x7f4e900b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e900d4e50 con 0x7f4e9015e170 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4e900cf790 con 0x7f4e900d4930 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.162+0000 7f4e966da640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f4e900cfa70 con 0x7f4e900d2450 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e8ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4e9015e170 0x7f4e900d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49106/0 (socket says 172.21.15.72:49106) 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e8ffff640 1 -- 172.21.15.72:0/2316113021 learned_addr learned my addr 172.21.15.72:0/2316113021 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e94c77640 1 --2- 172.21.15.72:0/2316113021 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d2450 0x7f4e900b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e8f7fe640 1 --2- 172.21.15.72:0/2316113021 >> v2:172.21.15.79:3300/0 conn(0x7f4e900d4930 0x7f4e9015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e8effd640 1 -- 172.21.15.72:0/2316113021 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313421129 0 0) 0x7f4e900d4e50 con 0x7f4e9015e170 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e8effd640 1 -- 172.21.15.72:0/2316113021 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e78003520 con 0x7f4e9015e170 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e94c77640 1 -- 172.21.15.72:0/2316113021 >> v2:172.21.15.79:3300/0 conn(0x7f4e900d4930 msgr2=0x7f4e9015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e94c77640 1 --2- 172.21.15.72:0/2316113021 >> v2:172.21.15.79:3300/0 conn(0x7f4e900d4930 0x7f4e9015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.164 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e94c77640 1 -- 172.21.15.72:0/2316113021 >> v1:172.21.15.72:6789/0 conn(0x7f4e9015e170 legacy=0x7f4e900d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e94c77640 1 -- 172.21.15.72:0/2316113021 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e900cfd50 con 0x7f4e900d2450 2024-03-24T10:37:20.165 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.163+0000 7f4e8f7fe640 1 --2- 172.21.15.72:0/2316113021 >> v2:172.21.15.79:3300/0 conn(0x7f4e900d4930 0x7f4e9015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:20.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e94c77640 1 --2- 172.21.15.72:0/2316113021 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d2450 0x7f4e900b3c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009d90 tx=0x7f4e8802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad6deb10e1126500 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.168 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e8effd640 1 -- 172.21.15.72:0/2316113021 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8802cbc0 con 0x7f4e900d2450 2024-03-24T10:37:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e8effd640 1 -- 172.21.15.72:0/2316113021 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8802cd20 con 0x7f4e900d2450 2024-03-24T10:37:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e8effd640 1 -- 172.21.15.72:0/2316113021 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88034640 con 0x7f4e900d2450 2024-03-24T10:37:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 -- 172.21.15.72:0/2316113021 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d2450 msgr2=0x7f4e900b3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.169 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 --2- 172.21.15.72:0/2316113021 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d2450 0x7f4e900b3c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009d90 tx=0x7f4e8802be10 comp rx=0 tx=0).stop 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 -- 172.21.15.72:0/2316113021 shutdown_connections 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 --2- 172.21.15.72:0/2316113021 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d2450 0x7f4e900b3c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 --2- 172.21.15.72:0/2316113021 >> v2:172.21.15.79:3300/0 conn(0x7f4e900d4930 0x7f4e9015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 -- 172.21.15.72:0/2316113021 >> 172.21.15.72:0/2316113021 conn(0x7f4e9009d310 msgr2=0x7f4e900d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 -- 172.21.15.72:0/2316113021 shutdown_connections 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.164+0000 7f4e966da640 1 -- 172.21.15.72:0/2316113021 wait complete. 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.165+0000 7f4e966da640 1 Processor -- start 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 -- start start 2024-03-24T10:37:20.170 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e900d2450 0x7f4e9006be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d4930 0x7f4e9015aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 0x7f4e90157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9006c780 con 0x7f4e9015e170 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9006ca60 con 0x7f4e900d2450 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.166+0000 7f4e966da640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9006cd40 con 0x7f4e900d4930 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 0x7f4e90157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 0x7f4e90157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40978/0 (socket says 172.21.15.72:40978) 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 -- 172.21.15.72:0/1968734710 learned_addr learned my addr 172.21.15.72:0/1968734710 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e8ffff640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e900d2450 0x7f4e9006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e8f7fe640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d4930 0x7f4e9015aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 -- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d4930 msgr2=0x7f4e9015aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d4930 0x7f4e9015aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 -- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e900d2450 msgr2=0x7f4e9006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.171 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e900d2450 0x7f4e9006be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 -- 172.21.15.72:0/1968734710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e80009400 con 0x7f4e9015e170 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e8ffff640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e900d2450 0x7f4e9006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e94c77640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 0x7f4e90157ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009d90 tx=0x7f4e88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88007000 con 0x7f4e9015e170 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e8802ce90 con 0x7f4e9015e170 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e88009a70 con 0x7f4e9015e170 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e880408b0 con 0x7f4e9015e170 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.167+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9006d300 con 0x7f4e9015e170 2024-03-24T10:37:20.172 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.168+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9006d820 con 0x7f4e9015e170 2024-03-24T10:37:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.169+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4e88040a10 con 0x7f4e9015e170 2024-03-24T10:37:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.169+0000 7f4e8cff9640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4e7c06b810 0x7f4e7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.169+0000 7f4e8ffff640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4e7c06b810 0x7f4e7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.169+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f4e880ad030 con 0x7f4e9015e170 2024-03-24T10:37:20.173 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.170+0000 7f4e8ffff640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4e7c06b810 0x7f4e7c06dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e84005880 tx=0x7f4e84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.174 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.174+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4e880777c0 con 0x7f4e9015e170 2024-03-24T10:37:20.346 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.345+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e900a1ef0 con 0x7f4e9015e170 2024-03-24T10:37:20.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.346+0000 7f4e8cff9640 1 -- 172.21.15.72:0/1968734710 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f4e88009450 con 0x7f4e9015e170 2024-03-24T10:37:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:20.347 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:20.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.348+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4e7c06b810 msgr2=0x7f4e7c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.349 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.348+0000 7f4e966da640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4e7c06b810 0x7f4e7c06dcd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e84005880 tx=0x7f4e84009040 comp rx=0 tx=0).stop 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.348+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 msgr2=0x7f4e90157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.348+0000 7f4e966da640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 0x7f4e90157ec0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e88009d90 tx=0x7f4e88004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 shutdown_connections 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4e7c06b810 0x7f4e7c06dcd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e9015e170 0x7f4e90157ec0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4e900d4930 0x7f4e9015aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 --2- 172.21.15.72:0/1968734710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e900d2450 0x7f4e9006be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 >> 172.21.15.72:0/1968734710 conn(0x7f4e9009d310 msgr2=0x7f4e900b5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:20.350 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 shutdown_connections 2024-03-24T10:37:20.351 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.349+0000 7f4e966da640 1 -- 172.21.15.72:0/1968734710 wait complete. 2024-03-24T10:37:20.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:20.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:20.464 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.464+0000 7f2d7a255640 1 Processor -- start 2024-03-24T10:37:20.465 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.464+0000 7f2d7a255640 1 -- start start 2024-03-24T10:37:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d7a255640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2d740b3580 0x7f2d740cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d7a255640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d74072470 0x7f2d7415b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d7a255640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d74154ea0 con 0x7f2d740b3960 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d7a255640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f2d7415b9c0 con 0x7f2d74072470 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d7a255640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f2d74071460 con 0x7f2d740b3580 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d72ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d74072470 0x7f2d7415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d73fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2d740b3960 0x7f2d7415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49116/0 (socket says 172.21.15.72:49116) 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d73fff640 1 -- 172.21.15.72:0/4140898468 learned_addr learned my addr 172.21.15.72:0/4140898468 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d737fe640 1 --2- 172.21.15.72:0/4140898468 >> v2:172.21.15.79:3300/0 conn(0x7f2d740b3580 0x7f2d740cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d72ffd640 1 -- 172.21.15.72:0/4140898468 >> v2:172.21.15.79:3300/0 conn(0x7f2d740b3580 msgr2=0x7f2d740cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d72ffd640 1 --2- 172.21.15.72:0/4140898468 >> v2:172.21.15.79:3300/0 conn(0x7f2d740b3580 0x7f2d740cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d72ffd640 1 -- 172.21.15.72:0/4140898468 >> v1:172.21.15.72:6789/0 conn(0x7f2d740b3960 legacy=0x7f2d7415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d72ffd640 1 -- 172.21.15.72:0/4140898468 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d74071fe0 con 0x7f2d74072470 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.465+0000 7f2d727fc640 1 -- 172.21.15.72:0/4140898468 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723520888 0 0) 0x7f2d74154ea0 con 0x7f2d740b3960 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.466+0000 7f2d72ffd640 1 --2- 172.21.15.72:0/4140898468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d74072470 0x7f2d7415b480 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d740b2890 tx=0x7f2d6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aeb65cafd230d6a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.466+0000 7f2d727fc640 1 -- 172.21.15.72:0/4140898468 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6802e070 con 0x7f2d74072470 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.466+0000 7f2d727fc640 1 -- 172.21.15.72:0/4140898468 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d680315a0 con 0x7f2d74072470 2024-03-24T10:37:20.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.466+0000 7f2d727fc640 1 -- 172.21.15.72:0/4140898468 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68031930 con 0x7f2d74072470 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 -- 172.21.15.72:0/4140898468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d74072470 msgr2=0x7f2d7415b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 --2- 172.21.15.72:0/4140898468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d74072470 0x7f2d7415b480 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2d740b2890 tx=0x7f2d6802b840 comp rx=0 tx=0).stop 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 -- 172.21.15.72:0/4140898468 shutdown_connections 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 --2- 172.21.15.72:0/4140898468 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d74072470 0x7f2d7415b480 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 --2- 172.21.15.72:0/4140898468 >> v2:172.21.15.79:3300/0 conn(0x7f2d740b3580 0x7f2d740cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 -- 172.21.15.72:0/4140898468 >> 172.21.15.72:0/4140898468 conn(0x7f2d740b1810 msgr2=0x7f2d740b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:20.472 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 -- 172.21.15.72:0/4140898468 shutdown_connections 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.467+0000 7f2d7a255640 1 -- 172.21.15.72:0/4140898468 wait complete. 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.468+0000 7f2d7a255640 1 Processor -- start 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.468+0000 7f2d7a255640 1 -- start start 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d74072470 0x7f2d74159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 0x7f2d740cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d740b3960 0x7f2d740ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741689e0 con 0x7f2d740b3580 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74168cc0 con 0x7f2d74072470 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2d74168fa0 con 0x7f2d740b3960 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 0x7f2d740cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 0x7f2d740cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41002/0 (socket says 172.21.15.72:41002) 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 -- 172.21.15.72:0/1719752658 learned_addr learned my addr 172.21.15.72:0/1719752658 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d737fe640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d74072470 0x7f2d74159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.473 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d73fff640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d740b3960 0x7f2d740ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 -- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d740b3960 msgr2=0x7f2d740ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d740b3960 0x7f2d740ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 -- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d74072470 msgr2=0x7f2d74159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d74072470 0x7f2d74159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 -- 172.21.15.72:0/1719752658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d68009400 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d72ffd640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 0x7f2d740cdc80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68032840 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d680329c0 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d74169280 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68032d70 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.469+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d74159a60 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.470+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d74159c50 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.471+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2d6804d3f0 con 0x7f2d740b3580 2024-03-24T10:37:20.474 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.471+0000 7f2d5bfff640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d6006b810 0x7f2d6006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.471+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f2d680ac060 con 0x7f2d740b3580 2024-03-24T10:37:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.471+0000 7f2d737fe640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d6006b810 0x7f2d6006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.475 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.471+0000 7f2d737fe640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d6006b810 0x7f2d6006dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d74154d10 tx=0x7f2d64009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.476 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.476+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2d68076730 con 0x7f2d740b3580 2024-03-24T10:37:20.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.648+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d7404f470 con 0x7f2d740b3580 2024-03-24T10:37:20.648 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.648+0000 7f2d5bfff640 1 -- 172.21.15.72:0/1719752658 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f2d68079df0 con 0x7f2d740b3580 2024-03-24T10:37:20.649 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d6006b810 msgr2=0x7f2d6006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d6006b810 0x7f2d6006dcd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2d74154d10 tx=0x7f2d64009190 comp rx=0 tx=0).stop 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 msgr2=0x7f2d740cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 0x7f2d740cdc80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 shutdown_connections 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f2d6006b810 0x7f2d6006dcd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2d740b3960 0x7f2d740ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d740b3580 0x7f2d740cdc80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 --2- 172.21.15.72:0/1719752658 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d74072470 0x7f2d74159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 >> 172.21.15.72:0/1719752658 conn(0x7f2d740b1810 msgr2=0x7f2d7406e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 shutdown_connections 2024-03-24T10:37:20.651 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.651+0000 7f2d7a255640 1 -- 172.21.15.72:0/1719752658 wait complete. 2024-03-24T10:37:20.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.764+0000 7f27f613e640 1 Processor -- start 2024-03-24T10:37:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.764+0000 7f27f613e640 1 -- start start 2024-03-24T10:37:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27f613e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27f00b3580 0x7f27f00cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27f613e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f0072470 0x7f27f015b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27f613e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f0154ea0 con 0x7f27f00b3960 2024-03-24T10:37:20.766 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27f613e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f27f015b9c0 con 0x7f27f00b3580 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27f613e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f27f0071460 con 0x7f27f0072470 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27ef7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f27f00b3580 0x7f27f00cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27effff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f27f00b3960 0x7f27f015dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49130/0 (socket says 172.21.15.72:49130) 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27effff640 1 -- 172.21.15.72:0/3330806030 learned_addr learned my addr 172.21.15.72:0/3330806030 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27eeffd640 1 --2- 172.21.15.72:0/3330806030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f0072470 0x7f27f015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27ef7fe640 1 -- 172.21.15.72:0/3330806030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f0072470 msgr2=0x7f27f015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27ef7fe640 1 --2- 172.21.15.72:0/3330806030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f0072470 0x7f27f015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27ef7fe640 1 -- 172.21.15.72:0/3330806030 >> v1:172.21.15.72:6789/0 conn(0x7f27f00b3960 legacy=0x7f27f015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27ef7fe640 1 -- 172.21.15.72:0/3330806030 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f0071fe0 con 0x7f27f00b3580 2024-03-24T10:37:20.767 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.765+0000 7f27ee7fc640 1 -- 172.21.15.72:0/3330806030 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589293646 0 0) 0x7f27f0154ea0 con 0x7f27f00b3960 2024-03-24T10:37:20.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.766+0000 7f27ef7fe640 1 --2- 172.21.15.72:0/3330806030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3580 0x7f27f00cf310 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f27e00097d0 tx=0x7f27e002b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea18b5024fdeed9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.766+0000 7f27ee7fc640 1 -- 172.21.15.72:0/3330806030 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0031770 con 0x7f27f00b3580 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.766+0000 7f27ee7fc640 1 -- 172.21.15.72:0/3330806030 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e00318d0 con 0x7f27f00b3580 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.766+0000 7f27ee7fc640 1 -- 172.21.15.72:0/3330806030 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0031c60 con 0x7f27f00b3580 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 -- 172.21.15.72:0/3330806030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3580 msgr2=0x7f27f00cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 --2- 172.21.15.72:0/3330806030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3580 0x7f27f00cf310 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f27e00097d0 tx=0x7f27e002b810 comp rx=0 tx=0).stop 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 -- 172.21.15.72:0/3330806030 shutdown_connections 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 --2- 172.21.15.72:0/3330806030 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f0072470 0x7f27f015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 --2- 172.21.15.72:0/3330806030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3580 0x7f27f00cf310 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 -- 172.21.15.72:0/3330806030 >> 172.21.15.72:0/3330806030 conn(0x7f27f00b1810 msgr2=0x7f27f00b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 -- 172.21.15.72:0/3330806030 shutdown_connections 2024-03-24T10:37:20.773 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.767+0000 7f27f613e640 1 -- 172.21.15.72:0/3330806030 wait complete. 2024-03-24T10:37:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.768+0000 7f27f613e640 1 Processor -- start 2024-03-24T10:37:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.768+0000 7f27f613e640 1 -- start start 2024-03-24T10:37:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27f613e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f0072470 0x7f27f014efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27f613e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f00b3580 0x7f27f01f5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27f613e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 0x7f27f014d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.774 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27f613e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0155a90 con 0x7f27f00b3960 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27f613e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27f0150240 con 0x7f27f0072470 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27f613e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f27f014f5b0 con 0x7f27f00b3580 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 0x7f27f014d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 0x7f27f014d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41032/0 (socket says 172.21.15.72:41032) 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 -- 172.21.15.72:0/1418578144 learned_addr learned my addr 172.21.15.72:0/1418578144 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27ef7fe640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f0072470 0x7f27f014efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27eeffd640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f00b3580 0x7f27f01f5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 -- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f00b3580 msgr2=0x7f27f01f5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f00b3580 0x7f27f01f5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 -- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f0072470 msgr2=0x7f27f014efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f0072470 0x7f27f014efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.775 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 -- 172.21.15.72:0/1418578144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e0009400 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.769+0000 7f27effff640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 0x7f27f014d070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c7a0 tx=0x7f27e800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.770+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e800a640 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.770+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e800a7a0 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.770+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e800abd0 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.770+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f014f890 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.770+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f014fe50 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.771+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f004f470 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.771+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f27e800ad30 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.771+0000 7f27d7fff640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f27dc06b810 0x7f27dc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.771+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f27e8089d80 con 0x7f27f00b3960 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.771+0000 7f27ef7fe640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f27dc06b810 0x7f27dc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:20.776 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.772+0000 7f27ef7fe640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f27dc06b810 0x7f27dc06dcd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f27e0036000 tx=0x7f27e003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:20.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.776+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f27e8054450 con 0x7f27f00b3960 2024-03-24T10:37:20.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.945+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f27f0150380 con 0x7f27f00b3960 2024-03-24T10:37:20.945 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.945+0000 7f27d7fff640 1 -- 172.21.15.72:0/1418578144 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f27e80180a0 con 0x7f27f00b3960 2024-03-24T10:37:20.945 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f27dc06b810 msgr2=0x7f27dc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f27dc06b810 0x7f27dc06dcd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f27e0036000 tx=0x7f27e003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 msgr2=0x7f27f014d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 0x7f27f014d070 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c7a0 tx=0x7f27e800cc60 comp rx=0 tx=0).stop 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 shutdown_connections 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f27dc06b810 0x7f27dc06dcd0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f27f00b3960 0x7f27f014d070 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f27f00b3580 0x7f27f01f5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.947 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 --2- 172.21.15.72:0/1418578144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27f0072470 0x7f27f014efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:20.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 >> 172.21.15.72:0/1418578144 conn(0x7f27f00b1810 msgr2=0x7f27f015bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:20.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 shutdown_connections 2024-03-24T10:37:20.948 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:20.947+0000 7f27f613e640 1 -- 172.21.15.72:0/1418578144 wait complete. 2024-03-24T10:37:20.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:21.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.062+0000 7efbfda64640 1 Processor -- start 2024-03-24T10:37:21.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.062+0000 7efbfda64640 1 -- start start 2024-03-24T10:37:21.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbfda64640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efbf80b3580 0x7efbf80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbfda64640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf8154ea0 con 0x7efbf815b480 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbfda64640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbf8071460 con 0x7efbf8072470 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbfda64640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7efbf8071fe0 con 0x7efbf80b3580 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf77fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efbf80b3580 0x7efbf80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf7fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7efbf815b480 0x7efbf806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:49136/0 (socket says 172.21.15.72:49136) 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf7fff640 1 -- 172.21.15.72:0/177237207 learned_addr learned my addr 172.21.15.72:0/177237207 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf77fe640 1 -- 172.21.15.72:0/177237207 >> v1:172.21.15.79:6789/0 conn(0x7efbf8072470 legacy=0x7efbf80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf67fc640 1 -- 172.21.15.72:0/177237207 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818370249 0 0) 0x7efbf8071460 con 0x7efbf8072470 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf77fe640 1 -- 172.21.15.72:0/177237207 >> v1:172.21.15.72:6789/0 conn(0x7efbf815b480 legacy=0x7efbf806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.063+0000 7efbf77fe640 1 -- 172.21.15.72:0/177237207 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbf815b910 con 0x7efbf80b3580 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.064+0000 7efbf77fe640 1 --2- 172.21.15.72:0/177237207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf80b3580 0x7efbf80cf310 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097a0 tx=0x7efbe802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdae4f1f8719af server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.065 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.064+0000 7efbf67fc640 1 -- 172.21.15.72:0/177237207 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8030710 con 0x7efbf80b3580 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.064+0000 7efbf67fc640 1 -- 172.21.15.72:0/177237207 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbe802e050 con 0x7efbf80b3580 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.064+0000 7efbf67fc640 1 -- 172.21.15.72:0/177237207 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8030a90 con 0x7efbf80b3580 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.064+0000 7efbfda64640 1 -- 172.21.15.72:0/177237207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf80b3580 msgr2=0x7efbf80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.064+0000 7efbfda64640 1 --2- 172.21.15.72:0/177237207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf80b3580 0x7efbf80cf310 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097a0 tx=0x7efbe802b710 comp rx=0 tx=0).stop 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.065+0000 7efbfda64640 1 -- 172.21.15.72:0/177237207 shutdown_connections 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.065+0000 7efbfda64640 1 --2- 172.21.15.72:0/177237207 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf80b3580 0x7efbf80cf310 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.065+0000 7efbfda64640 1 -- 172.21.15.72:0/177237207 >> 172.21.15.72:0/177237207 conn(0x7efbf80b1810 msgr2=0x7efbf80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.065+0000 7efbfda64640 1 -- 172.21.15.72:0/177237207 shutdown_connections 2024-03-24T10:37:21.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.065+0000 7efbfda64640 1 -- 172.21.15.72:0/177237207 wait complete. 2024-03-24T10:37:21.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.066+0000 7efbfda64640 1 Processor -- start 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.066+0000 7efbfda64640 1 -- start start 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbf8072470 0x7efbf8149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbf80b3580 0x7efbf80c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 0x7efbf80b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7efbf8149b80 con 0x7efbf815b480 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efbf80cb250 con 0x7efbf8072470 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7efbf80c9de0 con 0x7efbf80b3580 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 0x7efbf80b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 0x7efbf80b1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41052/0 (socket says 172.21.15.72:41052) 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 -- 172.21.15.72:0/739012644 learned_addr learned my addr 172.21.15.72:0/739012644 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:21.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf77fe640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbf8072470 0x7efbf8149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf6ffd640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbf80b3580 0x7efbf80c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 -- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbf80b3580 msgr2=0x7efbf80c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbf80b3580 0x7efbf80c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 -- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbf8072470 msgr2=0x7efbf8149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbf8072470 0x7efbf8149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 -- 172.21.15.72:0/739012644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbe8009400 con 0x7efbf815b480 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbf7fff640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 0x7efbf80b1bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efbf000cb20 tx=0x7efbf00020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf000a700 con 0x7efbf815b480 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf000a860 con 0x7efbf815b480 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbf80cb6e0 con 0x7efbf815b480 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf000abf0 con 0x7efbf815b480 2024-03-24T10:37:21.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.067+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbf80ca920 con 0x7efbf815b480 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.068+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbf8067a20 con 0x7efbf815b480 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.069+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7efbf000ad50 con 0x7efbf815b480 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.069+0000 7efbdffff640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe406b810 0x7efbe406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.069+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efbf0089f20 con 0x7efbf815b480 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.069+0000 7efbf77fe640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe406b810 0x7efbe406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.069+0000 7efbf77fe640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe406b810 0x7efbe406dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efbe8034000 tx=0x7efbe8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.072 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.073+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7efbf00545f0 con 0x7efbf815b480 2024-03-24T10:37:21.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.245+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efbf804f470 con 0x7efbf815b480 2024-03-24T10:37:21.245 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.246+0000 7efbdffff640 1 -- 172.21.15.72:0/739012644 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7efbf0018020 con 0x7efbf815b480 2024-03-24T10:37:21.245 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe406b810 msgr2=0x7efbe406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe406b810 0x7efbe406dcd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efbe8034000 tx=0x7efbe8008030 comp rx=0 tx=0).stop 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 msgr2=0x7efbf80b1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 0x7efbf80b1bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efbf000cb20 tx=0x7efbf00020a0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 shutdown_connections 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7efbe406b810 0x7efbe406dcd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efbf815b480 0x7efbf80b1bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7efbf80b3580 0x7efbf80c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 --2- 172.21.15.72:0/739012644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efbf8072470 0x7efbf8149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 >> 172.21.15.72:0/739012644 conn(0x7efbf80b1810 msgr2=0x7efbf815acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:21.248 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 shutdown_connections 2024-03-24T10:37:21.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.248+0000 7efbfda64640 1 -- 172.21.15.72:0/739012644 wait complete. 2024-03-24T10:37:21.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:21.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 Processor -- start 2024-03-24T10:37:21.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 -- start start 2024-03-24T10:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1c806e8d0 0x7fe1c80b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe1c806ecb0 0x7fe1c815f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1c815f980 con 0x7fe1c80b4190 2024-03-24T10:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c80b30f0 con 0x7fe1c806e8d0 2024-03-24T10:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.367+0000 7fe1ce52e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe1c80b33d0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1c806e8d0 0x7fe1c80b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1c806e8d0 0x7fe1c80b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41068/0 (socket says 172.21.15.72:41068) 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 -- 172.21.15.72:0/3313628550 learned_addr learned my addr 172.21.15.72:0/3313628550 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c77fe640 1 --2- 172.21.15.72:0/3313628550 >> v2:172.21.15.79:3300/0 conn(0x7fe1c806ecb0 0x7fe1c815f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 -- 172.21.15.72:0/3313628550 >> v2:172.21.15.79:3300/0 conn(0x7fe1c806ecb0 msgr2=0x7fe1c815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 --2- 172.21.15.72:0/3313628550 >> v2:172.21.15.79:3300/0 conn(0x7fe1c806ecb0 0x7fe1c815f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 -- 172.21.15.72:0/3313628550 >> v1:172.21.15.79:6789/0 conn(0x7fe1c80b4190 legacy=0x7fe1c8144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c6ffd640 1 -- 172.21.15.72:0/3313628550 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235988572 0 0) 0x7fe1c0001490 con 0x7fe1c80b4190 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.368+0000 7fe1c7fff640 1 -- 172.21.15.72:0/3313628550 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1c80b36b0 con 0x7fe1c806e8d0 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1c7fff640 1 --2- 172.21.15.72:0/3313628550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80b2b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800bb10 tx=0x7fe1b802e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffcdb0f233582d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1c6ffd640 1 -- 172.21.15.72:0/3313628550 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8036440 con 0x7fe1c806e8d0 2024-03-24T10:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1c6ffd640 1 -- 172.21.15.72:0/3313628550 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1b80365a0 con 0x7fe1c806e8d0 2024-03-24T10:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1c6ffd640 1 -- 172.21.15.72:0/3313628550 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8036930 con 0x7fe1c806e8d0 2024-03-24T10:37:21.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3313628550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806e8d0 msgr2=0x7fe1c80b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3313628550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80b2b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe1b800bb10 tx=0x7fe1b802e170 comp rx=0 tx=0).stop 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3313628550 shutdown_connections 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3313628550 >> v2:172.21.15.79:3300/0 conn(0x7fe1c806ecb0 0x7fe1c815f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3313628550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80b2b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3313628550 >> 172.21.15.72:0/3313628550 conn(0x7fe1c80b1810 msgr2=0x7fe1c80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3313628550 shutdown_connections 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.369+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3313628550 wait complete. 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.370+0000 7fe1ce52e640 1 Processor -- start 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 -- start start 2024-03-24T10:37:21.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 0x7fe1c80c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1c80b4190 0x7fe1c8142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c80cafe0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1c80cb2c0 con 0x7fe1c806e8d0 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1ce52e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe1c80cb5a0 con 0x7fe1c80b4190 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.371+0000 7fe1c77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 0x7fe1c80c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 0x7fe1c80c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41080/0 (socket says 172.21.15.72:41080) 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 -- 172.21.15.72:0/3915573373 learned_addr learned my addr 172.21.15.72:0/3915573373 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c7fff640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1ccacb640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1c80b4190 0x7fe1c8142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 -- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1c80b4190 msgr2=0x7fe1c8142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1c80b4190 0x7fe1c8142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 -- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c806e8d0 msgr2=0x7fe1c80ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 -- 172.21.15.72:0/3915573373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1b800b770 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c7fff640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c77fe640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 0x7fe1c80c9150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e9b0 tx=0x7fe1bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc009670 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc00c9a0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc00cd50 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1c80cb880 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.372+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1c81426b0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.373+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c804f470 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.374+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe1bc013470 con 0x7fe1c806ecb0 2024-03-24T10:37:21.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.374+0000 7fe1c4ff9640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1b406b810 0x7fe1b406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.374+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe1bc08aba0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.374+0000 7fe1c7fff640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1b406b810 0x7fe1b406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.374+0000 7fe1c7fff640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1b406b810 0x7fe1b406dcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8038000 tx=0x7fe1b8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.377 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.378+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe1bc0551e0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.551 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.552+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe1c80cba10 con 0x7fe1c806ecb0 2024-03-24T10:37:21.552 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.552+0000 7fe1c4ff9640 1 -- 172.21.15.72:0/3915573373 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe1bc0210a0 con 0x7fe1c806ecb0 2024-03-24T10:37:21.552 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:21.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1b406b810 msgr2=0x7fe1b406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1b406b810 0x7fe1b406dcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe1b8038000 tx=0x7fe1b8032000 comp rx=0 tx=0).stop 2024-03-24T10:37:21.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 msgr2=0x7fe1c80c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 0x7fe1c80c9150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00e9b0 tx=0x7fe1bc00ee70 comp rx=0 tx=0).stop 2024-03-24T10:37:21.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 shutdown_connections 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe1b406b810 0x7fe1b406dcd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe1c80b4190 0x7fe1c8142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1c806ecb0 0x7fe1c80c9150 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 --2- 172.21.15.72:0/3915573373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1c806e8d0 0x7fe1c80ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 >> 172.21.15.72:0/3915573373 conn(0x7fe1c80b1810 msgr2=0x7fe1c8143460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 shutdown_connections 2024-03-24T10:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.554+0000 7fe1ce52e640 1 -- 172.21.15.72:0/3915573373 wait complete. 2024-03-24T10:37:21.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:37:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 Processor -- start 2024-03-24T10:37:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 -- start start 2024-03-24T10:37:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda9c0d2600 0x7fda9c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c0d3be0 con 0x7fda9c06bcb0 2024-03-24T10:37:21.673 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fda9c06d030 con 0x7fda9c0d2600 2024-03-24T10:37:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.670+0000 7fdaa0834640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda9c06c130 con 0x7fda9c161910 2024-03-24T10:37:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9a59c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9ad9d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fda9c0d2600 0x7fda9c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda93fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fda9c06bcb0 0x7fda9c0d1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:36806/0 (socket says 172.21.15.72:36806) 2024-03-24T10:37:21.674 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda93fff640 1 -- 172.21.15.72:0/566065902 learned_addr learned my addr 172.21.15.72:0/566065902 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda99d9b640 1 -- 172.21.15.72:0/566065902 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955980921 0 0) 0x7fda9c0d3be0 con 0x7fda9c06bcb0 2024-03-24T10:37:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda99d9b640 1 -- 172.21.15.72:0/566065902 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda88003520 con 0x7fda9c06bcb0 2024-03-24T10:37:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9a59c640 1 -- 172.21.15.72:0/566065902 >> v2:172.21.15.79:3300/0 conn(0x7fda9c0d2600 msgr2=0x7fda9c0cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:21.675 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9a59c640 1 --2- 172.21.15.72:0/566065902 >> v2:172.21.15.79:3300/0 conn(0x7fda9c0d2600 0x7fda9c0cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9a59c640 1 -- 172.21.15.72:0/566065902 >> v1:172.21.15.79:6789/0 conn(0x7fda9c06bcb0 legacy=0x7fda9c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9a59c640 1 -- 172.21.15.72:0/566065902 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c06c3b0 con 0x7fda9c161910 2024-03-24T10:37:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.671+0000 7fda9ad9d640 1 --2- 172.21.15.72:0/566065902 >> v2:172.21.15.79:3300/0 conn(0x7fda9c0d2600 0x7fda9c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:21.676 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fda9a59c640 1 --2- 172.21.15.72:0/566065902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0d34c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0097a0 tx=0x7fda8c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b443217075a0655 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fda99d9b640 1 -- 172.21.15.72:0/566065902 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c02e070 con 0x7fda9c161910 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fda99d9b640 1 -- 172.21.15.72:0/566065902 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda8c0315a0 con 0x7fda9c161910 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fda99d9b640 1 -- 172.21.15.72:0/566065902 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda8c031910 con 0x7fda9c161910 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 -- 172.21.15.72:0/566065902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 msgr2=0x7fda9c0d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 --2- 172.21.15.72:0/566065902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0d34c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0097a0 tx=0x7fda8c02b840 comp rx=0 tx=0).stop 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 -- 172.21.15.72:0/566065902 shutdown_connections 2024-03-24T10:37:21.677 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 --2- 172.21.15.72:0/566065902 >> v2:172.21.15.79:3300/0 conn(0x7fda9c0d2600 0x7fda9c0cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 --2- 172.21.15.72:0/566065902 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0d34c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 -- 172.21.15.72:0/566065902 >> 172.21.15.72:0/566065902 conn(0x7fda9c0d3ff0 msgr2=0x7fda9c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 -- 172.21.15.72:0/566065902 shutdown_connections 2024-03-24T10:37:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.672+0000 7fdaa0834640 1 -- 172.21.15.72:0/566065902 wait complete. 2024-03-24T10:37:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 Processor -- start 2024-03-24T10:37:21.678 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 -- start start 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9c06bcb0 0x7fda9c0b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c0d2600 0x7fda9c15c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c0b2030 con 0x7fda9c0d2600 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fda9c15c9e0 con 0x7fda9c06bcb0 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.674+0000 7fdaa0834640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fda9c0c8e40 con 0x7fda9c161910 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda93fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c0d2600 0x7fda9c15c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9a59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9c06bcb0 0x7fda9c0b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda93fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c0d2600 0x7fda9c15c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48454/0 (socket says 172.21.15.72:48454) 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda93fff640 1 -- 172.21.15.72:0/3764799669 learned_addr learned my addr 172.21.15.72:0/3764799669 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 -- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9c06bcb0 msgr2=0x7fda9c0b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9c06bcb0 0x7fda9c0b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 -- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c0d2600 msgr2=0x7fda9c15c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c0d2600 0x7fda9c15c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 -- 172.21.15.72:0/3764799669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda94009a70 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda9ad9d640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0ccd40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda9400ef90 tx=0x7fda9400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9400ccd0 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda9400f040 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c009400 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda94003bd0 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.675+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda9c0b1790 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.676+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c073d50 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.677+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fda94014480 con 0x7fda9c161910 2024-03-24T10:37:21.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.677+0000 7fda92ffd640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda7c06b810 0x7fda7c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.677+0000 7fda9a59c640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda7c06b810 0x7fda7c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.677+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fda9408af10 con 0x7fda9c161910 2024-03-24T10:37:21.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.678+0000 7fda9a59c640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda7c06b810 0x7fda7c06dcd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fda8c036000 tx=0x7fda8c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:21.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.686+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fda94055670 con 0x7fda9c161910 2024-03-24T10:37:21.867 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.868+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fda9c15cba0 con 0x7fda9c161910 2024-03-24T10:37:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.868+0000 7fda92ffd640 1 -- 172.21.15.72:0/3764799669 <== mon.2 v2:172.21.15.79:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fda94058d30 con 0x7fda9c161910 2024-03-24T10:37:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda7c06b810 msgr2=0x7fda7c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda7c06b810 0x7fda7c06dcd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fda8c036000 tx=0x7fda8c03d040 comp rx=0 tx=0).stop 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 msgr2=0x7fda9c0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0ccd40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fda9400ef90 tx=0x7fda9400c490 comp rx=0 tx=0).stop 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 shutdown_connections 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fda7c06b810 0x7fda7c06dcd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fda9c161910 0x7fda9c0ccd40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c0d2600 0x7fda9c15c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 --2- 172.21.15.72:0/3764799669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fda9c06bcb0 0x7fda9c0b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 >> 172.21.15.72:0/3764799669 conn(0x7fda9c0d3ff0 msgr2=0x7fda9c15f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 shutdown_connections 2024-03-24T10:37:21.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:21.870+0000 7fdaa0834640 1 -- 172.21.15.72:0/3764799669 wait complete. 2024-03-24T10:37:21.881 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-24T10:37:21.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:21.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-24T10:37:21.910 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T10:37:21.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:21.910 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-24T10:37:21.965 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:21.966 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:21.981 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:21.981 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:22.036 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T10:37:22.036 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:22.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:22.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.192+0000 7f211d7a2640 1 Processor -- start 2024-03-24T10:37:22.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.192+0000 7f211d7a2640 1 -- start start 2024-03-24T10:37:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211d7a2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f2118159a60 0x7f21180ae820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211d7a2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21180cd8e0 0x7f211806d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211d7a2640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21180aed60 con 0x7f211806dd50 2024-03-24T10:37:22.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211d7a2640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f211806e1e0 con 0x7f2118159a60 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211d7a2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f211806c9b0 con 0x7f21180cd8e0 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211cfa1640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f211806dd50 0x7f2118071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33050/0 (socket says 172.21.15.72:33050) 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f211cfa1640 1 -- 172.21.15.72:0/1082304203 learned_addr learned my addr 172.21.15.72:0/1082304203 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f21177fe640 1 --2- 172.21.15.72:0/1082304203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21180cd8e0 0x7f211806d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f2117fff640 1 --2- 172.21.15.72:0/1082304203 >> v2:172.21.15.79:3300/0 conn(0x7f2118159a60 0x7f21180ae820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f2116ffd640 1 -- 172.21.15.72:0/1082304203 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720375367 0 0) 0x7f2110001490 con 0x7f211806dd50 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f2116ffd640 1 -- 172.21.15.72:0/1082304203 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2100003520 con 0x7f211806dd50 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f21177fe640 1 -- 172.21.15.72:0/1082304203 >> v2:172.21.15.79:3300/0 conn(0x7f2118159a60 msgr2=0x7f21180ae820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f21177fe640 1 --2- 172.21.15.72:0/1082304203 >> v2:172.21.15.79:3300/0 conn(0x7f2118159a60 0x7f21180ae820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f21177fe640 1 -- 172.21.15.72:0/1082304203 >> v1:172.21.15.72:6789/0 conn(0x7f211806dd50 legacy=0x7f2118071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f21177fe640 1 -- 172.21.15.72:0/1082304203 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211815d2e0 con 0x7f21180cd8e0 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.193+0000 7f2117fff640 1 --2- 172.21.15.72:0/1082304203 >> v2:172.21.15.79:3300/0 conn(0x7f2118159a60 0x7f21180ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:22.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.194+0000 7f21177fe640 1 --2- 172.21.15.72:0/1082304203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21180cd8e0 0x7f211806d810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f210c0097a0 tx=0x7f210c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eda6aec4fdaa139 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.201 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.194+0000 7f2116ffd640 1 -- 172.21.15.72:0/1082304203 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c031830 con 0x7f21180cd8e0 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.194+0000 7f2116ffd640 1 -- 172.21.15.72:0/1082304203 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210c031990 con 0x7f21180cd8e0 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.194+0000 7f2116ffd640 1 -- 172.21.15.72:0/1082304203 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c031d00 con 0x7f21180cd8e0 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 -- 172.21.15.72:0/1082304203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21180cd8e0 msgr2=0x7f211806d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 --2- 172.21.15.72:0/1082304203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21180cd8e0 0x7f211806d810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f210c0097a0 tx=0x7f210c02b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 -- 172.21.15.72:0/1082304203 shutdown_connections 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 --2- 172.21.15.72:0/1082304203 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f21180cd8e0 0x7f211806d810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.202 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 --2- 172.21.15.72:0/1082304203 >> v2:172.21.15.79:3300/0 conn(0x7f2118159a60 0x7f21180ae820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 -- 172.21.15.72:0/1082304203 >> 172.21.15.72:0/1082304203 conn(0x7f21180b1550 msgr2=0x7f21180b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 -- 172.21.15.72:0/1082304203 shutdown_connections 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.195+0000 7f211d7a2640 1 -- 172.21.15.72:0/1082304203 wait complete. 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.196+0000 7f211d7a2640 1 Processor -- start 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.196+0000 7f211d7a2640 1 -- start start 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211d7a2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 0x7f211815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211d7a2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21180cd8e0 0x7f2118151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211d7a2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2118159a60 0x7f211815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211d7a2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f2118156fa0 con 0x7f211806dd50 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211d7a2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2118157280 con 0x7f21180cd8e0 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211d7a2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f2118157560 con 0x7f2118159a60 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 0x7f211815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 0x7f211815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48462/0 (socket says 172.21.15.72:48462) 2024-03-24T10:37:22.203 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 -- 172.21.15.72:0/3241933678 learned_addr learned my addr 172.21.15.72:0/3241933678 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f21177fe640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21180cd8e0 0x7f2118151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f211cfa1640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2118159a60 0x7f211815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 -- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2118159a60 msgr2=0x7f211815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2118159a60 0x7f211815e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 -- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21180cd8e0 msgr2=0x7f2118151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21180cd8e0 0x7f2118151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 -- 172.21.15.72:0/3241933678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2108009400 con 0x7f211806dd50 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.197+0000 7f2117fff640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 0x7f211815bd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f210800e960 tx=0x7f210800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.198+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210800ca00 con 0x7f211806dd50 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.198+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f210800cb60 con 0x7f211806dd50 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.198+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c009400 con 0x7f211806dd50 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.198+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108013470 con 0x7f211806dd50 2024-03-24T10:37:22.204 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.198+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2118157b20 con 0x7f211806dd50 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.199+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2118159e40 con 0x7f211806dd50 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.199+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f21080135d0 con 0x7f211806dd50 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.199+0000 7f2114ff9640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f210406b810 0x7f210406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.199+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f210808a720 con 0x7f211806dd50 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.199+0000 7f21177fe640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f210406b810 0x7f210406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.200+0000 7f21177fe640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f210406b810 0x7f210406dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f210c036000 tx=0x7f210c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.204+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f2108054e80 con 0x7f211806dd50 2024-03-24T10:37:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.379+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f211804f470 con 0x7f211806dd50 2024-03-24T10:37:22.379 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.380+0000 7f2114ff9640 1 -- 172.21.15.72:0/3241933678 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f2108058540 con 0x7f211806dd50 2024-03-24T10:37:22.379 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:22.379 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f210406b810 msgr2=0x7f210406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f210406b810 0x7f210406dcd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f210c036000 tx=0x7f210c03c040 comp rx=0 tx=0).stop 2024-03-24T10:37:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 msgr2=0x7f211815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.381 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 0x7f211815bd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f210800e960 tx=0x7f210800ee20 comp rx=0 tx=0).stop 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 shutdown_connections 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f210406b810 0x7f210406dcd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f2118159a60 0x7f211815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21180cd8e0 0x7f2118151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 --2- 172.21.15.72:0/3241933678 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f211806dd50 0x7f211815bd50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 >> 172.21.15.72:0/3241933678 conn(0x7f21180b1550 msgr2=0x7f21180afe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 shutdown_connections 2024-03-24T10:37:22.382 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.382+0000 7f211d7a2640 1 -- 172.21.15.72:0/3241933678 wait complete. 2024-03-24T10:37:22.393 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:22.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:22.499 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.497+0000 7f3e230f4640 1 Processor -- start 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.497+0000 7f3e230f4640 1 -- start start 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e230f4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1c15e240 0x7f3e1c0d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e230f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3e1c0cfa50 0x7f3e1c0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e230f4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e1c0d4950 con 0x7f3e1c0d0f70 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e230f4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c0d2270 con 0x7f3e1c15e240 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e230f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3e1c0cfe60 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e20e90640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1c15e240 0x7f3e1c0d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e20e90640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e1c15e240 0x7f3e1c0d2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48476/0 (socket says 172.21.15.72:48476) 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.498+0000 7f3e20e90640 1 -- 172.21.15.72:0/3954609244 learned_addr learned my addr 172.21.15.72:0/3954609244 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e21691640 1 --2- 172.21.15.72:0/3954609244 >> v2:172.21.15.79:3300/0 conn(0x7f3e1c0cfa50 0x7f3e1c0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e20e90640 1 -- 172.21.15.72:0/3954609244 >> v2:172.21.15.79:3300/0 conn(0x7f3e1c0cfa50 msgr2=0x7f3e1c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:22.500 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e20e90640 1 --2- 172.21.15.72:0/3954609244 >> v2:172.21.15.79:3300/0 conn(0x7f3e1c0cfa50 0x7f3e1c0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e20e90640 1 -- 172.21.15.72:0/3954609244 >> v1:172.21.15.79:6789/0 conn(0x7f3e1c0d0f70 legacy=0x7f3e1c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e20e90640 1 -- 172.21.15.72:0/3954609244 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1c0b38c0 con 0x7f3e1c15e240 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e20e90640 1 --2- 172.21.15.72:0/3954609244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c15e240 0x7f3e1c0d2410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ce410 tx=0x7f3e0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a2c997663826a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.499+0000 7f3e1b7fe640 1 -- 172.21.15.72:0/3954609244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c031870 con 0x7f3e1c15e240 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e1b7fe640 1 -- 172.21.15.72:0/3954609244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0319d0 con 0x7f3e1c15e240 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e1b7fe640 1 -- 172.21.15.72:0/3954609244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c031d60 con 0x7f3e1c15e240 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 -- 172.21.15.72:0/3954609244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c15e240 msgr2=0x7f3e1c0d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3954609244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c15e240 0x7f3e1c0d2410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0ce410 tx=0x7f3e0c02b910 comp rx=0 tx=0).stop 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 -- 172.21.15.72:0/3954609244 shutdown_connections 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3954609244 >> v2:172.21.15.79:3300/0 conn(0x7f3e1c0cfa50 0x7f3e1c0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3954609244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c15e240 0x7f3e1c0d2410 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 -- 172.21.15.72:0/3954609244 >> 172.21.15.72:0/3954609244 conn(0x7f3e1c0d3e30 msgr2=0x7f3e1c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 -- 172.21.15.72:0/3954609244 shutdown_connections 2024-03-24T10:37:22.501 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.500+0000 7f3e230f4640 1 -- 172.21.15.72:0/3954609244 wait complete. 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.501+0000 7f3e230f4640 1 Processor -- start 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.501+0000 7f3e230f4640 1 -- start start 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e230f4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 0x7f3e1c1f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e230f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e1c0d0f70 0x7f3e1c0b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e230f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e1c15e240 0x7f3e1c152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e230f4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c1f8010 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e230f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3e1c0b6f60 con 0x7f3e1c0d0f70 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e230f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f3e1c0b7240 con 0x7f3e1c15e240 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e20e90640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 0x7f3e1c1f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e20e90640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 0x7f3e1c1f7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48482/0 (socket says 172.21.15.72:48482) 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e20e90640 1 -- 172.21.15.72:0/3668694800 learned_addr learned my addr 172.21.15.72:0/3668694800 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:22.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e1bfff640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e1c0d0f70 0x7f3e1c0b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.502+0000 7f3e21691640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e1c15e240 0x7f3e1c152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e20e90640 1 -- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e1c15e240 msgr2=0x7f3e1c152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e20e90640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e1c15e240 0x7f3e1c152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e20e90640 1 -- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e1c0d0f70 msgr2=0x7f3e1c0b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e20e90640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e1c0d0f70 0x7f3e1c0b8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e20e90640 1 -- 172.21.15.72:0/3668694800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0094d0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e20e90640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 0x7f3e1c1f7ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c02b950 tx=0x7f3e0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c03ad30 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e0c0443f0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e1c0b7520 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c0447a0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.503+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e1c0b7ae0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.504+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c04f470 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.504+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3e0c04d450 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.505 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.505+0000 7f3e197fa640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3e0806b810 0x7f3e0806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.505+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f3e0c02d040 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.505+0000 7f3e1bfff640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3e0806b810 0x7f3e0806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.505+0000 7f3e1bfff640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3e0806b810 0x7f3e0806dcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0c77f0 tx=0x7f3e10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.509+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3e0c0770f0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.682 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.682+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3e1c0b9cc0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.682+0000 7f3e197fa640 1 -- 172.21.15.72:0/3668694800 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f3e0c0350a0 con 0x7f3e1c0cfa50 2024-03-24T10:37:22.683 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3e0806b810 msgr2=0x7f3e0806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3e0806b810 0x7f3e0806dcd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0c77f0 tx=0x7f3e10009040 comp rx=0 tx=0).stop 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 msgr2=0x7f3e1c1f7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 0x7f3e1c1f7ad0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c02b950 tx=0x7f3e0c0046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 shutdown_connections 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3e0806b810 0x7f3e0806dcd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3e1c15e240 0x7f3e1c152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3e1c0d0f70 0x7f3e1c0b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 --2- 172.21.15.72:0/3668694800 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e1c0cfa50 0x7f3e1c1f7ad0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 >> 172.21.15.72:0/3668694800 conn(0x7f3e1c0d3e30 msgr2=0x7f3e1c06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:22.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 shutdown_connections 2024-03-24T10:37:22.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.684+0000 7f3e230f4640 1 -- 172.21.15.72:0/3668694800 wait complete. 2024-03-24T10:37:22.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:22.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 Processor -- start 2024-03-24T10:37:22.799 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 -- start start 2024-03-24T10:37:22.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c161c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f678c162170 0x7f678c15e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c1625a0 con 0x7f678c0ceb40 2024-03-24T10:37:22.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f678c06c3e0 con 0x7f678c162170 2024-03-24T10:37:22.801 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f67928eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f678c06c6c0 con 0x7f678c06d1a0 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f678bfff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f678c0ceb40 0x7f678c0d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33062/0 (socket says 172.21.15.72:33062) 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.799+0000 7f678bfff640 1 -- 172.21.15.72:0/2232208705 learned_addr learned my addr 172.21.15.72:0/2232208705 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f6790e88640 1 --2- 172.21.15.72:0/2232208705 >> v2:172.21.15.79:3300/0 conn(0x7f678c162170 0x7f678c15e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f678b7fe640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f678affd640 1 -- 172.21.15.72:0/2232208705 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593712741 0 0) 0x7f678c1625a0 con 0x7f678c0ceb40 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f678affd640 1 -- 172.21.15.72:0/2232208705 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6774003520 con 0x7f678c0ceb40 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f6790e88640 1 -- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 msgr2=0x7f678c161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f6790e88640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c161c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f6790e88640 1 -- 172.21.15.72:0/2232208705 >> v1:172.21.15.72:6789/0 conn(0x7f678c0ceb40 legacy=0x7f678c0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f6790e88640 1 -- 172.21.15.72:0/2232208705 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c06c9a0 con 0x7f678c162170 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.800+0000 7f678b7fe640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f6790e88640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c15e8d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6784009d90 tx=0x7f678402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f2331212251d0c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f678affd640 1 -- 172.21.15.72:0/2232208705 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678402cbc0 con 0x7f678c162170 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f678affd640 1 -- 172.21.15.72:0/2232208705 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678402cd20 con 0x7f678c162170 2024-03-24T10:37:22.802 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f678affd640 1 -- 172.21.15.72:0/2232208705 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784034660 con 0x7f678c162170 2024-03-24T10:37:22.805 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 -- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 msgr2=0x7f678c15e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c15e8d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6784009d90 tx=0x7f678402be10 comp rx=0 tx=0).stop 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 -- 172.21.15.72:0/2232208705 shutdown_connections 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c15e8d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 --2- 172.21.15.72:0/2232208705 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 -- 172.21.15.72:0/2232208705 >> 172.21.15.72:0/2232208705 conn(0x7f678c0d1c50 msgr2=0x7f678c0d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 -- 172.21.15.72:0/2232208705 shutdown_connections 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.801+0000 7f67928eb640 1 -- 172.21.15.72:0/2232208705 wait complete. 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 Processor -- start 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 -- start start 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c09bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 0x7f678c09ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.806 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c0c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f678c09faa0 con 0x7f678c0ceb40 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f678c09ea00 con 0x7f678c162170 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.803+0000 7f67928eb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f678c09ece0 con 0x7f678c06d1a0 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 0x7f678c09ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 0x7f678c09ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48492/0 (socket says 172.21.15.72:48492) 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 -- 172.21.15.72:0/508679249 learned_addr learned my addr 172.21.15.72:0/508679249 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f6790e88640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c0c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678bfff640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c09bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 -- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 msgr2=0x7f678c09bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c09bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 -- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 msgr2=0x7f678c0c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c0c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 -- 172.21.15.72:0/508679249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6780009400 con 0x7f678c0ceb40 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f678b7fe640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 0x7f678c09ca00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f678000ebe0 tx=0x7f678000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780009760 con 0x7f678c0ceb40 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678000cc30 con 0x7f678c0ceb40 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6784009a70 con 0x7f678c0ceb40 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678000eee0 con 0x7f678c0ceb40 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.804+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f678c09f2a0 con 0x7f678c0ceb40 2024-03-24T10:37:22.808 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.805+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f678c068430 con 0x7f678c0ceb40 2024-03-24T10:37:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.806+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6780013470 con 0x7f678c0ceb40 2024-03-24T10:37:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.806+0000 7f6788ff9640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f677806b810 0x7f677806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.806+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f678008a7b0 con 0x7f678c0ceb40 2024-03-24T10:37:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.806+0000 7f678bfff640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f677806b810 0x7f677806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:22.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.806+0000 7f678bfff640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f677806b810 0x7f677806dcd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f677c005880 tx=0x7f677c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:22.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.810+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6780054f10 con 0x7f678c0ceb40 2024-03-24T10:37:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.980+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f678c04f470 con 0x7f678c0ceb40 2024-03-24T10:37:22.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.981+0000 7f6788ff9640 1 -- 172.21.15.72:0/508679249 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f67800585d0 con 0x7f678c0ceb40 2024-03-24T10:37:22.981 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f677806b810 msgr2=0x7f677806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f677806b810 0x7f677806dcd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f677c005880 tx=0x7f677c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 msgr2=0x7f678c09ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 0x7f678c09ca00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f678000ebe0 tx=0x7f678000c520 comp rx=0 tx=0).stop 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 shutdown_connections 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f677806b810 0x7f677806dcd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f678c162170 0x7f678c0c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.984 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f678c0ceb40 0x7f678c09ca00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 --2- 172.21.15.72:0/508679249 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f678c06d1a0 0x7f678c09bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 >> 172.21.15.72:0/508679249 conn(0x7f678c0d1c50 msgr2=0x7f678c0b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 shutdown_connections 2024-03-24T10:37:22.985 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:22.983+0000 7f67928eb640 1 -- 172.21.15.72:0/508679249 wait complete. 2024-03-24T10:37:22.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.096+0000 7fbf906fb640 1 Processor -- start 2024-03-24T10:37:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.096+0000 7fbf906fb640 1 -- start start 2024-03-24T10:37:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.097+0000 7fbf906fb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf8806e8d0 0x7fbf880b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.097+0000 7fbf906fb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbf8815f440 0x7fbf88144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.097+0000 7fbf906fb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf880b30f0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.097+0000 7fbf906fb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbf880b48a0 con 0x7fbf8806e8d0 2024-03-24T10:37:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.097+0000 7fbf906fb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbf880b33d0 con 0x7fbf8815f440 2024-03-24T10:37:23.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf8806e8d0 0x7fbf880b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf8806e8d0 0x7fbf880b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48494/0 (socket says 172.21.15.72:48494) 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 -- 172.21.15.72:0/3859855912 learned_addr learned my addr 172.21.15.72:0/3859855912 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8ec98640 1 --2- 172.21.15.72:0/3859855912 >> v2:172.21.15.79:3300/0 conn(0x7fbf8815f440 0x7fbf88144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 -- 172.21.15.72:0/3859855912 >> v2:172.21.15.79:3300/0 conn(0x7fbf8815f440 msgr2=0x7fbf88144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 --2- 172.21.15.72:0/3859855912 >> v2:172.21.15.79:3300/0 conn(0x7fbf8815f440 0x7fbf88144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 -- 172.21.15.72:0/3859855912 >> v1:172.21.15.79:6789/0 conn(0x7fbf8806ecb0 legacy=0x7fbf880b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8e497640 1 -- 172.21.15.72:0/3859855912 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf880b36b0 con 0x7fbf8806e8d0 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.098+0000 7fbf8ec98640 1 --2- 172.21.15.72:0/3859855912 >> v2:172.21.15.79:3300/0 conn(0x7fbf8815f440 0x7fbf88144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf8e497640 1 --2- 172.21.15.72:0/3859855912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806e8d0 0x7fbf880b2b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400bb10 tx=0x7fbf8402e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747d4f364bc388fd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf8d495640 1 -- 172.21.15.72:0/3859855912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84036440 con 0x7fbf8806e8d0 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf8d495640 1 -- 172.21.15.72:0/3859855912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf840365a0 con 0x7fbf8806e8d0 2024-03-24T10:37:23.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf8d495640 1 -- 172.21.15.72:0/3859855912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf84036930 con 0x7fbf8806e8d0 2024-03-24T10:37:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 -- 172.21.15.72:0/3859855912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806e8d0 msgr2=0x7fbf880b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 --2- 172.21.15.72:0/3859855912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806e8d0 0x7fbf880b2b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400bb10 tx=0x7fbf8402e170 comp rx=0 tx=0).stop 2024-03-24T10:37:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 -- 172.21.15.72:0/3859855912 shutdown_connections 2024-03-24T10:37:23.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 --2- 172.21.15.72:0/3859855912 >> v2:172.21.15.79:3300/0 conn(0x7fbf8815f440 0x7fbf88144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 --2- 172.21.15.72:0/3859855912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806e8d0 0x7fbf880b2b10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 -- 172.21.15.72:0/3859855912 >> 172.21.15.72:0/3859855912 conn(0x7fbf880b1810 msgr2=0x7fbf880b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 -- 172.21.15.72:0/3859855912 shutdown_connections 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.099+0000 7fbf906fb640 1 -- 172.21.15.72:0/3859855912 wait complete. 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.100+0000 7fbf906fb640 1 Processor -- start 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.100+0000 7fbf906fb640 1 -- start start 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf906fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf8806e8d0 0x7fbf8815a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf906fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 0x7fbf881f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf906fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf8815f440 0x7fbf880ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf906fb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbf88133410 con 0x7fbf8806ecb0 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf906fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf881f0e10 con 0x7fbf8815f440 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf906fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbf88132800 con 0x7fbf8806e8d0 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf8dc96640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 0x7fbf881f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.105 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf8dc96640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 0x7fbf881f08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48498/0 (socket says 172.21.15.72:48498) 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf8dc96640 1 -- 172.21.15.72:0/1554620467 learned_addr learned my addr 172.21.15.72:0/1554620467 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf8ec98640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf8815f440 0x7fbf880ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.101+0000 7fbf8e497640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf8806e8d0 0x7fbf8815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf8dc96640 1 -- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf8806e8d0 msgr2=0x7fbf8815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf8dc96640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf8806e8d0 0x7fbf8815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf8dc96640 1 -- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf8815f440 msgr2=0x7fbf880ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf8dc96640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf8815f440 0x7fbf880ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf8dc96640 1 -- 172.21.15.72:0/1554620467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf80009a70 con 0x7fbf8806ecb0 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf8dc96640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 0x7fbf881f08d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c450 tx=0x7fbf7800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf780052d0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf78005430 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf8400b770 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf78003830 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.102+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf88132dc0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.103+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf881f34b0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.103+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbf78003990 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.104+0000 7fbf7effd640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf6c06b810 0x7fbf6c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.104+0000 7fbf8e497640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf6c06b810 0x7fbf6c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.104+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbf780899f0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.104+0000 7fbf8e497640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf6c06b810 0x7fbf6c06dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf84038000 tx=0x7fbf84032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.108+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbf881f34b0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.281+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbf881f34b0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.282 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.281+0000 7fbf7effd640 1 -- 172.21.15.72:0/1554620467 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fbf881f34b0 con 0x7fbf8806ecb0 2024-03-24T10:37:23.282 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf6c06b810 msgr2=0x7fbf6c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf6c06b810 0x7fbf6c06dcd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf84038000 tx=0x7fbf84032000 comp rx=0 tx=0).stop 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 msgr2=0x7fbf881f08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 0x7fbf881f08d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800c450 tx=0x7fbf7800c850 comp rx=0 tx=0).stop 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 shutdown_connections 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf6c06b810 0x7fbf6c06dcd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf8815f440 0x7fbf880ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf8806ecb0 0x7fbf881f08d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 --2- 172.21.15.72:0/1554620467 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf8806e8d0 0x7fbf8815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.284 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 >> 172.21.15.72:0/1554620467 conn(0x7fbf880b1810 msgr2=0x7fbf88143590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 shutdown_connections 2024-03-24T10:37:23.285 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.283+0000 7fbf906fb640 1 -- 172.21.15.72:0/1554620467 wait complete. 2024-03-24T10:37:23.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:23.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.398+0000 7fa911cc9640 1 Processor -- start 2024-03-24T10:37:23.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.398+0000 7fa911cc9640 1 -- start start 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa911cc9640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa90c0b3580 0x7fa90c0cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa911cc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c072470 0x7fa90c15b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa911cc9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 0x7fa90c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa911cc9640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c15b9c0 con 0x7fa90c0b3960 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa911cc9640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c154ea0 con 0x7fa90c0b3580 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa911cc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c071460 con 0x7fa90c072470 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 0x7fa90c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 0x7fa90c15dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48502/0 (socket says 172.21.15.72:48502) 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90b7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fa90c0b3580 0x7fa90c0cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90bfff640 1 -- 172.21.15.72:0/3667955362 learned_addr learned my addr 172.21.15.72:0/3667955362 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90affd640 1 --2- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c072470 0x7fa90c15b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.401 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90b7fe640 1 -- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c072470 msgr2=0x7fa90c15b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90b7fe640 1 --2- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c072470 0x7fa90c15b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90b7fe640 1 -- 172.21.15.72:0/3667955362 >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 msgr2=0x7fa90c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90b7fe640 1 --2- 172.21.15.72:0/3667955362 >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 0x7fa90c15dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90b7fe640 1 -- 172.21.15.72:0/3667955362 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c071fe0 con 0x7fa90c0b3580 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.399+0000 7fa90bfff640 1 --2- 172.21.15.72:0/3667955362 >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 0x7fa90c15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.400+0000 7fa90b7fe640 1 --2- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3580 0x7fa90c0cf310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0b2890 tx=0x7fa8fc02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efab20f7d95a37aa server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.400+0000 7fa90a7fc640 1 -- 172.21.15.72:0/3667955362 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc02f050 con 0x7fa90c0b3580 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.400+0000 7fa90a7fc640 1 -- 172.21.15.72:0/3667955362 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc031700 con 0x7fa90c0b3580 2024-03-24T10:37:23.402 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.400+0000 7fa90a7fc640 1 -- 172.21.15.72:0/3667955362 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc031a90 con 0x7fa90c0b3580 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 -- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3580 msgr2=0x7fa90c0cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 --2- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3580 0x7fa90c0cf310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0b2890 tx=0x7fa8fc02b7a0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 -- 172.21.15.72:0/3667955362 shutdown_connections 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 --2- 172.21.15.72:0/3667955362 >> v2:172.21.15.72:3300/0 conn(0x7fa90c0b3960 0x7fa90c15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 --2- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c072470 0x7fa90c15b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 --2- 172.21.15.72:0/3667955362 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3580 0x7fa90c0cf310 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 -- 172.21.15.72:0/3667955362 >> 172.21.15.72:0/3667955362 conn(0x7fa90c0b1810 msgr2=0x7fa90c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 -- 172.21.15.72:0/3667955362 shutdown_connections 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.401+0000 7fa911cc9640 1 -- 172.21.15.72:0/3667955362 wait complete. 2024-03-24T10:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.402+0000 7fa911cc9640 1 Processor -- start 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.402+0000 7fa911cc9640 1 -- start start 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa911cc9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 0x7fa90c135d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa911cc9640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c0b3580 0x7fa90c14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa911cc9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3960 0x7fa90c06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa911cc9640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c1f4e30 con 0x7fa90c072470 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa911cc9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0ccd50 con 0x7fa90c0b3960 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa911cc9640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c0cd030 con 0x7fa90c0b3580 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 0x7fa90c135d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 0x7fa90c135d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48512/0 (socket says 172.21.15.72:48512) 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 -- 172.21.15.72:0/651661410 learned_addr learned my addr 172.21.15.72:0/651661410 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90bfff640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3960 0x7fa90c06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90affd640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c0b3580 0x7fa90c14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 -- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c0b3580 msgr2=0x7fa90c14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c0b3580 0x7fa90c14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 -- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3960 msgr2=0x7fa90c06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3960 0x7fa90c06d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.403+0000 7fa90b7fe640 1 -- 172.21.15.72:0/651661410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa904009b30 con 0x7fa90c072470 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.404+0000 7fa90b7fe640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 0x7fa90c135d30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000c00 tx=0x7fa8fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.404+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc006e10 con 0x7fa90c072470 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.404+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8fc009400 con 0x7fa90c072470 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.404+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc033a30 con 0x7fa90c072470 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.404+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc033dc0 con 0x7fa90c072470 2024-03-24T10:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.404+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c0cd5f0 con 0x7fa90c072470 2024-03-24T10:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.405+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90c04f470 con 0x7fa90c072470 2024-03-24T10:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.405+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fa8fc03a040 con 0x7fa90c072470 2024-03-24T10:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.405+0000 7fa8f3fff640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa8f806b810 0x7fa8f806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.406+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa8fc0ac150 con 0x7fa90c072470 2024-03-24T10:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.406+0000 7fa90affd640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa8f806b810 0x7fa8f806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.406+0000 7fa90affd640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa8f806b810 0x7fa8f806dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0b10c0 tx=0x7fa900009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.411+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fa8fc076740 con 0x7fa90c072470 2024-03-24T10:37:23.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.580+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa90c0710e0 con 0x7fa90c072470 2024-03-24T10:37:23.581 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.581+0000 7fa8f3fff640 1 -- 172.21.15.72:0/651661410 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fa8fc079e00 con 0x7fa90c072470 2024-03-24T10:37:23.581 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa8f806b810 msgr2=0x7fa8f806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.583 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa8f806b810 0x7fa8f806dcd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa90c0b10c0 tx=0x7fa900009190 comp rx=0 tx=0).stop 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 msgr2=0x7fa90c135d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 0x7fa90c135d30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc000c00 tx=0x7fa8fc0046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 shutdown_connections 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fa8f806b810 0x7fa8f806dcd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa90c0b3960 0x7fa90c06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fa90c0b3580 0x7fa90c14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 --2- 172.21.15.72:0/651661410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa90c072470 0x7fa90c135d30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 >> 172.21.15.72:0/651661410 conn(0x7fa90c0b1810 msgr2=0x7fa90c15bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 shutdown_connections 2024-03-24T10:37:23.584 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.583+0000 7fa911cc9640 1 -- 172.21.15.72:0/651661410 wait complete. 2024-03-24T10:37:23.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T10:37:23.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.695+0000 7f68ba0ae640 1 Processor -- start 2024-03-24T10:37:23.696 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.695+0000 7f68ba0ae640 1 -- start start 2024-03-24T10:37:23.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.695+0000 7f68ba0ae640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f68b415aee0 0x7f68b415f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.695+0000 7f68ba0ae640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b415f8a0 con 0x7f68b406eb40 2024-03-24T10:37:23.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.695+0000 7f68ba0ae640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b40b2e90 con 0x7f68b40b3f30 2024-03-24T10:37:23.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.695+0000 7f68ba0ae640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f68b40b3170 con 0x7f68b415aee0 2024-03-24T10:37:23.697 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b3fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f68b406eb40 0x7f68b40cd1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33072/0 (socket says 172.21.15.72:33072) 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b3fff640 1 -- 172.21.15.72:0/358731425 learned_addr learned my addr 172.21.15.72:0/358731425 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b37fe640 1 --2- 172.21.15.72:0/358731425 >> v2:172.21.15.79:3300/0 conn(0x7f68b415aee0 0x7f68b415f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318766648 0 0) 0x7f68b415f8a0 con 0x7f68b406eb40 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a0003520 con 0x7f68b406eb40 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3972862517 0 0) 0x7f68b40b2e90 con 0x7f68b40b3f30 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68b415f8a0 con 0x7f68b40b3f30 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b37fe640 1 -- 172.21.15.72:0/358731425 >> v1:172.21.15.79:6789/0 conn(0x7f68b40b3f30 legacy=0x7f68b406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b37fe640 1 -- 172.21.15.72:0/358731425 >> v1:172.21.15.72:6789/0 conn(0x7f68b406eb40 legacy=0x7f68b40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.696+0000 7f68b37fe640 1 -- 172.21.15.72:0/358731425 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b40b3450 con 0x7f68b415aee0 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68b37fe640 1 --2- 172.21.15.72:0/358731425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b415aee0 0x7f68b415f360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009d90 tx=0x7f68a402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=469518e232d62653 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a402cd00 con 0x7f68b415aee0 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a402ce60 con 0x7f68b415aee0 2024-03-24T10:37:23.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68b27fc640 1 -- 172.21.15.72:0/358731425 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a4034660 con 0x7f68b415aee0 2024-03-24T10:37:23.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68ba0ae640 1 -- 172.21.15.72:0/358731425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b415aee0 msgr2=0x7f68b415f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.702 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/358731425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b415aee0 0x7f68b415f360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f68a4009d90 tx=0x7f68a402bf50 comp rx=0 tx=0).stop 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68ba0ae640 1 -- 172.21.15.72:0/358731425 shutdown_connections 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/358731425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b415aee0 0x7f68b415f360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.697+0000 7f68ba0ae640 1 -- 172.21.15.72:0/358731425 >> 172.21.15.72:0/358731425 conn(0x7f68b40b1810 msgr2=0x7f68b40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.698+0000 7f68ba0ae640 1 -- 172.21.15.72:0/358731425 shutdown_connections 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.698+0000 7f68ba0ae640 1 -- 172.21.15.72:0/358731425 wait complete. 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 Processor -- start 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 -- start start 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68b406eb40 0x7f68b4143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b40b3f30 0x7f68b40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 0x7f68b40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f68b4144a40 con 0x7f68b415aee0 2024-03-24T10:37:23.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68b40ae200 con 0x7f68b40b3f30 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.699+0000 7f68ba0ae640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f68b40ae4e0 con 0x7f68b406eb40 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 0x7f68b40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 0x7f68b40ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48520/0 (socket says 172.21.15.72:48520) 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 -- 172.21.15.72:0/2985289792 learned_addr learned my addr 172.21.15.72:0/2985289792 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b37fe640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68b406eb40 0x7f68b4143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b2ffd640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b40b3f30 0x7f68b40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 -- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68b406eb40 msgr2=0x7f68b4143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68b406eb40 0x7f68b4143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 -- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b40b3f30 msgr2=0x7f68b40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b40b3f30 0x7f68b40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 -- 172.21.15.72:0/2985289792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a4009a70 con 0x7f68b415aee0 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b2ffd640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b40b3f30 0x7f68b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68b3fff640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 0x7f68b40ce2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c3c0 tx=0x7f68ac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac005ce0 con 0x7f68b415aee0 2024-03-24T10:37:23.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ac005e60 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b40ae7c0 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ac007310 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.700+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b4144260 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.701+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b4144b80 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.702+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f68ac007470 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.702+0000 7f68abfff640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f689406b810 0x7f689406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.702+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f68ac089a50 con 0x7f68b415aee0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.702+0000 7f68b37fe640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f689406b810 0x7f689406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:23.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.702+0000 7f68b37fe640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f689406b810 0x7f689406dcd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68a4036000 tx=0x7f68a4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:23.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.706+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f68ac0541b0 con 0x7f68b415aee0 2024-03-24T10:37:23.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.891+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f68b4073d50 con 0x7f68b415aee0 2024-03-24T10:37:23.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.891+0000 7f68abfff640 1 -- 172.21.15.72:0/2985289792 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f68ac057870 con 0x7f68b415aee0 2024-03-24T10:37:23.892 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f689406b810 msgr2=0x7f689406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f689406b810 0x7f689406dcd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f68a4036000 tx=0x7f68a4030000 comp rx=0 tx=0).stop 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 msgr2=0x7f68b40ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 0x7f68b40ce2f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f68ac00c3c0 tx=0x7f68ac00c880 comp rx=0 tx=0).stop 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 shutdown_connections 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f689406b810 0x7f689406dcd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68b415aee0 0x7f68b40ce2f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68b40b3f30 0x7f68b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 --2- 172.21.15.72:0/2985289792 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68b406eb40 0x7f68b4143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:23.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 >> 172.21.15.72:0/2985289792 conn(0x7f68b40b1810 msgr2=0x7f68b40b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:23.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 shutdown_connections 2024-03-24T10:37:23.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:23.893+0000 7f68ba0ae640 1 -- 172.21.15.72:0/2985289792 wait complete. 2024-03-24T10:37:23.905 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-24T10:37:23.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:23.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-24T10:37:23.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T10:37:23.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:23.934 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-24T10:37:23.990 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-24T10:37:23.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:37:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.089+0000 7f6817d56640 1 Processor -- start 2024-03-24T10:37:24.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.090+0000 7f6817d56640 1 -- start start 2024-03-24T10:37:24.091 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.090+0000 7f6817d56640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68100cee90 0x7f68100cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.090+0000 7f6817d56640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f681015f930 0x7f681015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.090+0000 7f6817d56640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6810071630 con 0x7f681006e500 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.090+0000 7f6817d56640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f6810160940 con 0x7f681015f930 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.090+0000 7f6817d56640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f68100cf850 con 0x7f68100cee90 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f68162f3640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f681015f930 0x7f681015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f6815af2640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f681006e500 0x7f6810071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33084/0 (socket says 172.21.15.72:33084) 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f6815af2640 1 -- 172.21.15.72:0/3664773272 learned_addr learned my addr 172.21.15.72:0/3664773272 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:24.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f68152f1640 1 --2- 172.21.15.72:0/3664773272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68100cee90 0x7f68100cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f68162f3640 1 -- 172.21.15.72:0/3664773272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68100cee90 msgr2=0x7f68100cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f68162f3640 1 --2- 172.21.15.72:0/3664773272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68100cee90 0x7f68100cf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f68162f3640 1 -- 172.21.15.72:0/3664773272 >> v1:172.21.15.72:6789/0 conn(0x7f681006e500 legacy=0x7f6810071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f6814af0640 1 -- 172.21.15.72:0/3664773272 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345605814 0 0) 0x7f6810071630 con 0x7f681006e500 2024-03-24T10:37:24.093 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.091+0000 7f68162f3640 1 -- 172.21.15.72:0/3664773272 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681015c220 con 0x7f681015f930 2024-03-24T10:37:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f68162f3640 1 --2- 172.21.15.72:0/3664773272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f681015fdc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6808009d90 tx=0x7f680802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76b3b8e247911afa server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6814af0640 1 -- 172.21.15.72:0/3664773272 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680802cc50 con 0x7f681015f930 2024-03-24T10:37:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6814af0640 1 -- 172.21.15.72:0/3664773272 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680802cdb0 con 0x7f681015f930 2024-03-24T10:37:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6814af0640 1 -- 172.21.15.72:0/3664773272 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808034660 con 0x7f681015f930 2024-03-24T10:37:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 -- 172.21.15.72:0/3664773272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 msgr2=0x7f681015fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 --2- 172.21.15.72:0/3664773272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f681015fdc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6808009d90 tx=0x7f680802bea0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 -- 172.21.15.72:0/3664773272 shutdown_connections 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 --2- 172.21.15.72:0/3664773272 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f681015fdc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 --2- 172.21.15.72:0/3664773272 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f68100cee90 0x7f68100cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 -- 172.21.15.72:0/3664773272 >> 172.21.15.72:0/3664773272 conn(0x7f68100b1920 msgr2=0x7f68100b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 -- 172.21.15.72:0/3664773272 shutdown_connections 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.092+0000 7f6817d56640 1 -- 172.21.15.72:0/3664773272 wait complete. 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.093+0000 7f6817d56640 1 Processor -- start 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.093+0000 7f6817d56640 1 -- start start 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6817d56640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f681006e500 0x7f681009d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6817d56640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68100cee90 0x7f6810151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6817d56640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f6810151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6817d56640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f681009c660 con 0x7f681015f930 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6817d56640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f68101523a0 con 0x7f68100cee90 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6817d56640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f681009c8e0 con 0x7f681006e500 2024-03-24T10:37:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f68162f3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f6810151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f68162f3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f6810151570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48534/0 (socket says 172.21.15.72:48534) 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f68162f3640 1 -- 172.21.15.72:0/1541871025 learned_addr learned my addr 172.21.15.72:0/1541871025 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f6815af2640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f681006e500 0x7f681009d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.094+0000 7f68152f1640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68100cee90 0x7f6810151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68162f3640 1 -- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f681006e500 msgr2=0x7f681009d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68162f3640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f681006e500 0x7f681009d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68162f3640 1 -- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68100cee90 msgr2=0x7f6810151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68162f3640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68100cee90 0x7f6810151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68162f3640 1 -- 172.21.15.72:0/1541871025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6808009a70 con 0x7f681015f930 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68162f3640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f6810151570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6808009d90 tx=0x7f6808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680803e610 con 0x7f681015f930 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f680803e770 con 0x7f681015f930 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f681009cbc0 con 0x7f681015f930 2024-03-24T10:37:24.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680803eb60 con 0x7f681015f930 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.095+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6810151ab0 con 0x7f681015f930 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.096+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f681009d0e0 con 0x7f681015f930 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.096+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f680803b050 con 0x7f681015f930 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.097+0000 7f68067fc640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f67f406b810 0x7f67f406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.097+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f68080ace20 con 0x7f681015f930 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.097+0000 7f6815af2640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f67f406b810 0x7f67f406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.097+0000 7f6815af2640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f67f406b810 0x7f67f406dcd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6800000f60 tx=0x7f6800007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.101+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f681009d0e0 con 0x7f681015f930 2024-03-24T10:37:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.308+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f681009d0e0 con 0x7f681015f930 2024-03-24T10:37:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.308+0000 7f68067fc640 1 -- 172.21.15.72:0/1541871025 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f681009d0e0 con 0x7f681015f930 2024-03-24T10:37:24.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:24.309 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:37:24.309 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f67f406b810 msgr2=0x7f67f406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f67f406b810 0x7f67f406dcd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6800000f60 tx=0x7f6800007d50 comp rx=0 tx=0).stop 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 msgr2=0x7f6810151570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f6810151570 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6808009d90 tx=0x7f6808004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 shutdown_connections 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f67f406b810 0x7f67f406dcd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f681015f930 0x7f6810151570 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68100cee90 0x7f6810151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 --2- 172.21.15.72:0/1541871025 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f681006e500 0x7f681009d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 >> 172.21.15.72:0/1541871025 conn(0x7f68100b1920 msgr2=0x7f681015a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:24.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 shutdown_connections 2024-03-24T10:37:24.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.310+0000 7f6817d56640 1 -- 172.21.15.72:0/1541871025 wait complete. 2024-03-24T10:37:24.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 Processor -- start 2024-03-24T10:37:24.424 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 -- start start 2024-03-24T10:37:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700b45c0 0x7f83700cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 0x7f83701600a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83700cc8f0 con 0x7f837015f4a0 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f83700d0d30 con 0x7f83700b45c0 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.424+0000 7f8375c6f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f83701605e0 con 0x7f837015fc50 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 0x7f83701600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700b45c0 0x7f83700cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836ffff640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 0x7f83701600a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:48774/0 (socket says 172.21.15.72:48774) 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836effd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f83700b45c0 0x7f83700cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47206/0 (socket says 172.21.15.72:47206) 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836ffff640 1 -- 172.21.15.72:0/3894559263 learned_addr learned my addr 172.21.15.72:0/3894559263 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836f7fe640 1 --1- 172.21.15.72:0/3894559263 >> v1:172.21.15.79:6789/0 conn(0x7f837015f4a0 0x7f83700d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:36846/0 (socket says 172.21.15.72:36846) 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836effd640 1 -- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 msgr2=0x7f83701600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836effd640 1 --2- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 0x7f83701600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836effd640 1 -- 172.21.15.72:0/3894559263 >> v1:172.21.15.79:6789/0 conn(0x7f837015f4a0 legacy=0x7f83700d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836effd640 1 -- 172.21.15.72:0/3894559263 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83700d0ad0 con 0x7f83700b45c0 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836e7fc640 1 -- 172.21.15.72:0/3894559263 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131223112 0 0) 0x7f83700cc8f0 con 0x7f837015f4a0 2024-03-24T10:37:24.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.425+0000 7f836ffff640 1 --2- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 0x7f83701600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.426+0000 7f836effd640 1 --2- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700cd8c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83600097a0 tx=0x7f836002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfc166d56589cc19 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.426+0000 7f836e7fc640 1 -- 172.21.15.72:0/3894559263 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360031830 con 0x7f83700b45c0 2024-03-24T10:37:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.426+0000 7f836e7fc640 1 -- 172.21.15.72:0/3894559263 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8360031990 con 0x7f83700b45c0 2024-03-24T10:37:24.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.426+0000 7f836e7fc640 1 -- 172.21.15.72:0/3894559263 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360031d20 con 0x7f83700b45c0 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.426+0000 7f8375c6f640 1 -- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 msgr2=0x7f83700cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.426+0000 7f8375c6f640 1 --2- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700cd8c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f83600097a0 tx=0x7f836002b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.427+0000 7f8375c6f640 1 -- 172.21.15.72:0/3894559263 shutdown_connections 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.427+0000 7f8375c6f640 1 --2- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015fc50 0x7f83701600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.427+0000 7f8375c6f640 1 --2- 172.21.15.72:0/3894559263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700cd8c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.427+0000 7f8375c6f640 1 -- 172.21.15.72:0/3894559263 >> 172.21.15.72:0/3894559263 conn(0x7f83700b3930 msgr2=0x7f83700b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.427+0000 7f8375c6f640 1 -- 172.21.15.72:0/3894559263 shutdown_connections 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.427+0000 7f8375c6f640 1 -- 172.21.15.72:0/3894559263 wait complete. 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.428+0000 7f8375c6f640 1 Processor -- start 2024-03-24T10:37:24.431 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.428+0000 7f8375c6f640 1 -- start start 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.428+0000 7f8375c6f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.428+0000 7f8375c6f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015f4a0 0x7f837015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.428+0000 7f8375c6f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 0x7f83700b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.428+0000 7f8375c6f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83700c70b0 con 0x7f837015fc50 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8375c6f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83700b3070 con 0x7f83700b45c0 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8375c6f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f83700c6780 con 0x7f837015f4a0 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 0x7f83700b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836effd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015f4a0 0x7f837015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 0x7f83700b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48542/0 (socket says 172.21.15.72:48542) 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836ffff640 1 -- 172.21.15.72:0/1368121015 learned_addr learned my addr 172.21.15.72:0/1368121015 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 -- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015f4a0 msgr2=0x7f837015a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015f4a0 0x7f837015a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 -- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 msgr2=0x7f83700b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.432 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 0x7f83700b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 -- 172.21.15.72:0/1368121015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8368009b30 con 0x7f83700b45c0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836ffff640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 0x7f83700b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f836f7fe640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700c8eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f836400c450 tx=0x7f836400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83640074e0 con 0x7f83700b45c0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8364007640 con 0x7f83700b45c0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8360009400 con 0x7f83700b45c0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8364004a20 con 0x7f83700b45c0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.429+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83700c6d40 con 0x7f83700b45c0 2024-03-24T10:37:24.433 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.430+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f837009ff20 con 0x7f83700b45c0 2024-03-24T10:37:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.431+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8364004b80 con 0x7f83700b45c0 2024-03-24T10:37:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.431+0000 7f8357fff640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f835c06b810 0x7f835c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.431+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f836408a3b0 con 0x7f83700b45c0 2024-03-24T10:37:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.431+0000 7f836effd640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f835c06b810 0x7f835c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.431+0000 7f836effd640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f835c06b810 0x7f835c06dcd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8360036000 tx=0x7f836003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.436 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.436+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f83640548a0 con 0x7f83700b45c0 2024-03-24T10:37:24.607 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.607+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f837004f550 con 0x7f83700b45c0 2024-03-24T10:37:24.609 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.608+0000 7f8357fff640 1 -- 172.21.15.72:0/1368121015 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f8364057f60 con 0x7f83700b45c0 2024-03-24T10:37:24.609 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:24.609 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f835c06b810 msgr2=0x7f835c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f835c06b810 0x7f835c06dcd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8360036000 tx=0x7f836003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 msgr2=0x7f83700c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700c8eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f836400c450 tx=0x7f836400c850 comp rx=0 tx=0).stop 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 shutdown_connections 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f835c06b810 0x7f835c06dcd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f837015fc50 0x7f83700b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f837015f4a0 0x7f837015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 --2- 172.21.15.72:0/1368121015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83700b45c0 0x7f83700c8eb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 >> 172.21.15.72:0/1368121015 conn(0x7f83700b3930 msgr2=0x7f8370070610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:24.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 shutdown_connections 2024-03-24T10:37:24.612 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.610+0000 7f8375c6f640 1 -- 172.21.15.72:0/1368121015 wait complete. 2024-03-24T10:37:24.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:36:24.153769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:36:24.519534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-24T10:36:28.246563+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-24T10:37:24.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.725+0000 7fbe5a4da640 1 Processor -- start 2024-03-24T10:37:24.726 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.725+0000 7fbe5a4da640 1 -- start start 2024-03-24T10:37:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe5a4da640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbe54142490 0x7fbe540b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe5a4da640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe540b2b10 0x7fbe540cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe5a4da640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe540b2f50 con 0x7fbe540ce1b0 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe5a4da640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbe540b3210 con 0x7fbe54142490 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe5a4da640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbe540b34f0 con 0x7fbe540b2b10 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe58a77640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbe540ce1b0 0x7fbe540ce620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33092/0 (socket says 172.21.15.72:33092) 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.726+0000 7fbe58a77640 1 -- 172.21.15.72:0/280030253 learned_addr learned my addr 172.21.15.72:0/280030253 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe53fff640 1 --2- 172.21.15.72:0/280030253 >> v2:172.21.15.79:3300/0 conn(0x7fbe54142490 0x7fbe540b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe537fe640 1 --2- 172.21.15.72:0/280030253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe540b2b10 0x7fbe540cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe52ffd640 1 -- 172.21.15.72:0/280030253 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 777222945 0 0) 0x7fbe540b2f50 con 0x7fbe540ce1b0 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe52ffd640 1 -- 172.21.15.72:0/280030253 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3c003520 con 0x7fbe540ce1b0 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe537fe640 1 -- 172.21.15.72:0/280030253 >> v2:172.21.15.79:3300/0 conn(0x7fbe54142490 msgr2=0x7fbe540b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe537fe640 1 --2- 172.21.15.72:0/280030253 >> v2:172.21.15.79:3300/0 conn(0x7fbe54142490 0x7fbe540b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe537fe640 1 -- 172.21.15.72:0/280030253 >> v1:172.21.15.72:6789/0 conn(0x7fbe540ce1b0 legacy=0x7fbe540ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe537fe640 1 -- 172.21.15.72:0/280030253 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe540b37d0 con 0x7fbe540b2b10 2024-03-24T10:37:24.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.727+0000 7fbe53fff640 1 --2- 172.21.15.72:0/280030253 >> v2:172.21.15.79:3300/0 conn(0x7fbe54142490 0x7fbe540b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe537fe640 1 --2- 172.21.15.72:0/280030253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe540b2b10 0x7fbe540cf110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe480097a0 tx=0x7fbe4802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec0275177aa4a384 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe52ffd640 1 -- 172.21.15.72:0/280030253 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4802e070 con 0x7fbe540b2b10 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe52ffd640 1 -- 172.21.15.72:0/280030253 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480315a0 con 0x7fbe540b2b10 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe52ffd640 1 -- 172.21.15.72:0/280030253 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48031930 con 0x7fbe540b2b10 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 -- 172.21.15.72:0/280030253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe540b2b10 msgr2=0x7fbe540cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/280030253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe540b2b10 0x7fbe540cf110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe480097a0 tx=0x7fbe4802b840 comp rx=0 tx=0).stop 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 -- 172.21.15.72:0/280030253 shutdown_connections 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/280030253 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe540b2b10 0x7fbe540cf110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/280030253 >> v2:172.21.15.79:3300/0 conn(0x7fbe54142490 0x7fbe540b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 -- 172.21.15.72:0/280030253 >> 172.21.15.72:0/280030253 conn(0x7fbe540b1810 msgr2=0x7fbe540b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 -- 172.21.15.72:0/280030253 shutdown_connections 2024-03-24T10:37:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.728+0000 7fbe5a4da640 1 -- 172.21.15.72:0/280030253 wait complete. 2024-03-24T10:37:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.729+0000 7fbe5a4da640 1 Processor -- start 2024-03-24T10:37:24.731 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 -- start start 2024-03-24T10:37:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe540b2b10 0x7fbe5415a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 0x7fbe5415e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe54142490 0x7fbe5415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5413b3a0 con 0x7fbe540ce1b0 2024-03-24T10:37:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5415ebb0 con 0x7fbe540b2b10 2024-03-24T10:37:24.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe5a4da640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5415ee90 con 0x7fbe54142490 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe537fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 0x7fbe5415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.730+0000 7fbe537fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 0x7fbe5415e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48556/0 (socket says 172.21.15.72:48556) 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 -- 172.21.15.72:0/2070060771 learned_addr learned my addr 172.21.15.72:0/2070060771 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe58a77640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe54142490 0x7fbe5415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe53fff640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe540b2b10 0x7fbe5415a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 -- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe54142490 msgr2=0x7fbe5415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe54142490 0x7fbe5415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 -- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe540b2b10 msgr2=0x7fbe5415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe540b2b10 0x7fbe5415a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 -- 172.21.15.72:0/2070060771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe44009400 con 0x7fbe540ce1b0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe537fe640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 0x7fbe5415e040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbe48034040 tx=0x7fbe480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48032630 con 0x7fbe540ce1b0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe480327b0 con 0x7fbe540ce1b0 2024-03-24T10:37:24.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe48009400 con 0x7fbe540ce1b0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48032b60 con 0x7fbe540ce1b0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.731+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe54070f20 con 0x7fbe540ce1b0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.732+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5415f3b0 con 0x7fbe540ce1b0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.732+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbe48032cc0 con 0x7fbe540ce1b0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.733+0000 7fbe50ff9640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe4006b810 0x7fbe4006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.733+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fbe480ac310 con 0x7fbe540ce1b0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.733+0000 7fbe53fff640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe4006b810 0x7fbe4006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:24.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.733+0000 7fbe53fff640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe4006b810 0x7fbe4006dcd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe5413c980 tx=0x7fbe44009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:24.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.737+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbe48076a70 con 0x7fbe540ce1b0 2024-03-24T10:37:24.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.907+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbe5413b170 con 0x7fbe540ce1b0 2024-03-24T10:37:24.908 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.907+0000 7fbe50ff9640 1 -- 172.21.15.72:0/2070060771 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fbe4807a130 con 0x7fbe540ce1b0 2024-03-24T10:37:24.908 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:24.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe4006b810 msgr2=0x7fbe4006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.910 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe4006b810 0x7fbe4006dcd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbe5413c980 tx=0x7fbe44009190 comp rx=0 tx=0).stop 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 msgr2=0x7fbe5415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 0x7fbe5415e040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbe48034040 tx=0x7fbe480046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 shutdown_connections 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe4006b810 0x7fbe4006dcd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe54142490 0x7fbe5415e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe540ce1b0 0x7fbe5415e040 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 --2- 172.21.15.72:0/2070060771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe540b2b10 0x7fbe5415a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 >> 172.21.15.72:0/2070060771 conn(0x7fbe540b1810 msgr2=0x7fbe540b4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 shutdown_connections 2024-03-24T10:37:24.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:24.910+0000 7fbe5a4da640 1 -- 172.21.15.72:0/2070060771 wait complete. 2024-03-24T10:37:24.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T10:37:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.023+0000 7f14481d7640 1 Processor -- start 2024-03-24T10:37:25.024 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.023+0000 7f14481d7640 1 -- start start 2024-03-24T10:37:25.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f14481d7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 0x7f14400b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f14481d7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f144015f440 0x7f1440144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f14481d7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14400b30f0 con 0x7f144006ecb0 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f14481d7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f14400b48a0 con 0x7f144015f440 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f14481d7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f14400b33d0 con 0x7f144006e8d0 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f1445f73640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 0x7f14400b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f1446774640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f144015f440 0x7f1440144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f1445f73640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 0x7f14400b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:48816/0 (socket says 172.21.15.72:48816) 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.024+0000 7f1445f73640 1 -- 172.21.15.72:0/2309048503 learned_addr learned my addr 172.21.15.72:0/2309048503 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.025+0000 7f1446774640 1 -- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 msgr2=0x7f14400b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.025+0000 7f1446774640 1 --2- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 0x7f14400b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.025+0000 7f1446774640 1 -- 172.21.15.72:0/2309048503 >> v1:172.21.15.79:6789/0 conn(0x7f144006ecb0 legacy=0x7f14400b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.025+0000 7f1446774640 1 -- 172.21.15.72:0/2309048503 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14400b36b0 con 0x7f144015f440 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.025+0000 7f1445f73640 1 --2- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 0x7f14400b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:25.026 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.025+0000 7f1446774640 1 --2- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144015f440 0x7f1440144150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14380097a0 tx=0x7f143802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc0f65ecbdb2cde server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f1444f71640 1 -- 172.21.15.72:0/2309048503 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143802e070 con 0x7f144015f440 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f1444f71640 1 -- 172.21.15.72:0/2309048503 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14380315a0 con 0x7f144015f440 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f1444f71640 1 -- 172.21.15.72:0/2309048503 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438031930 con 0x7f144015f440 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 -- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144015f440 msgr2=0x7f1440144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 --2- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144015f440 0x7f1440144150 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f14380097a0 tx=0x7f143802b840 comp rx=0 tx=0).stop 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 -- 172.21.15.72:0/2309048503 shutdown_connections 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 --2- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144015f440 0x7f1440144150 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 --2- 172.21.15.72:0/2309048503 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006e8d0 0x7f14400b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 -- 172.21.15.72:0/2309048503 >> 172.21.15.72:0/2309048503 conn(0x7f14400b1810 msgr2=0x7f14400b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 -- 172.21.15.72:0/2309048503 shutdown_connections 2024-03-24T10:37:25.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.026+0000 7f14481d7640 1 -- 172.21.15.72:0/2309048503 wait complete. 2024-03-24T10:37:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.027+0000 7f14481d7640 1 Processor -- start 2024-03-24T10:37:25.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.027+0000 7f14481d7640 1 -- start start 2024-03-24T10:37:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f14481d7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 0x7f14401efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f14481d7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006ecb0 0x7f14400cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f14481d7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f144015f440 0x7f144013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f14481d7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f14401f0030 con 0x7f144015f440 2024-03-24T10:37:25.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f14481d7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f144015c530 con 0x7f144006e8d0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f14481d7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f144015c810 con 0x7f144006ecb0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 0x7f14401efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1446774640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f144015f440 0x7f144013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 0x7f14401efaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47270/0 (socket says 172.21.15.72:47270) 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 -- 172.21.15.72:0/3783040716 learned_addr learned my addr 172.21.15.72:0/3783040716 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445772640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006ecb0 0x7f14400cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 -- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006ecb0 msgr2=0x7f14400cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006ecb0 0x7f14400cdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 -- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f144015f440 msgr2=0x7f144013ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f144015f440 0x7f144013ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.028+0000 7f1445f73640 1 -- 172.21.15.72:0/3783040716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f143c00bd40 con 0x7f144006e8d0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.029+0000 7f1445f73640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 0x7f14401efaf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f143c00bfd0 tx=0x7f143c00e810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.029+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c010050 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.029+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143c011040 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.029+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c00b4e0 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.029+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1438009400 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.029+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144015d0b0 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.030+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1440073f60 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.030+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f143c003bb0 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.031+0000 7f14367fc640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f142406b810 0x7f142406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.031+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f143c08c950 con 0x7f144006e8d0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.031+0000 7f1445772640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f142406b810 0x7f142406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.031+0000 7f1445772640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f142406b810 0x7f142406dcd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14401f2fc0 tx=0x7f1430009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.035+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f143c057010 con 0x7f144006e8d0 2024-03-24T10:37:25.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.206+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f144004f470 con 0x7f144006e8d0 2024-03-24T10:37:25.207 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.207+0000 7f14367fc640 1 -- 172.21.15.72:0/3783040716 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f143c05a6d0 con 0x7f144006e8d0 2024-03-24T10:37:25.207 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:25.209 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f142406b810 msgr2=0x7f142406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f142406b810 0x7f142406dcd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14401f2fc0 tx=0x7f1430009040 comp rx=0 tx=0).stop 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 msgr2=0x7f14401efaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 0x7f14401efaf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f143c00bfd0 tx=0x7f143c00e810 comp rx=0 tx=0).stop 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 shutdown_connections 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f142406b810 0x7f142406dcd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f144015f440 0x7f144013ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f144006ecb0 0x7f14400cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 --2- 172.21.15.72:0/3783040716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f144006e8d0 0x7f14401efaf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 >> 172.21.15.72:0/3783040716 conn(0x7f14400b1810 msgr2=0x7f14400728b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 shutdown_connections 2024-03-24T10:37:25.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.209+0000 7f14481d7640 1 -- 172.21.15.72:0/3783040716 wait complete. 2024-03-24T10:37:25.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T10:37:25.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.323+0000 7fdc36956640 1 Processor -- start 2024-03-24T10:37:25.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.323+0000 7fdc36956640 1 -- start start 2024-03-24T10:37:25.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc36956640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc3015e240 0x7fdc300d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.325 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc36956640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc300d0f70 0x7fdc300d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc36956640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc300b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc36956640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fdc300d2270 con 0x7fdc3015e240 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc36956640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fdc300d4950 con 0x7fdc300d0f70 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc36956640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fdc300b38c0 con 0x7fdc300b3da0 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc2ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc3015e240 0x7fdc300d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc2ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdc3015e240 0x7fdc300d2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48566/0 (socket says 172.21.15.72:48566) 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc2f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fdc300d0f70 0x7fdc300d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc2ffff640 1 -- 172.21.15.72:0/3676174179 learned_addr learned my addr 172.21.15.72:0/3676174179 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.324+0000 7fdc34ef3640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc300b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc2ffff640 1 -- 172.21.15.72:0/3676174179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 msgr2=0x7fdc300b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc2ffff640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc300b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc2ffff640 1 -- 172.21.15.72:0/3676174179 >> v2:172.21.15.79:3300/0 conn(0x7fdc300d0f70 msgr2=0x7fdc300d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc2ffff640 1 --2- 172.21.15.72:0/3676174179 >> v2:172.21.15.79:3300/0 conn(0x7fdc300d0f70 0x7fdc300d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc2ffff640 1 -- 172.21.15.72:0/3676174179 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc300b3550 con 0x7fdc3015e240 2024-03-24T10:37:25.327 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc34ef3640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.325+0000 7fdc2ffff640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc300d2410 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdc300b69b0 tx=0x7fdc2002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af94b9d9dc27577 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc2effd640 1 -- 172.21.15.72:0/3676174179 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc200317e0 con 0x7fdc3015e240 2024-03-24T10:37:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc2effd640 1 -- 172.21.15.72:0/3676174179 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc20031940 con 0x7fdc3015e240 2024-03-24T10:37:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc2effd640 1 -- 172.21.15.72:0/3676174179 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20031cd0 con 0x7fdc3015e240 2024-03-24T10:37:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 -- 172.21.15.72:0/3676174179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 msgr2=0x7fdc300d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.328 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc300d2410 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdc300b69b0 tx=0x7fdc2002b880 comp rx=0 tx=0).stop 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 -- 172.21.15.72:0/3676174179 shutdown_connections 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc300b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 --2- 172.21.15.72:0/3676174179 >> v2:172.21.15.79:3300/0 conn(0x7fdc300d0f70 0x7fdc300d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 --2- 172.21.15.72:0/3676174179 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc300d2410 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 -- 172.21.15.72:0/3676174179 >> 172.21.15.72:0/3676174179 conn(0x7fdc300d3e30 msgr2=0x7fdc300d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 -- 172.21.15.72:0/3676174179 shutdown_connections 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.326+0000 7fdc36956640 1 -- 172.21.15.72:0/3676174179 wait complete. 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.327+0000 7fdc36956640 1 Processor -- start 2024-03-24T10:37:25.329 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 -- start start 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc301613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300d0f70 0x7fdc3015f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc301f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fdc301f77d0 con 0x7fdc3015e240 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdc301f7ab0 con 0x7fdc300d0f70 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc36956640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fdc300c7ae0 con 0x7fdc300b3da0 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc34ef3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc301f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc34ef3640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc301f6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48580/0 (socket says 172.21.15.72:48580) 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc34ef3640 1 -- 172.21.15.72:0/4034416548 learned_addr learned my addr 172.21.15.72:0/4034416548 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc2f7fe640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300d0f70 0x7fdc3015f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.328+0000 7fdc2ffff640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc301613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.332 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc34ef3640 1 -- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 msgr2=0x7fdc301613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc34ef3640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc301613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc34ef3640 1 -- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300d0f70 msgr2=0x7fdc3015f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc34ef3640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300d0f70 0x7fdc3015f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc34ef3640 1 -- 172.21.15.72:0/4034416548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc28009a70 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc34ef3640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc301f6d70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800eed0 tx=0x7fdc2800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28010040 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2800bd20 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc200094d0 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc28003bd0 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.329+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc300ccf10 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.330+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc300c8000 con 0x7fdc3015e240 2024-03-24T10:37:25.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.330+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fdc2801d410 con 0x7fdc3015e240 2024-03-24T10:37:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.331+0000 7fdc2cff9640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fdc1c06b810 0x7fdc1c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.331+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fdc2808acc0 con 0x7fdc3015e240 2024-03-24T10:37:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.331+0000 7fdc2ffff640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fdc1c06b810 0x7fdc1c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.331+0000 7fdc2ffff640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fdc1c06b810 0x7fdc1c06dcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc20036000 tx=0x7fdc2003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.335+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fdc300c8000 con 0x7fdc3015e240 2024-03-24T10:37:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.506+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fdc300c8000 con 0x7fdc3015e240 2024-03-24T10:37:25.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.507+0000 7fdc2cff9640 1 -- 172.21.15.72:0/4034416548 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fdc300c8000 con 0x7fdc3015e240 2024-03-24T10:37:25.507 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T10:37:25.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.508+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fdc1c06b810 msgr2=0x7fdc1c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fdc1c06b810 0x7fdc1c06dcd0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdc20036000 tx=0x7fdc2003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 msgr2=0x7fdc301f6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc301f6d70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800eed0 tx=0x7fdc2800b480 comp rx=0 tx=0).stop 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 shutdown_connections 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fdc1c06b810 0x7fdc1c06dcd0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdc3015e240 0x7fdc301f6d70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdc300d0f70 0x7fdc3015f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 --2- 172.21.15.72:0/4034416548 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fdc300b3da0 0x7fdc301613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 >> 172.21.15.72:0/4034416548 conn(0x7fdc300d3e30 msgr2=0x7fdc300d3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 shutdown_connections 2024-03-24T10:37:25.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.509+0000 7fdc36956640 1 -- 172.21.15.72:0/4034416548 wait complete. 2024-03-24T10:37:25.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-24T10:37:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.623+0000 7f0490a2e640 1 Processor -- start 2024-03-24T10:37:25.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.623+0000 7f0490a2e640 1 -- start start 2024-03-24T10:37:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0490a2e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f048c0d2b20 0x7f048c0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0490a2e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0490a2e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0d4950 con 0x7f048c15e240 2024-03-24T10:37:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0490a2e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f048c0d2270 con 0x7f048c0d2b20 2024-03-24T10:37:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0490a2e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f048c0b38c0 con 0x7f048c0d0f70 2024-03-24T10:37:25.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0489d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f048c0d2b20 0x7f048c0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f048a59c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f048c15e240 0x7f048c0d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33100/0 (socket says 172.21.15.72:33100) 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f048a59c640 1 -- 172.21.15.72:0/1623678970 learned_addr learned my addr 172.21.15.72:0/1623678970 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f0489d9b640 1 --2- 172.21.15.72:0/1623678970 >> v2:172.21.15.72:3300/0 conn(0x7f048c0d2b20 0x7f048c0cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48584/0 (socket says 172.21.15.72:48584) 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.624+0000 7f048ad9d640 1 --2- 172.21.15.72:0/1623678970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f0489d9b640 1 -- 172.21.15.72:0/1623678970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 msgr2=0x7f048c0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f0489d9b640 1 --2- 172.21.15.72:0/1623678970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f0489d9b640 1 -- 172.21.15.72:0/1623678970 >> v1:172.21.15.72:6789/0 conn(0x7f048c15e240 legacy=0x7f048c0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f0489d9b640 1 -- 172.21.15.72:0/1623678970 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c0b3550 con 0x7f048c0d2b20 2024-03-24T10:37:25.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f048959a640 1 -- 172.21.15.72:0/1623678970 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416991660 0 0) 0x7f048c0d4950 con 0x7f048c15e240 2024-03-24T10:37:25.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f0489d9b640 1 --2- 172.21.15.72:0/1623678970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c0d2b20 0x7f048c0cea40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f04800097a0 tx=0x7f048002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c1b3f60717b1d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f048959a640 1 -- 172.21.15.72:0/1623678970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048002e070 con 0x7f048c0d2b20 2024-03-24T10:37:25.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f048959a640 1 -- 172.21.15.72:0/1623678970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04800315a0 con 0x7f048c0d2b20 2024-03-24T10:37:25.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.625+0000 7f048959a640 1 -- 172.21.15.72:0/1623678970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480031930 con 0x7f048c0d2b20 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 -- 172.21.15.72:0/1623678970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c0d2b20 msgr2=0x7f048c0cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 --2- 172.21.15.72:0/1623678970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c0d2b20 0x7f048c0cea40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f04800097a0 tx=0x7f048002b840 comp rx=0 tx=0).stop 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 -- 172.21.15.72:0/1623678970 shutdown_connections 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 --2- 172.21.15.72:0/1623678970 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 --2- 172.21.15.72:0/1623678970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c0d2b20 0x7f048c0cea40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 -- 172.21.15.72:0/1623678970 >> 172.21.15.72:0/1623678970 conn(0x7f048c0d3e30 msgr2=0x7f048c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 -- 172.21.15.72:0/1623678970 shutdown_connections 2024-03-24T10:37:25.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.626+0000 7f0490a2e640 1 -- 172.21.15.72:0/1623678970 wait complete. 2024-03-24T10:37:25.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.627+0000 7f0490a2e640 1 Processor -- start 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.627+0000 7f0490a2e640 1 -- start start 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0490a2e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0490a2e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f048c0d2b20 0x7f048c15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0490a2e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 0x7f048c0cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0490a2e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f048c0c99a0 con 0x7f048c15e240 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0490a2e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f048c0c9070 con 0x7f048c0d2b20 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0490a2e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f048c0c9350 con 0x7f048c0d0f70 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 0x7f048c0cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 0x7f048c0cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48588/0 (socket says 172.21.15.72:48588) 2024-03-24T10:37:25.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 -- 172.21.15.72:0/4201532752 learned_addr learned my addr 172.21.15.72:0/4201532752 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:25.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048a59c640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0489d9b640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f048c0d2b20 0x7f048c15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 -- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 msgr2=0x7f048c156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 -- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f048c0d2b20 msgr2=0x7f048c15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f048c0d2b20 0x7f048c15a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f048ad9d640 1 -- 172.21.15.72:0/4201532752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0480009400 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.628+0000 7f0489d9b640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f048c0d2b20 0x7f048c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.629+0000 7f048ad9d640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 0x7f048c0cd0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f048400e7f0 tx=0x7f048400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.629+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484009510 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.629+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048400ee40 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.629+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c0c9630 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.629+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048400cb80 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.629+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c15a560 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.630+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048c0c9b10 con 0x7f048c15e240 2024-03-24T10:37:25.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.630+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f048400cce0 con 0x7f048c15e240 2024-03-24T10:37:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.630+0000 7f047affd640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f046c06b810 0x7f046c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.631+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f048408a640 con 0x7f048c15e240 2024-03-24T10:37:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.631+0000 7f048a59c640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f046c06b810 0x7f046c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.631+0000 7f048a59c640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f046c06b810 0x7f046c06dcd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f047c0012e0 tx=0x7f047c001700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.635+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0484054d10 con 0x7f048c15e240 2024-03-24T10:37:25.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:37:25.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:37:25.812 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.812+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f048c04f470 con 0x7f048c15e240 2024-03-24T10:37:25.813 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.812+0000 7f047affd640 1 -- 172.21.15.72:0/4201532752 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f04840583d0 con 0x7f048c15e240 2024-03-24T10:37:25.813 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T10:37:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f046c06b810 msgr2=0x7f046c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f046c06b810 0x7f046c06dcd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f047c0012e0 tx=0x7f047c001700 comp rx=0 tx=0).stop 2024-03-24T10:37:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 msgr2=0x7f048c0cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.815 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 0x7f048c0cd0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f048400e7f0 tx=0x7f048400ebf0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 shutdown_connections 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f046c06b810 0x7f046c06dcd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f048c15e240 0x7f048c0cd0d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f048c0d2b20 0x7f048c15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 --2- 172.21.15.72:0/4201532752 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f048c0d0f70 0x7f048c156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 >> 172.21.15.72:0/4201532752 conn(0x7f048c0d3e30 msgr2=0x7f048c15d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 shutdown_connections 2024-03-24T10:37:25.816 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.814+0000 7f0490a2e640 1 -- 172.21.15.72:0/4201532752 wait complete. 2024-03-24T10:37:25.826 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:37:25.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.925+0000 7fc6dbedf640 1 Processor -- start 2024-03-24T10:37:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.925+0000 7fc6dbedf640 1 -- start start 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6dbedf640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6d40cee90 0x7fc6d40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6dbedf640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d4071630 con 0x7fc6d406e500 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6dbedf640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6d415c220 con 0x7fc6d415f930 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6dbedf640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc6d4160940 con 0x7fc6d40cee90 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d9c7b640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc6d406e500 0x7fc6d4071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33116/0 (socket says 172.21.15.72:33116) 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d947a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc6d40cee90 0x7fc6d40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d9c7b640 1 -- 172.21.15.72:0/722786395 learned_addr learned my addr 172.21.15.72:0/722786395 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d947a640 1 -- 172.21.15.72:0/722786395 >> v1:172.21.15.79:6789/0 conn(0x7fc6d415f930 legacy=0x7fc6d415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d947a640 1 -- 172.21.15.72:0/722786395 >> v1:172.21.15.72:6789/0 conn(0x7fc6d406e500 legacy=0x7fc6d4071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d8c79640 1 -- 172.21.15.72:0/722786395 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416068067 0 0) 0x7fc6d4071630 con 0x7fc6d406e500 2024-03-24T10:37:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.926+0000 7fc6d947a640 1 -- 172.21.15.72:0/722786395 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d4160660 con 0x7fc6d40cee90 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.927+0000 7fc6d947a640 1 --2- 172.21.15.72:0/722786395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d40cee90 0x7fc6d40cf310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40097a0 tx=0x7fc6c402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd3e9cc07e534493 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.927+0000 7fc6d8c79640 1 -- 172.21.15.72:0/722786395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4030610 con 0x7fc6d40cee90 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.927+0000 7fc6d8c79640 1 -- 172.21.15.72:0/722786395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6c4030770 con 0x7fc6d40cee90 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.927+0000 7fc6d8c79640 1 -- 172.21.15.72:0/722786395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4030b00 con 0x7fc6d40cee90 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 -- 172.21.15.72:0/722786395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d40cee90 msgr2=0x7fc6d40cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/722786395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d40cee90 0x7fc6d40cf310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40097a0 tx=0x7fc6c402b960 comp rx=0 tx=0).stop 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 -- 172.21.15.72:0/722786395 shutdown_connections 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/722786395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d40cee90 0x7fc6d40cf310 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 -- 172.21.15.72:0/722786395 >> 172.21.15.72:0/722786395 conn(0x7fc6d40b1920 msgr2=0x7fc6d40b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 -- 172.21.15.72:0/722786395 shutdown_connections 2024-03-24T10:37:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.928+0000 7fc6dbedf640 1 -- 172.21.15.72:0/722786395 wait complete. 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.929+0000 7fc6dbedf640 1 Processor -- start 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.929+0000 7fc6dbedf640 1 -- start start 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6d406e500 0x7fc6d4151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d40cee90 0x7fc6d41471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 0x7fc6d4152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4152a10 con 0x7fc6d415f930 2024-03-24T10:37:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4151b60 con 0x7fc6d40cee90 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d41476f0 con 0x7fc6d406e500 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 0x7fc6d4152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 0x7fc6d4152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48600/0 (socket says 172.21.15.72:48600) 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 -- 172.21.15.72:0/630688135 learned_addr learned my addr 172.21.15.72:0/630688135 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6d9c7b640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6d406e500 0x7fc6d4151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6d947a640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d40cee90 0x7fc6d41471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 -- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6d406e500 msgr2=0x7fc6d4151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6d406e500 0x7fc6d4151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 -- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d40cee90 msgr2=0x7fc6d41471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d40cee90 0x7fc6d41471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 -- 172.21.15.72:0/630688135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c4009400 con 0x7fc6d415f930 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6da47c640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 0x7fc6d4152ea0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c390 tx=0x7fc6d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d00052d0 con 0x7fc6d415f930 2024-03-24T10:37:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6d0005430 con 0x7fc6d415f930 2024-03-24T10:37:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0003810 con 0x7fc6d415f930 2024-03-24T10:37:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d4151e00 con 0x7fc6d415f930 2024-03-24T10:37:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.930+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d41523c0 con 0x7fc6d415f930 2024-03-24T10:37:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.931+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d4152b80 con 0x7fc6d415f930 2024-03-24T10:37:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.932+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc6d0003970 con 0x7fc6d415f930 2024-03-24T10:37:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.932+0000 7fc6ca7fc640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc6b806b810 0x7fc6b806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.932+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc6d0089b00 con 0x7fc6d415f930 2024-03-24T10:37:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.932+0000 7fc6d9c7b640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc6b806b810 0x7fc6b806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.933+0000 7fc6d9c7b640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc6b806b810 0x7fc6b806dcd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc001920 tx=0x7fc6cc0018b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:25.936+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc6d0054140 con 0x7fc6d415f930 2024-03-24T10:37:26.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.143+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6d404f550 con 0x7fc6d415f930 2024-03-24T10:37:26.144 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.144+0000 7fc6ca7fc640 1 -- 172.21.15.72:0/630688135 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7fc6d0017020 con 0x7fc6d415f930 2024-03-24T10:37:26.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:26.145 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:37:26.145 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc6b806b810 msgr2=0x7fc6b806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc6b806b810 0x7fc6b806dcd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc001920 tx=0x7fc6cc0018b0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 msgr2=0x7fc6d4152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 0x7fc6d4152ea0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c390 tx=0x7fc6d000c850 comp rx=0 tx=0).stop 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 shutdown_connections 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc6b806b810 0x7fc6b806dcd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc6d415f930 0x7fc6d4152ea0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6d40cee90 0x7fc6d41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 --2- 172.21.15.72:0/630688135 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc6d406e500 0x7fc6d4151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.147 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 >> 172.21.15.72:0/630688135 conn(0x7fc6d40b1920 msgr2=0x7fc6d415e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 shutdown_connections 2024-03-24T10:37:26.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.146+0000 7fc6dbedf640 1 -- 172.21.15.72:0/630688135 wait complete. 2024-03-24T10:37:26.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.258+0000 7f5192902640 1 Processor -- start 2024-03-24T10:37:26.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.258+0000 7f5192902640 1 -- start start 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f5192902640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f518c15e140 0x7f518c0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f5192902640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f518c0d4c80 0x7f518c0d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f5192902640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f518c0d18c0 con 0x7f518c15e520 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f5192902640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f518c0b3e30 con 0x7f518c0d4c80 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f5192902640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f518c0b3500 con 0x7f518c15e140 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f518c0d4c80 0x7f518c0d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f518c0d4c80 0x7f518c0d2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48604/0 (socket says 172.21.15.72:48604) 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 -- 172.21.15.72:0/2173857153 learned_addr learned my addr 172.21.15.72:0/2173857153 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518bfff640 1 --2- 172.21.15.72:0/2173857153 >> v2:172.21.15.79:3300/0 conn(0x7f518c15e140 0x7f518c0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 -- 172.21.15.72:0/2173857153 >> v2:172.21.15.79:3300/0 conn(0x7f518c15e140 msgr2=0x7f518c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 --2- 172.21.15.72:0/2173857153 >> v2:172.21.15.79:3300/0 conn(0x7f518c15e140 0x7f518c0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 -- 172.21.15.72:0/2173857153 >> v1:172.21.15.79:6789/0 conn(0x7f518c15e520 legacy=0x7f518c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.259+0000 7f518b7fe640 1 -- 172.21.15.72:0/2173857153 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518c0b37e0 con 0x7f518c0d4c80 2024-03-24T10:37:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.260+0000 7f518b7fe640 1 --2- 172.21.15.72:0/2173857153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c0d4c80 0x7f518c0d2510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f518c0b6a30 tx=0x7f518002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806cd49fd04563e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.260+0000 7f518affd640 1 -- 172.21.15.72:0/2173857153 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180030860 con 0x7f518c0d4c80 2024-03-24T10:37:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.260+0000 7f518affd640 1 -- 172.21.15.72:0/2173857153 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51800309c0 con 0x7f518c0d4c80 2024-03-24T10:37:26.262 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.260+0000 7f518affd640 1 -- 172.21.15.72:0/2173857153 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180030d50 con 0x7f518c0d4c80 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 -- 172.21.15.72:0/2173857153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c0d4c80 msgr2=0x7f518c0d2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 --2- 172.21.15.72:0/2173857153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c0d4c80 0x7f518c0d2510 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f518c0b6a30 tx=0x7f518002b9a0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 -- 172.21.15.72:0/2173857153 shutdown_connections 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 --2- 172.21.15.72:0/2173857153 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c0d4c80 0x7f518c0d2510 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 --2- 172.21.15.72:0/2173857153 >> v2:172.21.15.79:3300/0 conn(0x7f518c15e140 0x7f518c0d0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 -- 172.21.15.72:0/2173857153 >> 172.21.15.72:0/2173857153 conn(0x7f518c0d3f30 msgr2=0x7f518c0d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 -- 172.21.15.72:0/2173857153 shutdown_connections 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.261+0000 7f5192902640 1 -- 172.21.15.72:0/2173857153 wait complete. 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.262+0000 7f5192902640 1 Processor -- start 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.262+0000 7f5192902640 1 -- start start 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5192902640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f518c0d4c80 0x7f518c0b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5192902640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 0x7f518c0ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5192902640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f518c0ca710 0x7f518c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5192902640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f518c15f750 con 0x7f518c15e140 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5192902640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f518c0caba0 con 0x7f518c0d4c80 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5192902640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f518c0cd5d0 con 0x7f518c0ca710 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 0x7f518c0ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 0x7f518c0ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48618/0 (socket says 172.21.15.72:48618) 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 -- 172.21.15.72:0/4219613627 learned_addr learned my addr 172.21.15.72:0/4219613627 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518bfff640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f518c0d4c80 0x7f518c0b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f5190e9f640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f518c0ca710 0x7f518c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 -- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f518c0ca710 msgr2=0x7f518c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f518c0ca710 0x7f518c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 -- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f518c0d4c80 msgr2=0x7f518c0b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f518c0d4c80 0x7f518c0b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 -- 172.21.15.72:0/4219613627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51800094d0 con 0x7f518c15e140 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.263+0000 7f518b7fe640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 0x7f518c0ca1d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5180000c00 tx=0x7f5180004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.264+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5180039c90 con 0x7f518c15e140 2024-03-24T10:37:26.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.264+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180039e10 con 0x7f518c15e140 2024-03-24T10:37:26.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.264+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518c0cd8b0 con 0x7f518c15e140 2024-03-24T10:37:26.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.264+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51800446c0 con 0x7f518c15e140 2024-03-24T10:37:26.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.264+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518c15f3e0 con 0x7f518c15e140 2024-03-24T10:37:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.265+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f518c15f900 con 0x7f518c15e140 2024-03-24T10:37:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.265+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f518004d3b0 con 0x7f518c15e140 2024-03-24T10:37:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.266+0000 7f5188ff9640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f517806b810 0x7f517806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.266+0000 7f518bfff640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f517806b810 0x7f517806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.266+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f518003e070 con 0x7f518c15e140 2024-03-24T10:37:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.266+0000 7f518bfff640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f517806b810 0x7f517806dcd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f517c009b40 tx=0x7f517c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.270+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f518c15f900 con 0x7f518c15e140 2024-03-24T10:37:26.446 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.445+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f518c15f900 con 0x7f518c15e140 2024-03-24T10:37:26.447 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.447+0000 7f5188ff9640 1 -- 172.21.15.72:0/4219613627 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7f518c15f900 con 0x7f518c15e140 2024-03-24T10:37:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:26.447 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.448+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f517806b810 msgr2=0x7f517806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.448+0000 7f5192902640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f517806b810 0x7f517806dcd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f517c009b40 tx=0x7f517c009190 comp rx=0 tx=0).stop 2024-03-24T10:37:26.449 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 msgr2=0x7f518c0ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 0x7f518c0ca1d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5180000c00 tx=0x7f5180004730 comp rx=0 tx=0).stop 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 shutdown_connections 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f517806b810 0x7f517806dcd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f518c0ca710 0x7f518c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f518c15e140 0x7f518c0ca1d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 --2- 172.21.15.72:0/4219613627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f518c0d4c80 0x7f518c0b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 >> 172.21.15.72:0/4219613627 conn(0x7f518c0d3f30 msgr2=0x7f518c06d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 shutdown_connections 2024-03-24T10:37:26.450 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.449+0000 7f5192902640 1 -- 172.21.15.72:0/4219613627 wait complete. 2024-03-24T10:37:26.461 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-24T10:37:26.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:37:26.564 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.560+0000 7fde77b3e640 1 Processor -- start 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.560+0000 7fde77b3e640 1 -- start start 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde77b3e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde700cee90 0x7fde700cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde77b3e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde70071630 con 0x7fde7015f930 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde77b3e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde7015c220 con 0x7fde7006e500 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde77b3e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fde70160940 con 0x7fde700cee90 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde750d9640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fde700cee90 0x7fde700cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde760db640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fde7015f930 0x7fde7015fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33118/0 (socket says 172.21.15.72:33118) 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde760db640 1 -- 172.21.15.72:0/3486690827 learned_addr learned my addr 172.21.15.72:0/3486690827 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.561+0000 7fde750d9640 1 -- 172.21.15.72:0/3486690827 >> v1:172.21.15.79:6789/0 conn(0x7fde7006e500 legacy=0x7fde70071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde750d9640 1 -- 172.21.15.72:0/3486690827 >> v1:172.21.15.72:6789/0 conn(0x7fde7015f930 legacy=0x7fde7015fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde748d8640 1 -- 172.21.15.72:0/3486690827 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458729068 0 0) 0x7fde70071630 con 0x7fde7015f930 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde750d9640 1 -- 172.21.15.72:0/3486690827 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde70160660 con 0x7fde700cee90 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde750d9640 1 --2- 172.21.15.72:0/3486690827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde700cee90 0x7fde700cf310 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde600097a0 tx=0x7fde6002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee67dd60108a90c server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.565 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde748d8640 1 -- 172.21.15.72:0/3486690827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60030610 con 0x7fde700cee90 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde748d8640 1 -- 172.21.15.72:0/3486690827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde60030770 con 0x7fde700cee90 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.562+0000 7fde748d8640 1 -- 172.21.15.72:0/3486690827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60030b00 con 0x7fde700cee90 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 -- 172.21.15.72:0/3486690827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde700cee90 msgr2=0x7fde700cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3486690827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde700cee90 0x7fde700cf310 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fde600097a0 tx=0x7fde6002b960 comp rx=0 tx=0).stop 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 -- 172.21.15.72:0/3486690827 shutdown_connections 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3486690827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde700cee90 0x7fde700cf310 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 -- 172.21.15.72:0/3486690827 >> 172.21.15.72:0/3486690827 conn(0x7fde700b1920 msgr2=0x7fde700b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 -- 172.21.15.72:0/3486690827 shutdown_connections 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.563+0000 7fde77b3e640 1 -- 172.21.15.72:0/3486690827 wait complete. 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.564+0000 7fde77b3e640 1 Processor -- start 2024-03-24T10:37:26.566 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.564+0000 7fde77b3e640 1 -- start start 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde77b3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7006e500 0x7fde7014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde77b3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde700cee90 0x7fde7009c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde77b3e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 0x7fde701471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde77b3e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fde701542f0 con 0x7fde7015f930 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde77b3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde70153250 con 0x7fde7006e500 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde77b3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fde70153530 con 0x7fde700cee90 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 0x7fde701471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 0x7fde701471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48628/0 (socket says 172.21.15.72:48628) 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 -- 172.21.15.72:0/3141738285 learned_addr learned my addr 172.21.15.72:0/3141738285 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde758da640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7006e500 0x7fde7014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde750d9640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde700cee90 0x7fde7009c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 -- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde700cee90 msgr2=0x7fde7009c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.569 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde700cee90 0x7fde7009c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 -- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7006e500 msgr2=0x7fde7014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7006e500 0x7fde7014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 -- 172.21.15.72:0/3141738285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde60009400 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.565+0000 7fde760db640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 0x7fde701471d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde6800c700 tx=0x7fde6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.566+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6800ce10 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.566+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde6800a640 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.566+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde70153810 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.566+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde6800aa30 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.566+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde70153ba0 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.567+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde70153fe0 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.567+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fde6800ab90 con 0x7fde7015f930 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.567+0000 7fde667fc640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde5406b810 0x7fde5406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.568+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fde68089bb0 con 0x7fde7015f930 2024-03-24T10:37:26.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.568+0000 7fde758da640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde5406b810 0x7fde5406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.568+0000 7fde758da640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde5406b810 0x7fde5406dcd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde7015f200 tx=0x7fde6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.572 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.572+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fde68054310 con 0x7fde7015f930 2024-03-24T10:37:26.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.781+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde7006f7a0 con 0x7fde7015f930 2024-03-24T10:37:26.782 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.781+0000 7fde667fc640 1 -- 172.21.15.72:0/3141738285 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7fde680579d0 con 0x7fde7015f930 2024-03-24T10:37:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:26.782 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:37:26.782 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:37:26.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde5406b810 msgr2=0x7fde5406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde5406b810 0x7fde5406dcd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde7015f200 tx=0x7fde6c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:26.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 msgr2=0x7fde701471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.784 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 0x7fde701471d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fde6800c700 tx=0x7fde6800cbc0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 shutdown_connections 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fde5406b810 0x7fde5406dcd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde7015f930 0x7fde701471d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fde700cee90 0x7fde7009c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 --2- 172.21.15.72:0/3141738285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde7006e500 0x7fde7014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 >> 172.21.15.72:0/3141738285 conn(0x7fde700b1920 msgr2=0x7fde7015e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 shutdown_connections 2024-03-24T10:37:26.785 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.783+0000 7fde77b3e640 1 -- 172.21.15.72:0/3141738285 wait complete. 2024-03-24T10:37:26.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:37:26.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.895+0000 7f523d2d4640 1 Processor -- start 2024-03-24T10:37:26.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.895+0000 7f523d2d4640 1 -- start start 2024-03-24T10:37:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f523d2d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5238161890 0x7f52380d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f523d2d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5238161c70 0x7f52380d09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f523d2d4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52380d0760 con 0x7f52380b2f10 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f523d2d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f52380d1950 con 0x7f5238161890 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f523d2d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f52380cf7c0 con 0x7f5238161c70 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5238161890 0x7f52380d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5238161890 0x7f52380d4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48630/0 (socket says 172.21.15.72:48630) 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 -- 172.21.15.72:0/4095217433 learned_addr learned my addr 172.21.15.72:0/4095217433 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f522ffff640 1 --2- 172.21.15.72:0/4095217433 >> v2:172.21.15.79:3300/0 conn(0x7f5238161c70 0x7f52380d09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 -- 172.21.15.72:0/4095217433 >> v2:172.21.15.79:3300/0 conn(0x7f5238161c70 msgr2=0x7f52380d09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 --2- 172.21.15.72:0/4095217433 >> v2:172.21.15.79:3300/0 conn(0x7f5238161c70 0x7f52380d09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 -- 172.21.15.72:0/4095217433 >> v1:172.21.15.79:6789/0 conn(0x7f52380b2f10 legacy=0x7f52380d1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.896+0000 7f5236ffd640 1 -- 172.21.15.72:0/4095217433 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52380d1670 con 0x7f5238161890 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.897+0000 7f5236ffd640 1 --2- 172.21.15.72:0/4095217433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161890 0x7f52380d4ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f523806bc50 tx=0x7f522802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77af7b3564eebb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.897+0000 7f52367fc640 1 -- 172.21.15.72:0/4095217433 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228030860 con 0x7f5238161890 2024-03-24T10:37:26.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.897+0000 7f52367fc640 1 -- 172.21.15.72:0/4095217433 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52280309c0 con 0x7f5238161890 2024-03-24T10:37:26.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.897+0000 7f52367fc640 1 -- 172.21.15.72:0/4095217433 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228030d50 con 0x7f5238161890 2024-03-24T10:37:26.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 -- 172.21.15.72:0/4095217433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161890 msgr2=0x7f52380d4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 --2- 172.21.15.72:0/4095217433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161890 0x7f52380d4ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f523806bc50 tx=0x7f522802b9a0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 -- 172.21.15.72:0/4095217433 shutdown_connections 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 --2- 172.21.15.72:0/4095217433 >> v2:172.21.15.79:3300/0 conn(0x7f5238161c70 0x7f52380d09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 --2- 172.21.15.72:0/4095217433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161890 0x7f52380d4ab0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 -- 172.21.15.72:0/4095217433 >> 172.21.15.72:0/4095217433 conn(0x7f52380d3f90 msgr2=0x7f52380d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 -- 172.21.15.72:0/4095217433 shutdown_connections 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.898+0000 7f523d2d4640 1 -- 172.21.15.72:0/4095217433 wait complete. 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.899+0000 7f523d2d4640 1 Processor -- start 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.899+0000 7f523d2d4640 1 -- start start 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.899+0000 7f523d2d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52380b2f10 0x7f52380c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.899+0000 7f523d2d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5238161890 0x7f52380b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.899+0000 7f523d2d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 0x7f52381547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.899+0000 7f523d2d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f52380cab70 con 0x7f5238161c70 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f523d2d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52380c9ad0 con 0x7f52380b2f10 2024-03-24T10:37:26.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f523d2d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f52380c9db0 con 0x7f5238161890 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 0x7f52381547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 0x7f52381547c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48632/0 (socket says 172.21.15.72:48632) 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 -- 172.21.15.72:0/3503500706 learned_addr learned my addr 172.21.15.72:0/3503500706 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f5236ffd640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52380b2f10 0x7f52380c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f522ffff640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5238161890 0x7f52380b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 -- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5238161890 msgr2=0x7f52380b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5238161890 0x7f52380b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 -- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52380b2f10 msgr2=0x7f52380c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52380b2f10 0x7f52380c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 -- 172.21.15.72:0/3503500706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52280094d0 con 0x7f5238161c70 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f52377fe640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 0x7f52381547c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f523000c730 tx=0x7f523000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230003b90 con 0x7f5238161c70 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5230003cf0 con 0x7f5238161c70 2024-03-24T10:37:26.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52380ca090 con 0x7f5238161c70 2024-03-24T10:37:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523000aa90 con 0x7f5238161c70 2024-03-24T10:37:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.900+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52380ca650 con 0x7f5238161c70 2024-03-24T10:37:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.901+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52380b4300 con 0x7f5238161c70 2024-03-24T10:37:26.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.902+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f523000abf0 con 0x7f5238161c70 2024-03-24T10:37:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.902+0000 7f522f7fe640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f521806b810 0x7f521806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.902+0000 7f5236ffd640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f521806b810 0x7f521806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.902+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f523008a1e0 con 0x7f5238161c70 2024-03-24T10:37:26.905 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.902+0000 7f5236ffd640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f521806b810 0x7f521806dcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5228036000 tx=0x7f5228008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:26.907 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:26.906+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5230054940 con 0x7f5238161c70 2024-03-24T10:37:27.116 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.116+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5238067330 con 0x7f5238161c70 2024-03-24T10:37:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.116+0000 7f522f7fe640 1 -- 172.21.15.72:0/3503500706 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5168 (secure 0 0 0) 0x7f5230058000 con 0x7f5238161c70 2024-03-24T10:37:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:27.117 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6834/1854434234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1854434234},{"type":"v1","addr":"172.21.15.79:6834","nonce":1854434234}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/813167878","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":813167878},{"type":"v1","addr":"172.21.15.72:6837","nonce":813167878}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2311947674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2311947674},{"type":"v1","addr":"172.21.15.72:6836","nonce":2311947674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:36:25.553252+0000","modified":"2024-03-24T10:36:47.629880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6835/68214934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":68214934},{"type":"v1","addr":"172.21.15.79:6835","nonce":68214934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4288,"qdb_cluster":[4288]},"id":1}]} 2024-03-24T10:37:27.117 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2024-03-24T10:37:27.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f521806b810 msgr2=0x7f521806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f521806b810 0x7f521806dcd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5228036000 tx=0x7f5228008030 comp rx=0 tx=0).stop 2024-03-24T10:37:27.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 msgr2=0x7f52381547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 0x7f52381547c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f523000c730 tx=0x7f523000cbf0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 shutdown_connections 2024-03-24T10:37:27.119 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f521806b810 0x7f521806dcd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5238161c70 0x7f52381547c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5238161890 0x7f52380b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 --2- 172.21.15.72:0/3503500706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f52380b2f10 0x7f52380c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 >> 172.21.15.72:0/3503500706 conn(0x7f52380d3f90 msgr2=0x7f5238068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:27.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 shutdown_connections 2024-03-24T10:37:27.120 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.118+0000 7f523d2d4640 1 -- 172.21.15.72:0/3503500706 wait complete. 2024-03-24T10:37:27.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:27.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.231+0000 7fca569f4640 1 Processor -- start 2024-03-24T10:37:27.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.231+0000 7fca569f4640 1 -- start start 2024-03-24T10:37:27.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca569f4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca50071050 0x7fca50071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.233 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca569f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 0x7fca500ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca569f4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca500715f0 con 0x7fca5006d570 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca569f4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fca50071d90 con 0x7fca50071050 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca569f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fca500b4d80 con 0x7fca500acf90 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca54f91640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 0x7fca500ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca4f7fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fca50071050 0x7fca50071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca54f91640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 0x7fca500ad420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:48930/0 (socket says 172.21.15.72:48930) 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca54f91640 1 -- 172.21.15.72:0/4060157964 learned_addr learned my addr 172.21.15.72:0/4060157964 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca4f7fe640 1 -- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 msgr2=0x7fca500ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 0x7fca500ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca4f7fe640 1 -- 172.21.15.72:0/4060157964 >> v1:172.21.15.79:6789/0 conn(0x7fca5006d570 legacy=0x7fca5006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca4f7fe640 1 -- 172.21.15.72:0/4060157964 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca500b3d60 con 0x7fca50071050 2024-03-24T10:37:27.234 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.232+0000 7fca54f91640 1 --2- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 0x7fca500ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.233+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca50071050 0x7fca50071850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fca440097a0 tx=0x7fca4402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f77b83a13e13812d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.233+0000 7fca4effd640 1 -- 172.21.15.72:0/4060157964 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44031830 con 0x7fca50071050 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.233+0000 7fca4effd640 1 -- 172.21.15.72:0/4060157964 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44031990 con 0x7fca50071050 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.233+0000 7fca4effd640 1 -- 172.21.15.72:0/4060157964 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44031d20 con 0x7fca50071050 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 -- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca50071050 msgr2=0x7fca50071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 --2- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca50071050 0x7fca50071850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fca440097a0 tx=0x7fca4402b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 -- 172.21.15.72:0/4060157964 shutdown_connections 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 --2- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500acf90 0x7fca500ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.236 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 --2- 172.21.15.72:0/4060157964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca50071050 0x7fca50071850 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 -- 172.21.15.72:0/4060157964 >> 172.21.15.72:0/4060157964 conn(0x7fca500b1920 msgr2=0x7fca500b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 -- 172.21.15.72:0/4060157964 shutdown_connections 2024-03-24T10:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.234+0000 7fca569f4640 1 -- 172.21.15.72:0/4060157964 wait complete. 2024-03-24T10:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.235+0000 7fca569f4640 1 Processor -- start 2024-03-24T10:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.235+0000 7fca569f4640 1 -- start start 2024-03-24T10:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca569f4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 0x7fca5014cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca569f4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca50071050 0x7fca50155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca569f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca500acf90 0x7fca5014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca569f4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca5014dd60 con 0x7fca5006d570 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca569f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca5009cd30 con 0x7fca500acf90 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca569f4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fca5009d010 con 0x7fca50071050 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 0x7fca5014cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 0x7fca5014cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48646/0 (socket says 172.21.15.72:48646) 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 -- 172.21.15.72:0/513874753 learned_addr learned my addr 172.21.15.72:0/513874753 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca54f91640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca500acf90 0x7fca5014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca50071050 0x7fca50155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 -- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca50071050 msgr2=0x7fca50155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca50071050 0x7fca50155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 -- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca500acf90 msgr2=0x7fca5014e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca500acf90 0x7fca5014e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.236+0000 7fca4ffff640 1 -- 172.21.15.72:0/513874753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca48009b30 con 0x7fca5006d570 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.237+0000 7fca4ffff640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 0x7fca5014cfe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c3c0 tx=0x7fca4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.237+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca400052d0 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.237+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca40005450 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.237+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca44009400 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.237+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40007260 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.237+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5014d9f0 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.238+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5009e080 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.238+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fca400073c0 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.239+0000 7fca4cff9640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.239+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fca400898d0 con 0x7fca5006d570 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.239+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.239+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca44036000 tx=0x7fca4403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.243+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fca40053fa0 con 0x7fca5006d570 2024-03-24T10:37:27.414 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.414+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fca5004f550 con 0x7fca5006d570 2024-03-24T10:37:27.415 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.415+0000 7fca4cff9640 1 -- 172.21.15.72:0/513874753 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18809 (secure 0 0 0) 0x7fca40057660 con 0x7fca5006d570 2024-03-24T10:37:27.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:27.416 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:07.346793+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:36:24.153769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-24T10:36:24.519534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-24T10:36:28.246563+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 msgr2=0x7fca3c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fca44036000 tx=0x7fca4403c040 comp rx=0 tx=0).stop 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 msgr2=0x7fca5014cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 0x7fca5014cfe0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca4000c3c0 tx=0x7fca4000c880 comp rx=0 tx=0).stop 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 shutdown_connections 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca500acf90 0x7fca5014e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca50071050 0x7fca50155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 --2- 172.21.15.72:0/513874753 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5006d570 0x7fca5014cfe0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 >> 172.21.15.72:0/513874753 conn(0x7fca500b1920 msgr2=0x7fca500adf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 shutdown_connections 2024-03-24T10:37:27.418 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.417+0000 7fca569f4640 1 -- 172.21.15.72:0/513874753 wait complete. 2024-03-24T10:37:27.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-24T10:37:27.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.529+0000 7f6293f7a640 1 Processor -- start 2024-03-24T10:37:27.530 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.530+0000 7f6293f7a640 1 -- start start 2024-03-24T10:37:27.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.530+0000 7f6293f7a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f628c0d2600 0x7f628c0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.531 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.530+0000 7f6293f7a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f628c06bcb0 0x7f628c0cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.530+0000 7f6293f7a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f628c0d3be0 con 0x7f628c161910 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.530+0000 7f6293f7a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f628c06d030 con 0x7f628c06bcb0 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.530+0000 7f6293f7a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f628c06c3b0 con 0x7f628c0d2600 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6292517640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f628c06bcb0 0x7f628c0cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6291d16640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f628c161910 0x7f628c0d1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33124/0 (socket says 172.21.15.72:33124) 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6291d16640 1 -- 172.21.15.72:0/51496114 learned_addr learned my addr 172.21.15.72:0/51496114 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6291515640 1 --2- 172.21.15.72:0/51496114 >> v2:172.21.15.79:3300/0 conn(0x7f628c0d2600 0x7f628c0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6292517640 1 -- 172.21.15.72:0/51496114 >> v2:172.21.15.79:3300/0 conn(0x7f628c0d2600 msgr2=0x7f628c0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6292517640 1 --2- 172.21.15.72:0/51496114 >> v2:172.21.15.79:3300/0 conn(0x7f628c0d2600 0x7f628c0d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6292517640 1 -- 172.21.15.72:0/51496114 >> v1:172.21.15.72:6789/0 conn(0x7f628c161910 legacy=0x7f628c0d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6290d14640 1 -- 172.21.15.72:0/51496114 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 656946537 0 0) 0x7f628c0d3be0 con 0x7f628c161910 2024-03-24T10:37:27.532 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.531+0000 7f6292517640 1 -- 172.21.15.72:0/51496114 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628c06c690 con 0x7f628c06bcb0 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6292517640 1 --2- 172.21.15.72:0/51496114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c06bcb0 0x7f628c0cefa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f628c0d5040 tx=0x7f628402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f987652669f2fe1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6290d14640 1 -- 172.21.15.72:0/51496114 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628402e070 con 0x7f628c06bcb0 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6290d14640 1 -- 172.21.15.72:0/51496114 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62840315a0 con 0x7f628c06bcb0 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6290d14640 1 -- 172.21.15.72:0/51496114 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284031930 con 0x7f628c06bcb0 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 -- 172.21.15.72:0/51496114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c06bcb0 msgr2=0x7f628c0cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 --2- 172.21.15.72:0/51496114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c06bcb0 0x7f628c0cefa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f628c0d5040 tx=0x7f628402b840 comp rx=0 tx=0).stop 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 -- 172.21.15.72:0/51496114 shutdown_connections 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 --2- 172.21.15.72:0/51496114 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c06bcb0 0x7f628c0cefa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 --2- 172.21.15.72:0/51496114 >> v2:172.21.15.79:3300/0 conn(0x7f628c0d2600 0x7f628c0d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 -- 172.21.15.72:0/51496114 >> 172.21.15.72:0/51496114 conn(0x7f628c0d3ff0 msgr2=0x7f628c0d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 -- 172.21.15.72:0/51496114 shutdown_connections 2024-03-24T10:37:27.534 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.532+0000 7f6293f7a640 1 -- 172.21.15.72:0/51496114 wait complete. 2024-03-24T10:37:27.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.533+0000 7f6293f7a640 1 Processor -- start 2024-03-24T10:37:27.535 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 -- start start 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f628c06bcb0 0x7f628c1e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f628c0d2600 0x7f628c1f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 0x7f628c154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1f8a20 con 0x7f628c161910 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f628c1e8c10 con 0x7f628c0d2600 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6293f7a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f628c1e8000 con 0x7f628c06bcb0 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6292517640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 0x7f628c154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6292517640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 0x7f628c154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48668/0 (socket says 172.21.15.72:48668) 2024-03-24T10:37:27.537 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6292517640 1 -- 172.21.15.72:0/3995339420 learned_addr learned my addr 172.21.15.72:0/3995339420 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6291515640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f628c0d2600 0x7f628c1f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.534+0000 7f6291d16640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f628c06bcb0 0x7f628c1e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6292517640 1 -- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f628c06bcb0 msgr2=0x7f628c1e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6292517640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f628c06bcb0 0x7f628c1e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6292517640 1 -- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f628c0d2600 msgr2=0x7f628c1f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6292517640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f628c0d2600 0x7f628c1f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6292517640 1 -- 172.21.15.72:0/3995339420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6284009400 con 0x7f628c161910 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6292517640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 0x7f628c154bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6284009890 tx=0x7f62840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284032840 con 0x7f628c161910 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62840329a0 con 0x7f628c161910 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284032d30 con 0x7f628c161910 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628c1e82e0 con 0x7f628c161910 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.535+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628c1e88a0 con 0x7f628c161910 2024-03-24T10:37:27.538 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.536+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628c0b3050 con 0x7f628c161910 2024-03-24T10:37:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.536+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f628404e430 con 0x7f628c161910 2024-03-24T10:37:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.537+0000 7f62827fc640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f627006b810 0x7f627006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.537+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f62840ac460 con 0x7f628c161910 2024-03-24T10:37:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.537+0000 7f6291d16640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f627006b810 0x7f627006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.539 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.537+0000 7f6291d16640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f627006b810 0x7f627006dcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f62880012e0 tx=0x7f6288001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.542 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.541+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f6284076b30 con 0x7f628c161910 2024-03-24T10:37:27.748 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.748+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f628c073d50 con 0x7f628c161910 2024-03-24T10:37:27.749 INFO:tasks.ceph.mon.a.smithi072.stderr:2024-03-24T10:37:27.748+0000 7fa5ba611640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-24T10:37:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.750+0000 7f62827fc640 1 -- 172.21.15.72:0/3995339420 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f628407a1f0 con 0x7f628c161910 2024-03-24T10:37:27.750 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.752+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f627006b810 msgr2=0x7f627006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.752+0000 7f6293f7a640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f627006b810 0x7f627006dcd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f62880012e0 tx=0x7f6288001630 comp rx=0 tx=0).stop 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.752+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 msgr2=0x7f628c154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.752+0000 7f6293f7a640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 0x7f628c154bb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6284009890 tx=0x7f62840046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 shutdown_connections 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f627006b810 0x7f627006dcd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f628c161910 0x7f628c154bb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f628c0d2600 0x7f628c1f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 --2- 172.21.15.72:0/3995339420 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f628c06bcb0 0x7f628c1e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 >> 172.21.15.72:0/3995339420 conn(0x7f628c0d3ff0 msgr2=0x7f628c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:27.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 shutdown_connections 2024-03-24T10:37:27.756 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.753+0000 7f6293f7a640 1 -- 172.21.15.72:0/3995339420 wait complete. 2024-03-24T10:37:27.756 INFO:tasks.ceph.mds.d.smithi079.stderr: -5362> 2024-03-24T10:36:30.759+0000 7fd4fc039640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-24T10:37:27.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-24T10:37:27.785 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2024-03-24T10:37:27.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.870+0000 7f90b006f640 1 Processor -- start 2024-03-24T10:37:27.871 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.870+0000 7f90b006f640 1 -- start start 2024-03-24T10:37:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90b006f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f90a80b3580 0x7f90a80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90b006f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a8154ea0 con 0x7f90a815b480 2024-03-24T10:37:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90b006f640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90a8071460 con 0x7f90a8072470 2024-03-24T10:37:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90b006f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f90a8071fe0 con 0x7f90a80b3580 2024-03-24T10:37:27.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90ae60c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f90a815b480 0x7f90a806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33138/0 (socket says 172.21.15.72:33138) 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90ae60c640 1 -- 172.21.15.72:0/2967863288 learned_addr learned my addr 172.21.15.72:0/2967863288 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90ade0b640 1 --2- 172.21.15.72:0/2967863288 >> v2:172.21.15.79:3300/0 conn(0x7f90a80b3580 0x7f90a80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565924856 0 0) 0x7f90a8154ea0 con 0x7f90a815b480 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.871+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9094003520 con 0x7f90a815b480 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017549222 0 0) 0x7f90a8071460 con 0x7f90a8072470 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a8154ea0 con 0x7f90a8072470 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ade0b640 1 -- 172.21.15.72:0/2967863288 >> v1:172.21.15.79:6789/0 conn(0x7f90a8072470 legacy=0x7f90a80b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ade0b640 1 -- 172.21.15.72:0/2967863288 >> v1:172.21.15.72:6789/0 conn(0x7f90a815b480 legacy=0x7f90a806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 544602470 0 0) 0x7f9094003520 con 0x7f90a815b480 2024-03-24T10:37:27.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ade0b640 1 -- 172.21.15.72:0/2967863288 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a815b910 con 0x7f90a80b3580 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.872+0000 7f90ade0b640 1 --2- 172.21.15.72:0/2967863288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a80b3580 0x7f90a80cf310 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90a40097a0 tx=0x7f90a402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a32f56fc6534cd6b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a00019f0 con 0x7f90a80b3580 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a402e050 con 0x7f90a80b3580 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90ace09640 1 -- 172.21.15.72:0/2967863288 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a4030730 con 0x7f90a80b3580 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 -- 172.21.15.72:0/2967863288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a80b3580 msgr2=0x7f90a80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 --2- 172.21.15.72:0/2967863288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a80b3580 0x7f90a80cf310 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f90a40097a0 tx=0x7f90a402b790 comp rx=0 tx=0).stop 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 -- 172.21.15.72:0/2967863288 shutdown_connections 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 --2- 172.21.15.72:0/2967863288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a80b3580 0x7f90a80cf310 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 -- 172.21.15.72:0/2967863288 >> 172.21.15.72:0/2967863288 conn(0x7f90a80b1810 msgr2=0x7f90a80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 -- 172.21.15.72:0/2967863288 shutdown_connections 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.873+0000 7f90b006f640 1 -- 172.21.15.72:0/2967863288 wait complete. 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.874+0000 7f90b006f640 1 Processor -- start 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.874+0000 7f90b006f640 1 -- start start 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90b006f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a8072470 0x7f90a814f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90b006f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 0x7f90a81f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90b006f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a815b480 0x7f90a81f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90b006f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8148b90 con 0x7f90a80b3580 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90b006f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90a8146550 con 0x7f90a815b480 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90b006f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f90a8149c30 con 0x7f90a8072470 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 0x7f90a81f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 0x7f90a81f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48674/0 (socket says 172.21.15.72:48674) 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 -- 172.21.15.72:0/1344262191 learned_addr learned my addr 172.21.15.72:0/1344262191 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ae60c640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a815b480 0x7f90a81f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ade0b640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a8072470 0x7f90a814f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 -- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a8072470 msgr2=0x7f90a814f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a8072470 0x7f90a814f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 -- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a815b480 msgr2=0x7f90a81f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.875+0000 7f90ad60a640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a815b480 0x7f90a81f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f90ad60a640 1 -- 172.21.15.72:0/1344262191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90a4009400 con 0x7f90a80b3580 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f90ad60a640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 0x7f90a81f5240 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f909800c3c0 tx=0x7f909800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90980052d0 con 0x7f90a80b3580 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9098005450 con 0x7f90a80b3580 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90a81493e0 con 0x7f90a80b3580 2024-03-24T10:37:27.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098003830 con 0x7f90a80b3580 2024-03-24T10:37:27.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.876+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90a814f700 con 0x7f90a80b3580 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.877+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90a804f470 con 0x7f90a80b3580 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.877+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9098003990 con 0x7f90a80b3580 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.878+0000 7f909e7fc640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f908c06b840 0x7f908c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.878+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f9098089ab0 con 0x7f90a80b3580 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.878+0000 7f90ade0b640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f908c06b840 0x7f908c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.878+0000 7f90ade0b640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f908c06b840 0x7f908c06dd00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90a4034000 tx=0x7f90a402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:27.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:27.882+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f90980541e0 con 0x7f90a80b3580 2024-03-24T10:37:28.090 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.090+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f90a80710e0 con 0x7f90a80b3580 2024-03-24T10:37:28.752 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.751+0000 7f909e7fc640 1 -- 172.21.15.72:0/1344262191 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f90980578a0 con 0x7f90a80b3580 2024-03-24T10:37:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f908c06b840 msgr2=0x7f908c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f908c06b840 0x7f908c06dd00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90a4034000 tx=0x7f90a402f000 comp rx=0 tx=0).stop 2024-03-24T10:37:28.754 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 msgr2=0x7f90a81f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 0x7f90a81f5240 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f909800c3c0 tx=0x7f909800c880 comp rx=0 tx=0).stop 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 shutdown_connections 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f908c06b840 0x7f908c06dd00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90a815b480 0x7f90a81f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f90a80b3580 0x7f90a81f5240 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 --2- 172.21.15.72:0/1344262191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f90a8072470 0x7f90a814f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.753+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 >> 172.21.15.72:0/1344262191 conn(0x7f90a80b1810 msgr2=0x7f90a80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.754+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 shutdown_connections 2024-03-24T10:37:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.754+0000 7f90b006f640 1 -- 172.21.15.72:0/1344262191 wait complete. 2024-03-24T10:37:28.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-24T10:37:28.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.871+0000 7fb4cdb3e640 1 Processor -- start 2024-03-24T10:37:28.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.871+0000 7fb4cdb3e640 1 -- start start 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4cdb3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80ce4a0 0x7fb4c81604b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4cdb3e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fb4c806e910 0x7fb4c80ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4cdb3e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4c80cf2a0 0x7fb4c80ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4cdb3e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c80cf6f0 con 0x7fb4c80cf2a0 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4cdb3e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c815ce20 con 0x7fb4c806e910 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4cdb3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c815c530 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4c80cf2a0 0x7fb4c80ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb4c80cf2a0 0x7fb4c80ae5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48678/0 (socket says 172.21.15.72:48678) 2024-03-24T10:37:28.873 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 -- 172.21.15.72:0/1340715547 learned_addr learned my addr 172.21.15.72:0/1340715547 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:28.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 -- 172.21.15.72:0/1340715547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80ce4a0 msgr2=0x7fb4c81604b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:28.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 --2- 172.21.15.72:0/1340715547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80ce4a0 0x7fb4c81604b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 -- 172.21.15.72:0/1340715547 >> v2:172.21.15.79:3300/0 conn(0x7fb4c806e910 msgr2=0x7fb4c80ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:28.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 --2- 172.21.15.72:0/1340715547 >> v2:172.21.15.79:3300/0 conn(0x7fb4c806e910 0x7fb4c80ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.872+0000 7fb4c7fff640 1 -- 172.21.15.72:0/1340715547 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c806ed70 con 0x7fb4c80cf2a0 2024-03-24T10:37:28.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.873+0000 7fb4c7fff640 1 --2- 172.21.15.72:0/1340715547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80cf2a0 0x7fb4c80ae5f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806bfd0 tx=0x7fb4c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd938b4b4d06822 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:28.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.873+0000 7fb4c6ffd640 1 -- 172.21.15.72:0/1340715547 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c002ca70 con 0x7fb4c80cf2a0 2024-03-24T10:37:28.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.873+0000 7fb4c6ffd640 1 -- 172.21.15.72:0/1340715547 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c002cbd0 con 0x7fb4c80cf2a0 2024-03-24T10:37:28.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.873+0000 7fb4c6ffd640 1 -- 172.21.15.72:0/1340715547 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00343f0 con 0x7fb4c80cf2a0 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/1340715547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80cf2a0 msgr2=0x7fb4c80ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/1340715547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80cf2a0 0x7fb4c80ae5f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb4c806bfd0 tx=0x7fb4c002bed0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/1340715547 shutdown_connections 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/1340715547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80cf2a0 0x7fb4c80ae5f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/1340715547 >> v2:172.21.15.79:3300/0 conn(0x7fb4c806e910 0x7fb4c80ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/1340715547 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80ce4a0 0x7fb4c81604b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/1340715547 >> 172.21.15.72:0/1340715547 conn(0x7fb4c80b18b0 msgr2=0x7fb4c80b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/1340715547 shutdown_connections 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.874+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/1340715547 wait complete. 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.875+0000 7fb4cdb3e640 1 Processor -- start 2024-03-24T10:37:28.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.875+0000 7fb4cdb3e640 1 -- start start 2024-03-24T10:37:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c806e910 0x7fb4c814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 0x7fb4c809b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80cf2a0 0x7fb4c809b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c815d610 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c815d820 con 0x7fb4c806e910 2024-03-24T10:37:28.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c815db00 con 0x7fb4c80cf2a0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 0x7fb4c809b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 0x7fb4c809b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48692/0 (socket says 172.21.15.72:48692) 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 -- 172.21.15.72:0/3590579769 learned_addr learned my addr 172.21.15.72:0/3590579769 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4c7fff640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80cf2a0 0x7fb4c809b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4c77fe640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c806e910 0x7fb4c814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 -- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80cf2a0 msgr2=0x7fb4c809b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80cf2a0 0x7fb4c809b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 -- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c806e910 msgr2=0x7fb4c814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c806e910 0x7fb4c814e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 -- 172.21.15.72:0/3590579769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c0009b30 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4bffff640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 0x7fb4c809b330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000b410 tx=0x7fb4b000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011830 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4b0011990 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b0011d40 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c815dde0 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.876+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c814ec90 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.877+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c815e300 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.878+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb4b001a400 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.878+0000 7fb4c4ff9640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb4a806b810 0x7fb4a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.878+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fb4b008a630 con 0x7fb4c80ce4a0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.878+0000 7fb4c77fe640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb4a806b810 0x7fb4a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:28.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.879+0000 7fb4c77fe640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb4a806b810 0x7fb4a806dcd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009990 tx=0x7fb4b8009110 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:28.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:28.882+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb4c815e300 con 0x7fb4c80ce4a0 2024-03-24T10:37:29.055 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.054+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb4c815e300 con 0x7fb4c80ce4a0 2024-03-24T10:37:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.756+0000 7fb4c4ff9640 1 -- 172.21.15.72:0/3590579769 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fb4c815e300 con 0x7fb4c80ce4a0 2024-03-24T10:37:29.757 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2024-03-24T10:37:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.760+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb4a806b810 msgr2=0x7fb4a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.760+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb4a806b810 0x7fb4a806dcd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009990 tx=0x7fb4b8009110 comp rx=0 tx=0).stop 2024-03-24T10:37:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.760+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 msgr2=0x7fb4c809b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:29.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.760+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 0x7fb4c809b330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb4b000b410 tx=0x7fb4b000b810 comp rx=0 tx=0).stop 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 shutdown_connections 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb4a806b810 0x7fb4a806dcd0 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009990 tx=0x7fb4b8009110 comp rx=0 tx=0).stop 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb4c80cf2a0 0x7fb4c809b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb4c80ce4a0 0x7fb4c809b330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 --2- 172.21.15.72:0/3590579769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb4c806e910 0x7fb4c814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 >> 172.21.15.72:0/3590579769 conn(0x7fb4c80b18b0 msgr2=0x7fb4c8072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:29.762 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.761+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 shutdown_connections 2024-03-24T10:37:29.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.762+0000 7fb4cdb3e640 1 -- 172.21.15.72:0/3590579769 wait complete. 2024-03-24T10:37:29.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-24T10:37:29.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.884+0000 7ff50d288640 1 Processor -- start 2024-03-24T10:37:29.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.884+0000 7ff50d288640 1 -- start start 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff50d288640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff50815b010 0x7ff508070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff50d288640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7ff5080ad5a0 0x7ff5080712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff50d288640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080719f0 0x7ff508071e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff50d288640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff5080726e0 con 0x7ff50815b010 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff50d288640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7ff5080b4050 con 0x7ff5080ad5a0 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff50d288640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080b4310 con 0x7ff5080719f0 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff50815b010 0x7ff508070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff50815b010 0x7ff508070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48700/0 (socket says 172.21.15.72:48700) 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 -- 172.21.15.72:0/3932455941 learned_addr learned my addr 172.21.15.72:0/3932455941 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 -- 172.21.15.72:0/3932455941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080719f0 msgr2=0x7ff508071e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff5077fe640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080719f0 0x7ff508071e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff5067fc640 1 --2- 172.21.15.72:0/3932455941 >> v2:172.21.15.79:3300/0 conn(0x7ff5080ad5a0 0x7ff5080712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.887 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080719f0 0x7ff508071e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 -- 172.21.15.72:0/3932455941 >> v2:172.21.15.79:3300/0 conn(0x7ff5080ad5a0 msgr2=0x7ff5080712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 --2- 172.21.15.72:0/3932455941 >> v2:172.21.15.79:3300/0 conn(0x7ff5080ad5a0 0x7ff5080712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff506ffd640 1 -- 172.21.15.72:0/3932455941 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5080b45f0 con 0x7ff50815b010 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff5077fe640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080719f0 0x7ff508071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.885+0000 7ff5067fc640 1 --2- 172.21.15.72:0/3932455941 >> v2:172.21.15.79:3300/0 conn(0x7ff5080ad5a0 0x7ff5080712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.886+0000 7ff506ffd640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff50815b010 0x7ff508070db0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff5080d0bc0 tx=0x7ff4f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddc76f9b2a028cd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.886+0000 7ff505ffb640 1 -- 172.21.15.72:0/3932455941 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f80317e0 con 0x7ff50815b010 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.886+0000 7ff505ffb640 1 -- 172.21.15.72:0/3932455941 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f8031940 con 0x7ff50815b010 2024-03-24T10:37:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.886+0000 7ff505ffb640 1 -- 172.21.15.72:0/3932455941 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8031cd0 con 0x7ff50815b010 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 -- 172.21.15.72:0/3932455941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff50815b010 msgr2=0x7ff508070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff50815b010 0x7ff508070db0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff5080d0bc0 tx=0x7ff4f802b880 comp rx=0 tx=0).stop 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 -- 172.21.15.72:0/3932455941 shutdown_connections 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080719f0 0x7ff508071e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 --2- 172.21.15.72:0/3932455941 >> v2:172.21.15.79:3300/0 conn(0x7ff5080ad5a0 0x7ff5080712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 --2- 172.21.15.72:0/3932455941 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff50815b010 0x7ff508070db0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 -- 172.21.15.72:0/3932455941 >> 172.21.15.72:0/3932455941 conn(0x7ff5080b18b0 msgr2=0x7ff5080b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 -- 172.21.15.72:0/3932455941 shutdown_connections 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.887+0000 7ff50d288640 1 -- 172.21.15.72:0/3932455941 wait complete. 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.888+0000 7ff50d288640 1 Processor -- start 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.888+0000 7ff50d288640 1 -- start start 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff50d288640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5080719f0 0x7ff50806de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff50d288640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 0x7ff50814ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff50d288640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080cd0e0 0x7ff5081499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff50d288640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080ce670 con 0x7ff5080ad5a0 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff50d288640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff5080cda60 con 0x7ff5080719f0 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff50d288640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff5080cdd40 con 0x7ff5080cd0e0 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 0x7ff50814ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 0x7ff50814ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48714/0 (socket says 172.21.15.72:48714) 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 -- 172.21.15.72:0/3022296591 learned_addr learned my addr 172.21.15.72:0/3022296591 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:29.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5077fe640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080cd0e0 0x7ff5081499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff506ffd640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5080719f0 0x7ff50806de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 -- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080cd0e0 msgr2=0x7ff5081499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080cd0e0 0x7ff5081499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 -- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5080719f0 msgr2=0x7ff50806de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5080719f0 0x7ff50806de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.889+0000 7ff5067fc640 1 -- 172.21.15.72:0/3022296591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f80094d0 con 0x7ff5080ad5a0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.890+0000 7ff5067fc640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 0x7ff50814ec70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c7f0 tx=0x7ff4fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.890+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc007a30 con 0x7ff5080ad5a0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.890+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc007b90 con 0x7ff5080ad5a0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.890+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5080ce020 con 0x7ff5080ad5a0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.890+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00ce40 con 0x7ff5080ad5a0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.890+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50806e360 con 0x7ff5080ad5a0 2024-03-24T10:37:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.891+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50806e580 con 0x7ff5080ad5a0 2024-03-24T10:37:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.891+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff4fc0113f0 con 0x7ff5080ad5a0 2024-03-24T10:37:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.892+0000 7ff4ef7fe640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff4f406b810 0x7ff4f406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.892+0000 7ff506ffd640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff4f406b810 0x7ff4f406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.892+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7ff4fc08a540 con 0x7ff5080ad5a0 2024-03-24T10:37:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.892+0000 7ff506ffd640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff4f406b810 0x7ff4f406dcd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8036000 tx=0x7ff4f803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:29.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:29.896+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff50806e580 con 0x7ff5080ad5a0 2024-03-24T10:37:30.069 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.067+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff50806e580 con 0x7ff5080ad5a0 2024-03-24T10:37:30.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.760+0000 7ff4ef7fe640 1 -- 172.21.15.72:0/3022296591 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7ff50806e580 con 0x7ff5080ad5a0 2024-03-24T10:37:30.761 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2024-03-24T10:37:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff4f406b810 msgr2=0x7ff4f406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:30.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff4f406b810 0x7ff4f406dcd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8036000 tx=0x7ff4f803d040 comp rx=0 tx=0).stop 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 msgr2=0x7ff50814ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 0x7ff50814ec70 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc00c7f0 tx=0x7ff4fc00cbf0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 shutdown_connections 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff4f406b810 0x7ff4f406dcd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff5080cd0e0 0x7ff5081499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5080ad5a0 0x7ff50814ec70 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 --2- 172.21.15.72:0/3022296591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff5080719f0 0x7ff50806de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 >> 172.21.15.72:0/3022296591 conn(0x7ff5080b18b0 msgr2=0x7ff5080af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 shutdown_connections 2024-03-24T10:37:30.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.763+0000 7ff50d288640 1 -- 172.21.15.72:0/3022296591 wait complete. 2024-03-24T10:37:30.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-24T10:37:30.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.882+0000 7fbf38b6c640 1 Processor -- start 2024-03-24T10:37:30.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.882+0000 7fbf38b6c640 1 -- start start 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf38b6c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf3415b010 0x7fbf34070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf38b6c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf340ad5a0 0x7fbf340712f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf38b6c640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf340726e0 con 0x7fbf340719f0 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf38b6c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbf340b4050 con 0x7fbf340ad5a0 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf38b6c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbf340b4310 con 0x7fbf3415b010 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf31d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf340ad5a0 0x7fbf340712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf31d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbf340ad5a0 0x7fbf340712f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48724/0 (socket says 172.21.15.72:48724) 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf31d9b640 1 -- 172.21.15.72:0/532506462 learned_addr learned my addr 172.21.15.72:0/532506462 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.883+0000 7fbf3259c640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf3415b010 0x7fbf34070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf31d9b640 1 -- 172.21.15.72:0/532506462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf3415b010 msgr2=0x7fbf34070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:30.885 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf31d9b640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf3415b010 0x7fbf34070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf31d9b640 1 -- 172.21.15.72:0/532506462 >> v1:172.21.15.79:6789/0 conn(0x7fbf340719f0 legacy=0x7fbf34071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf31d9b640 1 -- 172.21.15.72:0/532506462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf340b45f0 con 0x7fbf340ad5a0 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf3259c640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf3415b010 0x7fbf34070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf31d9b640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf340ad5a0 0x7fbf340712f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5437ff42ffd06f5a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf3159a640 1 -- 172.21.15.72:0/532506462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2802f830 con 0x7fbf340ad5a0 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf3159a640 1 -- 172.21.15.72:0/532506462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2802f990 con 0x7fbf340ad5a0 2024-03-24T10:37:30.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.884+0000 7fbf3159a640 1 -- 172.21.15.72:0/532506462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2802fd20 con 0x7fbf340ad5a0 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 -- 172.21.15.72:0/532506462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf340ad5a0 msgr2=0x7fbf340712f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf340ad5a0 0x7fbf340712f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009870 tx=0x7fbf2802da70 comp rx=0 tx=0).stop 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 -- 172.21.15.72:0/532506462 shutdown_connections 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf340ad5a0 0x7fbf340712f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/532506462 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf3415b010 0x7fbf34070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 -- 172.21.15.72:0/532506462 >> 172.21.15.72:0/532506462 conn(0x7fbf340b18b0 msgr2=0x7fbf340b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 -- 172.21.15.72:0/532506462 shutdown_connections 2024-03-24T10:37:30.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.885+0000 7fbf38b6c640 1 -- 172.21.15.72:0/532506462 wait complete. 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.886+0000 7fbf38b6c640 1 Processor -- start 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.886+0000 7fbf38b6c640 1 -- start start 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf38b6c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf340719f0 0x7fbf3414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf38b6c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf340ad5a0 0x7fbf3409a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf38b6c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 0x7fbf3415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf38b6c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3409c080 con 0x7fbf3409af10 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf38b6c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf3409b470 con 0x7fbf340719f0 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf38b6c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbf3409b750 con 0x7fbf340ad5a0 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf32d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 0x7fbf3415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf32d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 0x7fbf3415cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48736/0 (socket says 172.21.15.72:48736) 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf32d9d640 1 -- 172.21.15.72:0/980041510 learned_addr learned my addr 172.21.15.72:0/980041510 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf3259c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf340719f0 0x7fbf3414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:30.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.887+0000 7fbf31d9b640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf340ad5a0 0x7fbf3409a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf32d9d640 1 -- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf340ad5a0 msgr2=0x7fbf3409a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf32d9d640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf340ad5a0 0x7fbf3409a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf32d9d640 1 -- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf340719f0 msgr2=0x7fbf3414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf32d9d640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf340719f0 0x7fbf3414d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf32d9d640 1 -- 172.21.15.72:0/980041510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf280094d0 con 0x7fbf3409af10 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf32d9d640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 0x7fbf3415cff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c410 tx=0x7fbf2c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c011790 con 0x7fbf3409af10 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf2c0118f0 con 0x7fbf3409af10 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3409ba30 con 0x7fbf3409af10 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c011ce0 con 0x7fbf3409af10 2024-03-24T10:37:30.891 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.888+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3415cb00 con 0x7fbf3409af10 2024-03-24T10:37:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.889+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf340b0300 con 0x7fbf3409af10 2024-03-24T10:37:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.889+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbf2c01c460 con 0x7fbf3409af10 2024-03-24T10:37:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.890+0000 7fbf22ffd640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf1406b840 0x7fbf1406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.890+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fbf2c089f40 con 0x7fbf3409af10 2024-03-24T10:37:30.892 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.890+0000 7fbf3259c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf1406b840 0x7fbf1406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:30.893 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.890+0000 7fbf3259c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf1406b840 0x7fbf1406dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf24007510 tx=0x7fbf240074a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:30.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:30.894+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbf2c0548d0 con 0x7fbf3409af10 2024-03-24T10:37:31.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.065+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbf3409e080 con 0x7fbf3409af10 2024-03-24T10:37:31.768 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.767+0000 7fbf22ffd640 1 -- 172.21.15.72:0/980041510 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fbf2c057f90 con 0x7fbf3409af10 2024-03-24T10:37:31.768 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2024-03-24T10:37:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf1406b840 msgr2=0x7fbf1406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf1406b840 0x7fbf1406dd00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf24007510 tx=0x7fbf240074a0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 msgr2=0x7fbf3415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:31.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 0x7fbf3415cff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00c410 tx=0x7fbf2c00c8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 shutdown_connections 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbf1406b840 0x7fbf1406dd00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3409af10 0x7fbf3415cff0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbf340ad5a0 0x7fbf3409a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 --2- 172.21.15.72:0/980041510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf340719f0 0x7fbf3414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.769+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 >> 172.21.15.72:0/980041510 conn(0x7fbf340b18b0 msgr2=0x7fbf340afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.770+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 shutdown_connections 2024-03-24T10:37:31.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.770+0000 7fbf38b6c640 1 -- 172.21.15.72:0/980041510 wait complete. 2024-03-24T10:37:31.786 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-24T10:37:31.786 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-24T10:37:31.786 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-24T10:37:31.786 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:37:31.786 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-24T10:37:31.786 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-24T10:37:31.787 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-24T10:37:31.787 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:37:31.787 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-24T10:37:31.787 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-24T10:37:31.787 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-24T10:37:31.787 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:37:31.787 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-24T10:37:31.788 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-24T10:37:31.788 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-24T10:37:31.788 INFO:teuthology.orchestra.run:waiting for 300 2024-03-24T10:37:31.797 INFO:tasks.ceph.mds.a:Stopped 2024-03-24T10:37:31.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-24T10:37:31.798 INFO:tasks.ceph.mds.c:Stopped 2024-03-24T10:37:31.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-24T10:37:31.799 INFO:tasks.ceph.mds.b:Stopped 2024-03-24T10:37:31.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-24T10:37:31.801 INFO:tasks.ceph.mds.d:Stopped 2024-03-24T10:37:31.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-24T10:37:31.840 INFO:tasks.ceph.mds.a:Started 2024-03-24T10:37:31.840 DEBUG:teuthology.parallel:result is None 2024-03-24T10:37:31.841 INFO:tasks.ceph.mds.c:Started 2024-03-24T10:37:31.841 DEBUG:teuthology.parallel:result is None 2024-03-24T10:37:31.844 INFO:tasks.ceph.mds.b:Started 2024-03-24T10:37:31.845 INFO:tasks.ceph.mds.d:Started 2024-03-24T10:37:31.845 DEBUG:teuthology.parallel:result is None 2024-03-24T10:37:31.845 DEBUG:teuthology.parallel:result is None 2024-03-24T10:37:31.845 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-24T10:37:31.917 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2024-03-24T10:37:31.918 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2024-03-24T10:37:31.926 INFO:tasks.ceph.mds.d.smithi079.stdout:starting mds.d at 2024-03-24T10:37:31.927 INFO:tasks.ceph.mds.b.smithi079.stdout:starting mds.b at 2024-03-24T10:37:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.952+0000 7f498bb01640 1 Processor -- start 2024-03-24T10:37:31.953 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.952+0000 7f498bb01640 1 -- start start 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498bb01640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f498415e1a0 0x7f49840d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498bb01640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f498415e580 0x7f4984161e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498bb01640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49840b47c0 0x7f49840b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498bb01640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f49841623b0 con 0x7f498415e1a0 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498bb01640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f49840b4050 con 0x7f498415e580 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498bb01640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f49841625e0 con 0x7f49840b47c0 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498989d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f498415e1a0 0x7f49840d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498989d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f498415e1a0 0x7f49840d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59024/0 (socket says 172.21.15.72:59024) 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.953+0000 7f498989d640 1 -- 172.21.15.72:0/442554715 learned_addr learned my addr 172.21.15.72:0/442554715 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498909c640 1 --2- 172.21.15.72:0/442554715 >> v2:172.21.15.79:3300/0 conn(0x7f498415e580 0x7f4984161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498989d640 1 -- 172.21.15.72:0/442554715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49840b47c0 msgr2=0x7f49840b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498989d640 1 --2- 172.21.15.72:0/442554715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49840b47c0 0x7f49840b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498989d640 1 -- 172.21.15.72:0/442554715 >> v2:172.21.15.79:3300/0 conn(0x7f498415e580 msgr2=0x7f4984161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498989d640 1 --2- 172.21.15.72:0/442554715 >> v2:172.21.15.79:3300/0 conn(0x7f498415e580 0x7f4984161e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498989d640 1 -- 172.21.15.72:0/442554715 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49841628c0 con 0x7f498415e1a0 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498989d640 1 --2- 172.21.15.72:0/442554715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498415e1a0 0x7f49840d1420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f49840d3ef0 tx=0x7f497402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca4a0a125cc9669 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.954+0000 7f498889b640 1 -- 172.21.15.72:0/442554715 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974031870 con 0x7f498415e1a0 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498889b640 1 -- 172.21.15.72:0/442554715 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49740319d0 con 0x7f498415e1a0 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498889b640 1 -- 172.21.15.72:0/442554715 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4974031d60 con 0x7f498415e1a0 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 -- 172.21.15.72:0/442554715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498415e1a0 msgr2=0x7f49840d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 --2- 172.21.15.72:0/442554715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498415e1a0 0x7f49840d1420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f49840d3ef0 tx=0x7f497402b910 comp rx=0 tx=0).stop 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 -- 172.21.15.72:0/442554715 shutdown_connections 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 --2- 172.21.15.72:0/442554715 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f49840b47c0 0x7f49840b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 --2- 172.21.15.72:0/442554715 >> v2:172.21.15.79:3300/0 conn(0x7f498415e580 0x7f4984161e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 --2- 172.21.15.72:0/442554715 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f498415e1a0 0x7f49840d1420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 -- 172.21.15.72:0/442554715 >> 172.21.15.72:0/442554715 conn(0x7f498408da00 msgr2=0x7f498409d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 -- 172.21.15.72:0/442554715 shutdown_connections 2024-03-24T10:37:31.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.955+0000 7f498bb01640 1 -- 172.21.15.72:0/442554715 wait complete. 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.956+0000 7f498bb01640 1 Processor -- start 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.956+0000 7f498bb01640 1 -- start start 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498bb01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49840b47c0 0x7f498415e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498bb01640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498415e1a0 0x7f4984161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498bb01640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 0x7f49841f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498bb01640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4984161840 con 0x7f49840b8fb0 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498bb01640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49840b9a00 con 0x7f49840b47c0 2024-03-24T10:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498bb01640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f49840b1300 con 0x7f498415e1a0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 0x7f49841f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 0x7f49841f73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59026/0 (socket says 172.21.15.72:59026) 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 -- 172.21.15.72:0/3088149334 learned_addr learned my addr 172.21.15.72:0/3088149334 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498909c640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498415e1a0 0x7f4984161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498989d640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49840b47c0 0x7f498415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 -- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498415e1a0 msgr2=0x7f4984161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498415e1a0 0x7f4984161300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 -- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49840b47c0 msgr2=0x7f498415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49840b47c0 0x7f498415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.957+0000 7f498a09e640 1 -- 172.21.15.72:0/3088149334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49740094d0 con 0x7f49840b8fb0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f498989d640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49840b47c0 0x7f498415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f498a09e640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 0x7f49841f73c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f497c00b9e0 tx=0x7f497c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c00cb20 con 0x7f49840b8fb0 2024-03-24T10:37:31.961 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c00cc80 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49840b9720 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c014440 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.958+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49840b0f90 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.959+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4984073d50 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.959+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f497c01e440 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.960+0000 7f497a7fc640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f496806b810 0x7f496806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.960+0000 7f498989d640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f496806b810 0x7f496806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.960+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7f497c089e40 con 0x7f49840b8fb0 2024-03-24T10:37:31.962 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.960+0000 7f498989d640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f496806b810 0x7f496806dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4974036000 tx=0x7f497403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:31.964+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f497c054b10 con 0x7f49840b8fb0 2024-03-24T10:37:32.148 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.148+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f49840b3ac0 con 0x7f49840b8fb0 2024-03-24T10:37:32.777 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.776+0000 7f497a7fc640 1 -- 172.21.15.72:0/3088149334 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7f497c019020 con 0x7f49840b8fb0 2024-03-24T10:37:32.777 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f496806b810 msgr2=0x7f496806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f496806b810 0x7f496806dcd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4974036000 tx=0x7f497403c040 comp rx=0 tx=0).stop 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 msgr2=0x7f49841f73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 0x7f49841f73c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f497c00b9e0 tx=0x7f497c00bea0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 shutdown_connections 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f496806b810 0x7f496806dcd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.780 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49840b8fb0 0x7f49841f73c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f498415e1a0 0x7f4984161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 --2- 172.21.15.72:0/3088149334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49840b47c0 0x7f498415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 >> 172.21.15.72:0/3088149334 conn(0x7f498408da00 msgr2=0x7f49840d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:32.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 shutdown_connections 2024-03-24T10:37:32.781 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.779+0000 7f498bb01640 1 -- 172.21.15.72:0/3088149334 wait complete. 2024-03-24T10:37:32.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-24T10:37:32.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.894+0000 7fca5646b640 1 Processor -- start 2024-03-24T10:37:32.895 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.894+0000 7fca5646b640 1 -- start start 2024-03-24T10:37:32.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.894+0000 7fca5646b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500cee90 0x7fca500cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:32.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.894+0000 7fca5646b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca5015f930 0x7fca5015fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:32.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca5646b640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca50071630 con 0x7fca5006e500 2024-03-24T10:37:32.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca5646b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fca50160940 con 0x7fca5015f930 2024-03-24T10:37:32.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca5646b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fca500cf850 con 0x7fca500cee90 2024-03-24T10:37:32.896 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca54a08640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca5015f930 0x7fca5015fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca4ffff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fca5006e500 0x7fca50071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48144/0 (socket says 172.21.15.72:48144) 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca4ffff640 1 -- 172.21.15.72:0/2710463507 learned_addr learned my addr 172.21.15.72:0/2710463507 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca54a08640 1 -- 172.21.15.72:0/2710463507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500cee90 msgr2=0x7fca500cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca54a08640 1 --2- 172.21.15.72:0/2710463507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500cee90 0x7fca500cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca54a08640 1 -- 172.21.15.72:0/2710463507 >> v1:172.21.15.72:6789/0 conn(0x7fca5006e500 legacy=0x7fca50071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca54a08640 1 -- 172.21.15.72:0/2710463507 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5015c220 con 0x7fca5015f930 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.895+0000 7fca4effd640 1 -- 172.21.15.72:0/2710463507 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373057123 0 0) 0x7fca50071630 con 0x7fca5006e500 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca54a08640 1 --2- 172.21.15.72:0/2710463507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5015f930 0x7fca5015fdc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca48009d90 tx=0x7fca4802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6421dce645fbf46 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca4effd640 1 -- 172.21.15.72:0/2710463507 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4802cc50 con 0x7fca5015f930 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca4effd640 1 -- 172.21.15.72:0/2710463507 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4802cdb0 con 0x7fca5015f930 2024-03-24T10:37:32.897 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca4effd640 1 -- 172.21.15.72:0/2710463507 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48034660 con 0x7fca5015f930 2024-03-24T10:37:32.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 -- 172.21.15.72:0/2710463507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5015f930 msgr2=0x7fca5015fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:32.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 --2- 172.21.15.72:0/2710463507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5015f930 0x7fca5015fdc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fca48009d90 tx=0x7fca4802bea0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 -- 172.21.15.72:0/2710463507 shutdown_connections 2024-03-24T10:37:32.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 --2- 172.21.15.72:0/2710463507 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca5015f930 0x7fca5015fdc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.898 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 --2- 172.21.15.72:0/2710463507 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca500cee90 0x7fca500cf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 -- 172.21.15.72:0/2710463507 >> 172.21.15.72:0/2710463507 conn(0x7fca500b1920 msgr2=0x7fca500b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:32.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 -- 172.21.15.72:0/2710463507 shutdown_connections 2024-03-24T10:37:32.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.896+0000 7fca5646b640 1 -- 172.21.15.72:0/2710463507 wait complete. 2024-03-24T10:37:32.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 Processor -- start 2024-03-24T10:37:32.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 -- start start 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca5006e500 0x7fca5009c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 0x7fca500afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca5015f930 0x7fca50146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fca500b03b0 con 0x7fca500cee90 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca500b0690 con 0x7fca5015f930 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.898+0000 7fca5646b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fca500b0970 con 0x7fca5006e500 2024-03-24T10:37:32.901 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 0x7fca500afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 0x7fca500afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59038/0 (socket says 172.21.15.72:59038) 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 -- 172.21.15.72:0/3262309 learned_addr learned my addr 172.21.15.72:0/3262309 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4ffff640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca5006e500 0x7fca5009c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca54a08640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca5015f930 0x7fca50146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 -- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca5006e500 msgr2=0x7fca5009c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca5006e500 0x7fca5009c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 -- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca5015f930 msgr2=0x7fca50146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca5015f930 0x7fca50146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 -- 172.21.15.72:0/3262309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca48009a70 con 0x7fca500cee90 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca54a08640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca5015f930 0x7fca50146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4f7fe640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 0x7fca500afa40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca4400b4a0 tx=0x7fca4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44010610 con 0x7fca500cee90 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44010770 con 0x7fca500cee90 2024-03-24T10:37:32.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca500b0c50 con 0x7fca500cee90 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44010b20 con 0x7fca500cee90 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.899+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5009c7a0 con 0x7fca500cee90 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.900+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca5009c990 con 0x7fca500cee90 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.901+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fca44010c80 con 0x7fca500cee90 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.901+0000 7fca4cff9640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.901+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fca44089cd0 con 0x7fca500cee90 2024-03-24T10:37:32.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.901+0000 7fca4ffff640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:32.904 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.901+0000 7fca4ffff640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca40000f60 tx=0x7fca40007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:32.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:32.905+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fca44054820 con 0x7fca500cee90 2024-03-24T10:37:33.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.141+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fca500b1170 con 0x7fca500cee90 2024-03-24T10:37:33.141 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.141+0000 7fca4cff9640 1 -- 172.21.15.72:0/3262309 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) ==== 80+0+6645 (secure 0 0 0) 0x7fca500b1170 con 0x7fca500cee90 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmYuKLCBAAUVObgf4K/UTjpRCCnmO//Q==", 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-03-24T10:37:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmc+gDFRAAQZqdWedSlu83X3SE5kDtRQ==", 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBm8+zpDxAA+GTpCIIqGefAob5k2BG/uQ==", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmfJOXHBAAAUvZrTh4shSDwUxQPT3VOw==", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDzAQBmstltOxAAOg4CR6yJpWD+67CDewMfdQ==", 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD2AQBmnp7tORAAqJA+zaC5+Pc8VBCAgJAQbg==", 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD5AQBmpW9sOBAA6xIhF2gFdwZVOn4T5NFfmg==", 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQD8AQBmtXGoNhAAeZAL6Q3WFjsgb0HLwTZ2pg==", 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQADAgBm2hW/BBAAlZVzBNY4hKJLvybCequNeg==", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAGAgBmrn8AAxAAY3zq7Comu5loRoFG8WM3hA==", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAJAgBm+N81ARAAPFSPPtf8sY9QDOH6D3NbuQ==", 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAMAgBmfbcQABAAbyJFdXYxxks+pVo221+Mvg==", 2024-03-24T10:37:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmpt8/IRAAYiR002bSEWemiqCVbKgVlw==", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-03-24T10:37:33.150 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBm/PGSKhAA4OzSekjwyyhs7sAfnpjmLQ==", 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.2", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmRCscJxAAsDCJbFkj5lk8KskSdPKHXg==", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.3", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmlj9mMBAAOlOs3oGb8P6bDh0H0KWATQ==", 2024-03-24T10:37:33.152 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q==", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2024-03-24T10:37:33.153 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQARAgBmOy/KNhAARL+boDxR2+v/w029SD0Mxw==", 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQARAgBmXzfKNhAAQG9g0iuOaFpxkDWBOQx8dw==", 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.154 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQARAgBm+T3KNhAAcT3EknbVmY5F5bxS2jv51Q==", 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQARAgBmTUTKNhAAkiYSEfEZiZxpp8PUcuKCJg==", 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-24T10:37:33.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQARAgBm5ErKNhAAaRNzn4EtbyIswa5noxmaqw==", 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQARAgBmslHKNhAAJ5oWFcfX7xteQZwPADM+5w==", 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBmSGa1BBAAsEceO3i3PO1gR0njPHhmrA==", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQDwAQBm+vP0ABAAeRjI7NBGqi5ZhLrvCpTXyA==", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2024-03-24T10:37:33.157 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2024-03-24T10:37:33.158 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2024-03-24T10:37:33.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:33.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2024-03-24T10:37:33.158 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-24T10:37:33.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 msgr2=0x7fca3c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca40000f60 tx=0x7fca40007b50 comp rx=0 tx=0).stop 2024-03-24T10:37:33.159 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 msgr2=0x7fca500afa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 0x7fca500afa40 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fca4400b4a0 tx=0x7fca4400b960 comp rx=0 tx=0).stop 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 shutdown_connections 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fca3c06b810 0x7fca3c06dcd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca5015f930 0x7fca50146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca500cee90 0x7fca500afa40 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 --2- 172.21.15.72:0/3262309 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fca5006e500 0x7fca5009c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 >> 172.21.15.72:0/3262309 conn(0x7fca500b1920 msgr2=0x7fca5015e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 shutdown_connections 2024-03-24T10:37:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.143+0000 7fca5646b640 1 -- 172.21.15.72:0/3262309 wait complete. 2024-03-24T10:37:33.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-24T10:37:33.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.260+0000 7f0088d93640 1 Processor -- start 2024-03-24T10:37:33.261 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.260+0000 7f0088d93640 1 -- start start 2024-03-24T10:37:33.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0088d93640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f00840cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0088d93640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f008415fa20 0x7f008415fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0088d93640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00841603c0 con 0x7f0084145700 2024-03-24T10:37:33.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0088d93640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f00840cf710 con 0x7f008415fa20 2024-03-24T10:37:33.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0088d93640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f008406d9c0 con 0x7f008406edf0 2024-03-24T10:37:33.264 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f008259c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0084145700 0x7f008406de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48154/0 (socket says 172.21.15.72:48154) 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f008259c640 1 -- 172.21.15.72:0/2390265693 learned_addr learned my addr 172.21.15.72:0/2390265693 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0082d9d640 1 --2- 172.21.15.72:0/2390265693 >> v2:172.21.15.79:3300/0 conn(0x7f008415fa20 0x7f008415fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f007bfff640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f00840cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1386638045 0 0) 0x7f00841603c0 con 0x7f0084145700 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0070003520 con 0x7f0084145700 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1174971020 0 0) 0x7f0070003520 con 0x7f0084145700 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 msgr2=0x7f00840cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f00840cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 >> v2:172.21.15.79:3300/0 conn(0x7f008415fa20 msgr2=0x7f008415fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 --2- 172.21.15.72:0/2390265693 >> v2:172.21.15.79:3300/0 conn(0x7f008415fa20 0x7f008415fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f008406d090 con 0x7f0084145700 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f0074001670 con 0x7f0084145700 2024-03-24T10:37:33.265 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 >> v1:172.21.15.72:6789/0 conn(0x7f0084145700 legacy=0x7f008406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0070003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00700047c0 0x7f0070004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f0070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f00840cf710 con 0x7f0070003970 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f008406d9c0 con 0x7f00700047c0 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f007000b980 con 0x7f008406edf0 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.261+0000 7f008259c640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0070003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f007bfff640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00700047c0 0x7f0070004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f0082d9d640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f0070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f008259c640 1 -- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 msgr2=0x7f0070005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f008259c640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f0070005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f008259c640 1 -- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00700047c0 msgr2=0x7f0070004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:33.266 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f008259c640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00700047c0 0x7f0070004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f008259c640 1 -- 172.21.15.72:0/2390265693 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0070003520 con 0x7f0070003970 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f0082d9d640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008406edf0 0x7f0070005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f007bfff640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00700047c0 0x7f0070004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.262+0000 7f008259c640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0070003d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f007400c270 tx=0x7f00700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79dc7d7d0e31c91 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007402cae0 con 0x7f0070003970 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f007402cc40 con 0x7f0070003970 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0081d9b640 1 -- 172.21.15.72:0/2390265693 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740058d0 con 0x7f0070003970 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0088d93640 1 -- 172.21.15.72:0/2390265693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 msgr2=0x7f0070003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0088d93640 1 --2- 172.21.15.72:0/2390265693 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0070003d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f007400c270 tx=0x7f00700057f0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0082d9d640 1 -- 172.21.15.72:0/2390265693 reap_dead start 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0088d93640 1 -- 172.21.15.72:0/2390265693 shutdown_connections 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0088d93640 1 -- 172.21.15.72:0/2390265693 >> 172.21.15.72:0/2390265693 conn(0x7f00840b1810 msgr2=0x7f00840b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0088d93640 1 -- 172.21.15.72:0/2390265693 shutdown_connections 2024-03-24T10:37:33.267 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.263+0000 7f0088d93640 1 -- 172.21.15.72:0/2390265693 wait complete. 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.264+0000 7f0088d93640 1 Processor -- start 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 -- start start 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0084136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008413cce0 0x7f008413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00841f4f60 0x7f00841f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f00841f5c90 con 0x7f0070003970 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0084136ff0 con 0x7f00841f4f60 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f0088d93640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f00841372d0 con 0x7f008413cce0 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f008259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0084136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.270 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f008259c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0084136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59052/0 (socket says 172.21.15.72:59052) 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.265+0000 7f008259c640 1 -- 172.21.15.72:0/3917404047 learned_addr learned my addr 172.21.15.72:0/3917404047 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f008259c640 1 -- 172.21.15.72:0/3917404047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008413cce0 msgr2=0x7f008413d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f008259c640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008413cce0 0x7f008413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f008259c640 1 -- 172.21.15.72:0/3917404047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00841f4f60 msgr2=0x7f00841f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f008259c640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00841f4f60 0x7f00841f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f008259c640 1 -- 172.21.15.72:0/3917404047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00841375b0 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f008259c640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0084136400 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f007400c210 tx=0x7f0074001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0074004bf0 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0074004d50 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0084137890 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00740072b0 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.266+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00841f5920 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.267+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0084073d50 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.267+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0074032070 con 0x7f0070003970 2024-03-24T10:37:33.271 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.268+0000 7f007affd640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f006406b840 0x7f006406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.268+0000 7f007bfff640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f006406b840 0x7f006406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.268+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f00740aaec0 con 0x7f0070003970 2024-03-24T10:37:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.268+0000 7f007bfff640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f006406b840 0x7f006406dd00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00840b1100 tx=0x7f006c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.272 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.272+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0074075c10 con 0x7f0070003970 2024-03-24T10:37:33.509 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.509+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f0084072d60 con 0x7f0070003970 2024-03-24T10:37:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.511+0000 7f007affd640 1 -- 172.21.15.72:0/3917404047 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f0074045020 con 0x7f0070003970 2024-03-24T10:37:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f006406b840 msgr2=0x7f006406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f006406b840 0x7f006406dd00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00840b1100 tx=0x7f006c008040 comp rx=0 tx=0).stop 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 msgr2=0x7f0084136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0084136400 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f007400c210 tx=0x7f0074001a00 comp rx=0 tx=0).stop 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 shutdown_connections 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f006406b840 0x7f006406dd00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00841f4f60 0x7f00841f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f008413cce0 0x7f008413d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 --2- 172.21.15.72:0/3917404047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0070003970 0x7f0084136400 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 >> 172.21.15.72:0/3917404047 conn(0x7f00840b1810 msgr2=0x7f008413fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 shutdown_connections 2024-03-24T10:37:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.513+0000 7f0088d93640 1 -- 172.21.15.72:0/3917404047 wait complete. 2024-03-24T10:37:33.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-24T10:37:33.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.624+0000 7fbe772fb640 1 Processor -- start 2024-03-24T10:37:33.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.625+0000 7fbe772fb640 1 -- start start 2024-03-24T10:37:33.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.625+0000 7fbe772fb640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe70161910 0x7fbe700d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.625+0000 7fbe772fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe700d2600 0x7fbe700cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.625+0000 7fbe772fb640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe7006c160 con 0x7fbe7006bcb0 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.625+0000 7fbe772fb640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fbe7006d030 con 0x7fbe70161910 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.625+0000 7fbe772fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbe700d3be0 con 0x7fbe700d2600 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe75097640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbe70161910 0x7fbe700d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe74896640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbe7006bcb0 0x7fbe700d1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48170/0 (socket says 172.21.15.72:48170) 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe74896640 1 -- 172.21.15.72:0/3013212561 learned_addr learned my addr 172.21.15.72:0/3013212561 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe75898640 1 --2- 172.21.15.72:0/3013212561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe700d2600 0x7fbe700cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe75097640 1 -- 172.21.15.72:0/3013212561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe700d2600 msgr2=0x7fbe700cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe75097640 1 --2- 172.21.15.72:0/3013212561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe700d2600 0x7fbe700cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe75097640 1 -- 172.21.15.72:0/3013212561 >> v1:172.21.15.72:6789/0 conn(0x7fbe7006bcb0 legacy=0x7fbe700d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe75097640 1 -- 172.21.15.72:0/3013212561 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7006c3b0 con 0x7fbe70161910 2024-03-24T10:37:33.627 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.626+0000 7fbe67fff640 1 -- 172.21.15.72:0/3013212561 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3018540674 0 0) 0x7fbe7006c160 con 0x7fbe7006bcb0 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe75097640 1 --2- 172.21.15.72:0/3013212561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe70161910 0x7fbe700d34c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe600097a0 tx=0x7fbe6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a5bbb5bcf8237b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe67fff640 1 -- 172.21.15.72:0/3013212561 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6002e070 con 0x7fbe70161910 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe67fff640 1 -- 172.21.15.72:0/3013212561 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe600315a0 con 0x7fbe70161910 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe67fff640 1 -- 172.21.15.72:0/3013212561 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe60031930 con 0x7fbe70161910 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 -- 172.21.15.72:0/3013212561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe70161910 msgr2=0x7fbe700d34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 --2- 172.21.15.72:0/3013212561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe70161910 0x7fbe700d34c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe600097a0 tx=0x7fbe6002b840 comp rx=0 tx=0).stop 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 -- 172.21.15.72:0/3013212561 shutdown_connections 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 --2- 172.21.15.72:0/3013212561 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe700d2600 0x7fbe700cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 --2- 172.21.15.72:0/3013212561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe70161910 0x7fbe700d34c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 -- 172.21.15.72:0/3013212561 >> 172.21.15.72:0/3013212561 conn(0x7fbe700d3ff0 msgr2=0x7fbe700d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 -- 172.21.15.72:0/3013212561 shutdown_connections 2024-03-24T10:37:33.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.627+0000 7fbe772fb640 1 -- 172.21.15.72:0/3013212561 wait complete. 2024-03-24T10:37:33.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.628+0000 7fbe772fb640 1 Processor -- start 2024-03-24T10:37:33.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.628+0000 7fbe772fb640 1 -- start start 2024-03-24T10:37:33.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe772fb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7006bcb0 0x7fbe700cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe772fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 0x7fbe7015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe772fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70161910 0x7fbe7015e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe772fb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbe700cc8c0 con 0x7fbe700d2600 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe772fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbe700c7b20 con 0x7fbe70161910 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe772fb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbe700c7e00 con 0x7fbe7006bcb0 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe74896640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 0x7fbe7015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe74896640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 0x7fbe7015dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59066/0 (socket says 172.21.15.72:59066) 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe74896640 1 -- 172.21.15.72:0/994057907 learned_addr learned my addr 172.21.15.72:0/994057907 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe75097640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7006bcb0 0x7fbe700cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.629+0000 7fbe75898640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70161910 0x7fbe7015e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe74896640 1 -- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7006bcb0 msgr2=0x7fbe700cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe74896640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7006bcb0 0x7fbe700cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe74896640 1 -- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70161910 msgr2=0x7fbe7015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe74896640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70161910 0x7fbe7015e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe74896640 1 -- 172.21.15.72:0/994057907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe60009400 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe75097640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7006bcb0 0x7fbe700cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe75898640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70161910 0x7fbe7015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe74896640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 0x7fbe7015dd80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c430 tx=0x7fbe6c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c0074e0 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6c007660 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe700c80e0 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004a20 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.630+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe700cc440 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.631+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe700c8600 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.631+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbe6c004b80 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.632+0000 7fbe65ffb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe5406b810 0x7fbe5406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.632+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fbe6c089e10 con 0x7fbe700d2600 2024-03-24T10:37:33.634 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.632+0000 7fbe75097640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe5406b810 0x7fbe5406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.632+0000 7fbe75097640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe5406b810 0x7fbe5406dcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbe60036000 tx=0x7fbe6003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.636 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.636+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbe700c8600 con 0x7fbe700d2600 2024-03-24T10:37:33.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.876+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fbe700c8600 con 0x7fbe700d2600 2024-03-24T10:37:33.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.878+0000 7fbe65ffb640 1 -- 172.21.15.72:0/994057907 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fbe700c8600 con 0x7fbe700d2600 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe5406b810 msgr2=0x7fbe5406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe5406b810 0x7fbe5406dcd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbe60036000 tx=0x7fbe6003d040 comp rx=0 tx=0).stop 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 msgr2=0x7fbe7015dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 0x7fbe7015dd80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c430 tx=0x7fbe6c00c8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 shutdown_connections 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbe5406b810 0x7fbe5406dcd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbe70161910 0x7fbe7015e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbe700d2600 0x7fbe7015dd80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 --2- 172.21.15.72:0/994057907 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbe7006bcb0 0x7fbe700cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 >> 172.21.15.72:0/994057907 conn(0x7fbe700d3ff0 msgr2=0x7fbe700d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:33.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 shutdown_connections 2024-03-24T10:37:33.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.880+0000 7fbe772fb640 1 -- 172.21.15.72:0/994057907 wait complete. 2024-03-24T10:37:33.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-24T10:37:33.992 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.992+0000 7fd01ca39640 1 Processor -- start 2024-03-24T10:37:33.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.992+0000 7fd01ca39640 1 -- start start 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd01ca39640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd01ca39640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd01806eb40 0x7fd0180cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd01ca39640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd01815f8a0 con 0x7fd0180b3f30 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd01ca39640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd0180b2e90 con 0x7fd01806eb40 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd01ca39640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd0180b3170 con 0x7fd01815aee0 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd01806eb40 0x7fd0180cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd01806eb40 0x7fd0180cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59082/0 (socket says 172.21.15.72:59082) 2024-03-24T10:37:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 -- 172.21.15.72:0/2770991758 learned_addr learned my addr 172.21.15.72:0/2770991758 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd01659c640 1 --2- 172.21.15.72:0/2770991758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 -- 172.21.15.72:0/2770991758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 msgr2=0x7fd01815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 --2- 172.21.15.72:0/2770991758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 -- 172.21.15.72:0/2770991758 >> v1:172.21.15.79:6789/0 conn(0x7fd0180b3f30 legacy=0x7fd01806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.993+0000 7fd016d9d640 1 -- 172.21.15.72:0/2770991758 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0180b3450 con 0x7fd01806eb40 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.994+0000 7fd016d9d640 1 --2- 172.21.15.72:0/2770991758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01806eb40 0x7fd0180cd1a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd010009870 tx=0x7fd01002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24a46b8cbac84ac server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.994+0000 7fd01559a640 1 -- 172.21.15.72:0/2770991758 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010030840 con 0x7fd01806eb40 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.994+0000 7fd01559a640 1 -- 172.21.15.72:0/2770991758 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0100309a0 con 0x7fd01806eb40 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.994+0000 7fd01559a640 1 -- 172.21.15.72:0/2770991758 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd010030d30 con 0x7fd01806eb40 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 -- 172.21.15.72:0/2770991758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01806eb40 msgr2=0x7fd0180cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 --2- 172.21.15.72:0/2770991758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01806eb40 0x7fd0180cd1a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd010009870 tx=0x7fd01002b980 comp rx=0 tx=0).stop 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 -- 172.21.15.72:0/2770991758 shutdown_connections 2024-03-24T10:37:33.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 --2- 172.21.15.72:0/2770991758 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd01806eb40 0x7fd0180cd1a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 --2- 172.21.15.72:0/2770991758 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:33.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 -- 172.21.15.72:0/2770991758 >> 172.21.15.72:0/2770991758 conn(0x7fd0180b1810 msgr2=0x7fd0180b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:33.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 -- 172.21.15.72:0/2770991758 shutdown_connections 2024-03-24T10:37:33.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.995+0000 7fd01ca39640 1 -- 172.21.15.72:0/2770991758 wait complete. 2024-03-24T10:37:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.996+0000 7fd01ca39640 1 Processor -- start 2024-03-24T10:37:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.996+0000 7fd01ca39640 1 -- start start 2024-03-24T10:37:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01ca39640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01806eb40 0x7fd01815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:33.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01ca39640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 0x7fd01806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01ca39640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01806d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01ca39640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd01815be50 con 0x7fd0180b3f30 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01ca39640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd01815c130 con 0x7fd01806eb40 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01ca39640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd01815c410 con 0x7fd01815aee0 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 0x7fd01806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 0x7fd01806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59086/0 (socket says 172.21.15.72:59086) 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 -- 172.21.15.72:0/1580581648 learned_addr learned my addr 172.21.15.72:0/1580581648 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd01659c640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01806eb40 0x7fd01815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd016d9d640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 -- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 msgr2=0x7fd01806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01806d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 -- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01806eb40 msgr2=0x7fd01815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01806eb40 0x7fd01815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.000 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 -- 172.21.15.72:0/1580581648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0100094d0 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.997+0000 7fd015d9b640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 0x7fd01806d320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c400 tx=0x7fd00c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.998+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c0052d0 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.998+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c005450 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.998+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd01815c6f0 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.998+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c007260 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.998+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd01815d430 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.999+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd01815cc10 con 0x7fd0180b3f30 2024-03-24T10:37:34.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.999+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd00c0073c0 con 0x7fd0180b3f30 2024-03-24T10:37:34.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:33.999+0000 7fd006ffd640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcff806b810 0x7fcff806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.000+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd00c0893b0 con 0x7fd0180b3f30 2024-03-24T10:37:34.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.000+0000 7fd01659c640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcff806b810 0x7fcff806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.000+0000 7fd01659c640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcff806b810 0x7fcff806dcd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd008009fd0 tx=0x7fd008009800 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.004+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd01815cc10 con 0x7fd0180b3f30 2024-03-24T10:37:34.241 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.241+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7fd01815cc10 con 0x7fd0180b3f30 2024-03-24T10:37:34.243 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.243+0000 7fd006ffd640 1 -- 172.21.15.72:0/1580581648 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fd01815cc10 con 0x7fd0180b3f30 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcff806b810 msgr2=0x7fcff806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcff806b810 0x7fcff806dcd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd008009fd0 tx=0x7fd008009800 comp rx=0 tx=0).stop 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 msgr2=0x7fd01806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 0x7fd01806d320 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00c400 tx=0x7fd00c00c8c0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 shutdown_connections 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fcff806b810 0x7fcff806dcd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd01815aee0 0x7fd01806d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0180b3f30 0x7fd01806d320 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 --2- 172.21.15.72:0/1580581648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd01806eb40 0x7fd01815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 >> 172.21.15.72:0/1580581648 conn(0x7fd0180b1810 msgr2=0x7fd01806e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 shutdown_connections 2024-03-24T10:37:34.246 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.245+0000 7fd01ca39640 1 -- 172.21.15.72:0/1580581648 wait complete. 2024-03-24T10:37:34.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-24T10:37:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.357+0000 7f507dc6b640 1 Processor -- start 2024-03-24T10:37:34.358 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.357+0000 7f507dc6b640 1 -- start start 2024-03-24T10:37:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f507dc6b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f507815aee0 0x7f507815f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f507dc6b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f507806eb40 0x7f50780cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f507dc6b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507815f8a0 con 0x7f50780b3f30 2024-03-24T10:37:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f507dc6b640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f50780b2e90 con 0x7f507815aee0 2024-03-24T10:37:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f507dc6b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f50780b3170 con 0x7f507806eb40 2024-03-24T10:37:34.359 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f507815aee0 0x7f507815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f507815aee0 0x7f507815f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59094/0 (socket says 172.21.15.72:59094) 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 -- 172.21.15.72:0/4249151386 learned_addr learned my addr 172.21.15.72:0/4249151386 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f5077fff640 1 --2- 172.21.15.72:0/4249151386 >> v2:172.21.15.79:3300/0 conn(0x7f507806eb40 0x7f50780cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 -- 172.21.15.72:0/4249151386 >> v2:172.21.15.79:3300/0 conn(0x7f507806eb40 msgr2=0x7f50780cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 --2- 172.21.15.72:0/4249151386 >> v2:172.21.15.79:3300/0 conn(0x7f507806eb40 0x7f50780cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 -- 172.21.15.72:0/4249151386 >> v1:172.21.15.79:6789/0 conn(0x7f50780b3f30 legacy=0x7f507806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:34.360 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.358+0000 7f50777fe640 1 -- 172.21.15.72:0/4249151386 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50780b3450 con 0x7f507815aee0 2024-03-24T10:37:34.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.359+0000 7f50777fe640 1 --2- 172.21.15.72:0/4249151386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815f360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f507806f180 tx=0x7f506802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ec1d24f52db527 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.359+0000 7f50767fc640 1 -- 172.21.15.72:0/4249151386 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068031870 con 0x7f507815aee0 2024-03-24T10:37:34.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.359+0000 7f50767fc640 1 -- 172.21.15.72:0/4249151386 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50680319d0 con 0x7f507815aee0 2024-03-24T10:37:34.361 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.359+0000 7f50767fc640 1 -- 172.21.15.72:0/4249151386 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068031d60 con 0x7f507815aee0 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 -- 172.21.15.72:0/4249151386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 msgr2=0x7f507815f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 --2- 172.21.15.72:0/4249151386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815f360 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f507806f180 tx=0x7f506802b910 comp rx=0 tx=0).stop 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 -- 172.21.15.72:0/4249151386 shutdown_connections 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 --2- 172.21.15.72:0/4249151386 >> v2:172.21.15.79:3300/0 conn(0x7f507806eb40 0x7f50780cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 --2- 172.21.15.72:0/4249151386 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815f360 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 -- 172.21.15.72:0/4249151386 >> 172.21.15.72:0/4249151386 conn(0x7f50780b1810 msgr2=0x7f50780b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 -- 172.21.15.72:0/4249151386 shutdown_connections 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.360+0000 7f507dc6b640 1 -- 172.21.15.72:0/4249151386 wait complete. 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.361+0000 7f507dc6b640 1 Processor -- start 2024-03-24T10:37:34.362 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.361+0000 7f507dc6b640 1 -- start start 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f507dc6b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f507806eb40 0x7f507814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f507dc6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50780b3f30 0x7f507815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f507dc6b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f507dc6b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f50781f3e30 con 0x7f507815aee0 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f507dc6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f507815be30 con 0x7f50780b3f30 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f507dc6b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f507815c110 con 0x7f507806eb40 2024-03-24T10:37:34.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59108/0 (socket says 172.21.15.72:59108) 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 -- 172.21.15.72:0/703451000 learned_addr learned my addr 172.21.15.72:0/703451000 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f50777fe640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f507806eb40 0x7f507814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5076ffd640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50780b3f30 0x7f507815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 -- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f507806eb40 msgr2=0x7f507814b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f507806eb40 0x7f507814b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 -- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50780b3f30 msgr2=0x7f507815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50780b3f30 0x7f507815b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 -- 172.21.15.72:0/703451000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50680094d0 con 0x7f507815aee0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5076ffd640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50780b3f30 0x7f507815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f50777fe640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f507806eb40 0x7f507814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.362+0000 7f5077fff640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815b800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5070007d90 tx=0x7f507000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.363+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070014420 con 0x7f507815aee0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.363+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50700145a0 con 0x7f507815aee0 2024-03-24T10:37:34.368 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.363+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f507815c3f0 con 0x7f507815aee0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.363+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5070014950 con 0x7f507815aee0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.363+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f507815c9b0 con 0x7f507815aee0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.364+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f507815cba0 con 0x7f507815aee0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.364+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5070014ab0 con 0x7f507815aee0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.365+0000 7f505ffff640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f506406b810 0x7f506406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.365+0000 7f50777fe640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f506406b810 0x7f506406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.365+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f507008a950 con 0x7f507815aee0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.365+0000 7f50777fe640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f506406b810 0x7f506406dcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5068036000 tx=0x7f506803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.369 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.369+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5070055530 con 0x7f507815aee0 2024-03-24T10:37:34.606 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.606+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f5078073d50 con 0x7f507815aee0 2024-03-24T10:37:34.608 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.608+0000 7f505ffff640 1 -- 172.21.15.72:0/703451000 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f5070058bf0 con 0x7f507815aee0 2024-03-24T10:37:34.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f506406b810 msgr2=0x7f506406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f506406b810 0x7f506406dcd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5068036000 tx=0x7f506803c040 comp rx=0 tx=0).stop 2024-03-24T10:37:34.610 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 msgr2=0x7f507815b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815b800 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5070007d90 tx=0x7f507000e4b0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 shutdown_connections 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f506406b810 0x7f506406dcd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f507815aee0 0x7f507815b800 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f50780b3f30 0x7f507815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 --2- 172.21.15.72:0/703451000 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f507806eb40 0x7f507814b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 >> 172.21.15.72:0/703451000 conn(0x7f50780b1810 msgr2=0x7f50780ae620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 shutdown_connections 2024-03-24T10:37:34.611 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.610+0000 7f507dc6b640 1 -- 172.21.15.72:0/703451000 wait complete. 2024-03-24T10:37:34.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-24T10:37:34.722 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.722+0000 7fad7ba8f640 1 Processor -- start 2024-03-24T10:37:34.723 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.722+0000 7fad7ba8f640 1 -- start start 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7ba8f640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fad74158170 0x7fad740716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7ba8f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 0x7fad7406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7ba8f640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad74071d00 con 0x7fad7406d860 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7ba8f640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fad740b31e0 con 0x7fad74158170 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7ba8f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fad740b34c0 con 0x7fad740cf430 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7a02c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fad7406d860 0x7fad740b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48178/0 (socket says 172.21.15.72:48178) 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7a02c640 1 -- 172.21.15.72:0/3550744967 learned_addr learned my addr 172.21.15.72:0/3550744967 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7982b640 1 --2- 172.21.15.72:0/3550744967 >> v2:172.21.15.79:3300/0 conn(0x7fad74158170 0x7fad740716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7902a640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 0x7fad7406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98648851 0 0) 0x7fad74071d00 con 0x7fad7406d860 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad60003440 con 0x7fad7406d860 2024-03-24T10:37:34.727 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3606976507 0 0) 0x7fad60003440 con 0x7fad7406d860 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 msgr2=0x7fad7406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 0x7fad7406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 >> v2:172.21.15.79:3300/0 conn(0x7fad74158170 msgr2=0x7fad740716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 --2- 172.21.15.72:0/3550744967 >> v2:172.21.15.79:3300/0 conn(0x7fad74158170 0x7fad740716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad740b37a0 con 0x7fad7406d860 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7fad6c0019f0 con 0x7fad7406d860 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 >> v1:172.21.15.72:6789/0 conn(0x7fad7406d860 legacy=0x7fad740b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad60003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad60008850 0x7fad6000ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 0x7fad6000d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad740b31e0 con 0x7fad60003a60 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad740b34c0 con 0x7fad60008850 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fad6000db10 con 0x7fad740cf430 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.723+0000 7fad7982b640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad60003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.728 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7902a640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad60008850 0x7fad6000ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7a02c640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 0x7fad6000d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7982b640 1 -- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 msgr2=0x7fad6000d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7982b640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad740cf430 0x7fad6000d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7982b640 1 -- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad60008850 msgr2=0x7fad6000ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7982b640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad60008850 0x7fad6000ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7982b640 1 -- 172.21.15.72:0/3550744967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad60003440 con 0x7fad60003a60 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.724+0000 7fad7982b640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad60003e80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fad70009ac0 tx=0x7fad600036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c92c00ebab54b6d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7002c710 con 0x7fad60003a60 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7002c870 con 0x7fad60003a60 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad78829640 1 -- 172.21.15.72:0/3550744967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7002cc00 con 0x7fad60003a60 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7ba8f640 1 -- 172.21.15.72:0/3550744967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 msgr2=0x7fad60003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/3550744967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad60003e80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fad70009ac0 tx=0x7fad600036f0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7a02c640 1 -- 172.21.15.72:0/3550744967 reap_dead start 2024-03-24T10:37:34.729 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7ba8f640 1 -- 172.21.15.72:0/3550744967 shutdown_connections 2024-03-24T10:37:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7ba8f640 1 -- 172.21.15.72:0/3550744967 >> 172.21.15.72:0/3550744967 conn(0x7fad740b1810 msgr2=0x7fad740b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7ba8f640 1 -- 172.21.15.72:0/3550744967 shutdown_connections 2024-03-24T10:37:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.725+0000 7fad7ba8f640 1 -- 172.21.15.72:0/3550744967 wait complete. 2024-03-24T10:37:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.726+0000 7fad7ba8f640 1 Processor -- start 2024-03-24T10:37:34.730 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.726+0000 7fad7ba8f640 1 -- start start 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7ba8f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad7413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7ba8f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad740cdd00 0x7fad740ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7ba8f640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad74159100 0x7fad74159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7ba8f640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fad74142640 con 0x7fad60003a60 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7ba8f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad74159aa0 con 0x7fad740cdd00 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7ba8f640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fad741419c0 con 0x7fad74159100 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad7413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad7413ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59138/0 (socket says 172.21.15.72:59138) 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 -- 172.21.15.72:0/202686604 learned_addr learned my addr 172.21.15.72:0/202686604 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:34.732 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 -- 172.21.15.72:0/202686604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad74159100 msgr2=0x7fad74159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad74159100 0x7fad74159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 -- 172.21.15.72:0/202686604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad740cdd00 msgr2=0x7fad740ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad740cdd00 0x7fad740ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.727+0000 7fad7982b640 1 -- 172.21.15.72:0/202686604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad74141ca0 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.728+0000 7fad7982b640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad7413ee90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad70037040 tx=0x7fad70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.728+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70003810 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.728+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad7002de90 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.728+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad74141f80 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.728+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad70003b90 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.728+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad7413f3d0 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.729+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad74073d50 con 0x7fad60003a60 2024-03-24T10:37:34.733 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.729+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fad70003cf0 con 0x7fad60003a60 2024-03-24T10:37:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.730+0000 7fad6a7fc640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad5806b810 0x7fad5806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.730+0000 7fad7902a640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad5806b810 0x7fad5806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.730+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fad700abe70 con 0x7fad60003a60 2024-03-24T10:37:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.730+0000 7fad7902a640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad5806b810 0x7fad5806dcd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad74154bc0 tx=0x7fad64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:34.734 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.734+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fad70076b90 con 0x7fad60003a60 2024-03-24T10:37:34.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.975+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fad740b2f20 con 0x7fad60003a60 2024-03-24T10:37:34.977 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.977+0000 7fad6a7fc640 1 -- 172.21.15.72:0/202686604 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) ==== 97+0+0 (secure 0 0 0) 0x7fad7004c0a0 con 0x7fad60003a60 2024-03-24T10:37:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad5806b810 msgr2=0x7fad5806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad5806b810 0x7fad5806dcd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad74154bc0 tx=0x7fad64008040 comp rx=0 tx=0).stop 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 msgr2=0x7fad7413ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad7413ee90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad70037040 tx=0x7fad70004730 comp rx=0 tx=0).stop 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 shutdown_connections 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fad5806b810 0x7fad5806dcd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fad74159100 0x7fad74159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad740cdd00 0x7fad740ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 --2- 172.21.15.72:0/202686604 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fad60003a60 0x7fad7413ee90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 >> 172.21.15.72:0/202686604 conn(0x7fad740b1810 msgr2=0x7fad7415e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 shutdown_connections 2024-03-24T10:37:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:34.980+0000 7fad7ba8f640 1 -- 172.21.15.72:0/202686604 wait complete. 2024-03-24T10:37:34.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-24T10:37:35.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.091+0000 7f33ac607640 1 Processor -- start 2024-03-24T10:37:35.092 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.091+0000 7f33ac607640 1 -- start start 2024-03-24T10:37:35.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.092+0000 7f33ac607640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33a40b3f30 0x7f33a406e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.092+0000 7f33ac607640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.092+0000 7f33ac607640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a40b2e90 con 0x7f33a415aee0 2024-03-24T10:37:35.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.092+0000 7f33ac607640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f33a406ede0 con 0x7f33a40b3f30 2024-03-24T10:37:35.097 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.092+0000 7f33ac607640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f33a40b3170 con 0x7f33a406e970 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33a40b3f30 0x7f33a406e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33aaba4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f33a40b3f30 0x7f33a406e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47166/0 (socket says 172.21.15.72:47166) 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 -- 172.21.15.72:0/696279349 learned_addr learned my addr 172.21.15.72:0/696279349 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 -- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 msgr2=0x7f33a40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 --2- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a40cd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.098 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 -- 172.21.15.72:0/696279349 >> v1:172.21.15.79:6789/0 conn(0x7f33a415aee0 legacy=0x7f33a415f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33a9ba2640 1 -- 172.21.15.72:0/696279349 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a40b3450 con 0x7f33a40b3f30 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.093+0000 7f33aaba4640 1 --2- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.094+0000 7f33a9ba2640 1 --2- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a406e430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3394009870 tx=0x7f339402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a547be1d7d2df2d server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.094+0000 7f33a93a1640 1 -- 172.21.15.72:0/696279349 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394030840 con 0x7f33a40b3f30 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.094+0000 7f33a93a1640 1 -- 172.21.15.72:0/696279349 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33940309a0 con 0x7f33a40b3f30 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.094+0000 7f33a93a1640 1 -- 172.21.15.72:0/696279349 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394030d30 con 0x7f33a40b3f30 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 -- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 msgr2=0x7f33a406e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 --2- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a406e430 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3394009870 tx=0x7f339402b980 comp rx=0 tx=0).stop 2024-03-24T10:37:35.099 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 -- 172.21.15.72:0/696279349 shutdown_connections 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 --2- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 --2- 172.21.15.72:0/696279349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a406e430 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 -- 172.21.15.72:0/696279349 >> 172.21.15.72:0/696279349 conn(0x7f33a40b1810 msgr2=0x7f33a40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 -- 172.21.15.72:0/696279349 shutdown_connections 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.095+0000 7f33ac607640 1 -- 172.21.15.72:0/696279349 wait complete. 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.096+0000 7f33ac607640 1 Processor -- start 2024-03-24T10:37:35.100 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.096+0000 7f33ac607640 1 -- start start 2024-03-24T10:37:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33ac607640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33ac607640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a4159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33ac607640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 0x7f33a414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33ac607640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f33a414af20 con 0x7f33a415aee0 2024-03-24T10:37:35.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33ac607640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33a414c230 con 0x7f33a40b3f30 2024-03-24T10:37:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33ac607640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f33a414cd10 con 0x7f33a406e970 2024-03-24T10:37:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 0x7f33a414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 0x7f33a414a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59154/0 (socket says 172.21.15.72:59154) 2024-03-24T10:37:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 -- 172.21.15.72:0/2278193200 learned_addr learned my addr 172.21.15.72:0/2278193200 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aa3a3640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33a9ba2640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a4159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 -- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 msgr2=0x7f33a414bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a414bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 -- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 msgr2=0x7f33a4159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a4159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 -- 172.21.15.72:0/2278193200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a0009400 con 0x7f33a415aee0 2024-03-24T10:37:35.108 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33a9ba2640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a4159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:35.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f33aaba4640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 0x7f33a414a0b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f33a0010a90 tx=0x7f33a0010f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.097+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a0009650 con 0x7f33a415aee0 2024-03-24T10:37:35.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.098+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a0004020 con 0x7f33a415aee0 2024-03-24T10:37:35.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.098+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33940094d0 con 0x7f33a415aee0 2024-03-24T10:37:35.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.098+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a00043d0 con 0x7f33a415aee0 2024-03-24T10:37:35.109 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.098+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a414c470 con 0x7f33a415aee0 2024-03-24T10:37:35.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.099+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a4157100 con 0x7f33a415aee0 2024-03-24T10:37:35.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.099+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f33a0003610 con 0x7f33a415aee0 2024-03-24T10:37:35.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.099+0000 7f339affd640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f338806b810 0x7f338806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.100+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f33a008c440 con 0x7f33a415aee0 2024-03-24T10:37:35.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.100+0000 7f33aa3a3640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f338806b810 0x7f338806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.100+0000 7f33aa3a3640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f338806b810 0x7f338806dcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f339c001ca0 tx=0x7f339c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.104+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f33a0057030 con 0x7f33a415aee0 2024-03-24T10:37:35.343 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.342+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f33a4073d50 con 0x7f33a415aee0 2024-03-24T10:37:35.344 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.344+0000 7f339affd640 1 -- 172.21.15.72:0/2278193200 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f33a005a6f0 con 0x7f33a415aee0 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f338806b810 msgr2=0x7f338806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f338806b810 0x7f338806dcd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f339c001ca0 tx=0x7f339c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 msgr2=0x7f33a414a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 0x7f33a414a0b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f33a0010a90 tx=0x7f33a0010f50 comp rx=0 tx=0).stop 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 shutdown_connections 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f338806b810 0x7f338806dcd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a415aee0 0x7f33a414a0b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33a40b3f30 0x7f33a4159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 --2- 172.21.15.72:0/2278193200 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f33a406e970 0x7f33a414bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.347 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 >> 172.21.15.72:0/2278193200 conn(0x7f33a40b1810 msgr2=0x7f33a41556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 shutdown_connections 2024-03-24T10:37:35.348 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.346+0000 7f33ac607640 1 -- 172.21.15.72:0/2278193200 wait complete. 2024-03-24T10:37:35.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.457+0000 7f4b8969d640 1 Processor -- start 2024-03-24T10:37:35.458 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.457+0000 7f4b8969d640 1 -- start start 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b8969d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b8415ae80 0x7f4b8406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b8969d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f4b84071550 0x7f4b840ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b8969d640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b840725b0 con 0x7f4b8406e680 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b8969d640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f4b84071a10 con 0x7f4b8415ae80 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b8969d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f4b8415b260 con 0x7f4b84071550 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b8415ae80 0x7f4b8406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4b8415ae80 0x7f4b8406cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59156/0 (socket says 172.21.15.72:59156) 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 -- 172.21.15.72:0/1531365513 learned_addr learned my addr 172.21.15.72:0/1531365513 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 -- 172.21.15.72:0/1531365513 >> v2:172.21.15.79:3300/0 conn(0x7f4b84071550 msgr2=0x7f4b840ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b837fe640 1 --2- 172.21.15.72:0/1531365513 >> v2:172.21.15.79:3300/0 conn(0x7f4b84071550 0x7f4b840ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.460 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 --2- 172.21.15.72:0/1531365513 >> v2:172.21.15.79:3300/0 conn(0x7f4b84071550 0x7f4b840ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 -- 172.21.15.72:0/1531365513 >> v1:172.21.15.79:6789/0 conn(0x7f4b8406e680 legacy=0x7f4b84070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.458+0000 7f4b82ffd640 1 -- 172.21.15.72:0/1531365513 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b84071c80 con 0x7f4b8415ae80 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.459+0000 7f4b837fe640 1 --2- 172.21.15.72:0/1531365513 >> v2:172.21.15.79:3300/0 conn(0x7f4b84071550 0x7f4b840ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.459+0000 7f4b82ffd640 1 --2- 172.21.15.72:0/1531365513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8415ae80 0x7f4b8406cce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b8406c870 tx=0x7f4b7402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ab08b992e7cb06 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.459+0000 7f4b81ffb640 1 -- 172.21.15.72:0/1531365513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74031890 con 0x7f4b8415ae80 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.459+0000 7f4b81ffb640 1 -- 172.21.15.72:0/1531365513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b740319f0 con 0x7f4b8415ae80 2024-03-24T10:37:35.461 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.459+0000 7f4b81ffb640 1 -- 172.21.15.72:0/1531365513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74031d80 con 0x7f4b8415ae80 2024-03-24T10:37:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 -- 172.21.15.72:0/1531365513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8415ae80 msgr2=0x7f4b8406cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 --2- 172.21.15.72:0/1531365513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8415ae80 0x7f4b8406cce0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4b8406c870 tx=0x7f4b7402b930 comp rx=0 tx=0).stop 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 -- 172.21.15.72:0/1531365513 shutdown_connections 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 --2- 172.21.15.72:0/1531365513 >> v2:172.21.15.79:3300/0 conn(0x7f4b84071550 0x7f4b840ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 --2- 172.21.15.72:0/1531365513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8415ae80 0x7f4b8406cce0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 -- 172.21.15.72:0/1531365513 >> 172.21.15.72:0/1531365513 conn(0x7f4b840b1920 msgr2=0x7f4b840b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 -- 172.21.15.72:0/1531365513 shutdown_connections 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.460+0000 7f4b8969d640 1 -- 172.21.15.72:0/1531365513 wait complete. 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.461+0000 7f4b8969d640 1 Processor -- start 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.461+0000 7f4b8969d640 1 -- start start 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b8969d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 0x7f4b840cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b8969d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b84071550 0x7f4b8406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b8969d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b8415ae80 0x7f4b8406dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b8969d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4b840c96b0 con 0x7f4b8406e680 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b8969d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4b840cf620 con 0x7f4b84071550 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b8969d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f4b840c9900 con 0x7f4b8415ae80 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 0x7f4b840cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 0x7f4b840cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59168/0 (socket says 172.21.15.72:59168) 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 -- 172.21.15.72:0/628512897 learned_addr learned my addr 172.21.15.72:0/628512897 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b837fe640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b8415ae80 0x7f4b8406dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b827fc640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b84071550 0x7f4b8406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 -- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b8415ae80 msgr2=0x7f4b8406dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b8415ae80 0x7f4b8406dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 -- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b84071550 msgr2=0x7f4b8406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b84071550 0x7f4b8406d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b82ffd640 1 -- 172.21.15.72:0/628512897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b740094d0 con 0x7f4b8406e680 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b837fe640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b8415ae80 0x7f4b8406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.462+0000 7f4b827fc640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b84071550 0x7f4b8406d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.463+0000 7f4b82ffd640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 0x7f4b840cf0e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b74000c00 tx=0x7f4b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.463+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7403ad30 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.463+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b7403ae90 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.463+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b840c9be0 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.463+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74044630 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.463+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b840ca1a0 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.464+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b840c9a40 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.464+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f4b7404d450 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.465+0000 7f4b6b7fe640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4b7006b840 0x7f4b7006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.465+0000 7f4b827fc640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4b7006b840 0x7f4b7006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.465+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f4b740ac7f0 con 0x7f4b8406e680 2024-03-24T10:37:35.469 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.465+0000 7f4b827fc640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4b7006b840 0x7f4b7006dd00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b84138fc0 tx=0x7f4b78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.470 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.469+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4b840c9a40 con 0x7f4b8406e680 2024-03-24T10:37:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.639+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b840c9a40 con 0x7f4b8406e680 2024-03-24T10:37:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.640+0000 7f4b6b7fe640 1 -- 172.21.15.72:0/628512897 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13128 (secure 0 0 0) 0x7f4b840c9a40 con 0x7f4b8406e680 2024-03-24T10:37:35.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:35.641 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":35,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:32.783592+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4b7006b840 msgr2=0x7f4b7006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4b7006b840 0x7f4b7006dd00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4b84138fc0 tx=0x7f4b78009040 comp rx=0 tx=0).stop 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 msgr2=0x7f4b840cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 0x7f4b840cf0e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4b74000c00 tx=0x7f4b740046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 shutdown_connections 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f4b7006b840 0x7f4b7006dd00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f4b8415ae80 0x7f4b8406dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4b84071550 0x7f4b8406d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 --2- 172.21.15.72:0/628512897 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b8406e680 0x7f4b840cf0e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 >> 172.21.15.72:0/628512897 conn(0x7f4b840b1920 msgr2=0x7f4b840b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:35.643 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 shutdown_connections 2024-03-24T10:37:35.644 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.642+0000 7f4b8969d640 1 -- 172.21.15.72:0/628512897 wait complete. 2024-03-24T10:37:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-24T10:37:35.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T10:37:35.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 Processor -- start 2024-03-24T10:37:35.824 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 -- start start 2024-03-24T10:37:35.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9be40b3580 0x7f9be40cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.825 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9be4072470 0x7f9be415b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be4154ea0 con 0x7f9be40b3960 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9be415b9c0 con 0x7f9be40b3580 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.824+0000 7f9be9102640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9be4071460 con 0x7f9be4072470 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be2d9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9be40b3580 0x7f9be40cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be359e640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9be40b3960 0x7f9be415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48194/0 (socket says 172.21.15.72:48194) 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be359e640 1 -- 172.21.15.72:0/1613614984 learned_addr learned my addr 172.21.15.72:0/1613614984 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9bdbfff640 1 --2- 172.21.15.72:0/1613614984 >> v2:172.21.15.79:3300/0 conn(0x7f9be4072470 0x7f9be415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1613614984 >> v2:172.21.15.79:3300/0 conn(0x7f9be4072470 msgr2=0x7f9be415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be2d9d640 1 --2- 172.21.15.72:0/1613614984 >> v2:172.21.15.79:3300/0 conn(0x7f9be4072470 0x7f9be415b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1613614984 >> v1:172.21.15.72:6789/0 conn(0x7f9be40b3960 legacy=0x7f9be415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be259c640 1 -- 172.21.15.72:0/1613614984 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022696926 0 0) 0x7f9be4154ea0 con 0x7f9be40b3960 2024-03-24T10:37:35.826 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.825+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1613614984 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be4071fe0 con 0x7f9be40b3580 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be2d9d640 1 --2- 172.21.15.72:0/1613614984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be40b3580 0x7f9be40cf310 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b4eb0 tx=0x7f9bd402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1b50b52e34a2b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be259c640 1 -- 172.21.15.72:0/1613614984 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd402e070 con 0x7f9be40b3580 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be259c640 1 -- 172.21.15.72:0/1613614984 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd40315a0 con 0x7f9be40b3580 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be259c640 1 -- 172.21.15.72:0/1613614984 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4031930 con 0x7f9be40b3580 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 -- 172.21.15.72:0/1613614984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be40b3580 msgr2=0x7f9be40cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 --2- 172.21.15.72:0/1613614984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be40b3580 0x7f9be40cf310 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9be40b4eb0 tx=0x7f9bd402b840 comp rx=0 tx=0).stop 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 -- 172.21.15.72:0/1613614984 shutdown_connections 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 --2- 172.21.15.72:0/1613614984 >> v2:172.21.15.79:3300/0 conn(0x7f9be4072470 0x7f9be415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 --2- 172.21.15.72:0/1613614984 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be40b3580 0x7f9be40cf310 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.828 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 -- 172.21.15.72:0/1613614984 >> 172.21.15.72:0/1613614984 conn(0x7f9be40b1810 msgr2=0x7f9be40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:35.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 -- 172.21.15.72:0/1613614984 shutdown_connections 2024-03-24T10:37:35.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.826+0000 7f9be9102640 1 -- 172.21.15.72:0/1613614984 wait complete. 2024-03-24T10:37:35.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 Processor -- start 2024-03-24T10:37:35.829 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 -- start start 2024-03-24T10:37:35.830 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 0x7f9be406df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9be40b3580 0x7f9be40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be40b3960 0x7f9be41f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9be4141280 con 0x7f9be4072470 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9be413fbb0 con 0x7f9be40b3960 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be9102640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9be413fe90 con 0x7f9be40b3580 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be2d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 0x7f9be406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be2d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 0x7f9be406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59178/0 (socket says 172.21.15.72:59178) 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.828+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1229208572 learned_addr learned my addr 172.21.15.72:0/1229208572 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1229208572 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9be40b3580 msgr2=0x7f9be40cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be2d9d640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9be40b3580 0x7f9be40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1229208572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be40b3960 msgr2=0x7f9be41f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be2d9d640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be40b3960 0x7f9be41f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be2d9d640 1 -- 172.21.15.72:0/1229208572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd4009400 con 0x7f9be4072470 2024-03-24T10:37:35.831 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be2d9d640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 0x7f9be406df00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4000c00 tx=0x7f9bd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4032900 con 0x7f9be4072470 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd4032a80 con 0x7f9be4072470 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be4140170 con 0x7f9be4072470 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4032e30 con 0x7f9be4072470 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.829+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be4140730 con 0x7f9be4072470 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.830+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be404f470 con 0x7f9be4072470 2024-03-24T10:37:35.832 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.830+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9bd404d3f0 con 0x7f9be4072470 2024-03-24T10:37:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.831+0000 7f9bdb7fe640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9bc406b810 0x7f9bc406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.831+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9bd40abd10 con 0x7f9be4072470 2024-03-24T10:37:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.831+0000 7f9bdbfff640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9bc406b810 0x7f9bc406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.831+0000 7f9bdbfff640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9bc406b810 0x7f9bc406dcd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9be41414e0 tx=0x7f9bcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:35.835 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:35.835+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9bd4076980 con 0x7f9be4072470 2024-03-24T10:37:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.007+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9be40710e0 con 0x7f9be4072470 2024-03-24T10:37:36.008 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.008+0000 7f9bdb7fe640 1 -- 172.21.15.72:0/1229208572 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f9bd407a040 con 0x7f9be4072470 2024-03-24T10:37:36.008 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9bc406b810 msgr2=0x7f9bc406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9bc406b810 0x7f9bc406dcd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9be41414e0 tx=0x7f9bcc008040 comp rx=0 tx=0).stop 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 msgr2=0x7f9be406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 0x7f9be406df00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4000c00 tx=0x7f9bd40046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 shutdown_connections 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9bc406b810 0x7f9bc406dcd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9be40b3960 0x7f9be41f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9be40b3580 0x7f9be40cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 --2- 172.21.15.72:0/1229208572 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9be4072470 0x7f9be406df00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 >> 172.21.15.72:0/1229208572 conn(0x7f9be40b1810 msgr2=0x7f9be415c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 shutdown_connections 2024-03-24T10:37:36.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.009+0000 7f9be9102640 1 -- 172.21.15.72:0/1229208572 wait complete. 2024-03-24T10:37:36.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-24T10:37:36.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.121+0000 7f8d7aceb640 1 Processor -- start 2024-03-24T10:37:36.122 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.121+0000 7f8d7aceb640 1 -- start start 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.122+0000 7f8d7aceb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d741608c0 0x7f8d740d4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.122+0000 7f8d7aceb640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 0x7f8d740cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.122+0000 7f8d7aceb640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d740d2d40 con 0x7f8d740d08f0 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.122+0000 7f8d7aceb640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8d740b32d0 con 0x7f8d740d28e0 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.122+0000 7f8d7aceb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8d740cecd0 con 0x7f8d741608c0 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d78a87640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d741608c0 0x7f8d740d4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d73fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 0x7f8d740cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d73fff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 0x7f8d740cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47224/0 (socket says 172.21.15.72:47224) 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d73fff640 1 -- 172.21.15.72:0/3344421191 learned_addr learned my addr 172.21.15.72:0/3344421191 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d78a87640 1 -- 172.21.15.72:0/3344421191 >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 msgr2=0x7f8d740cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d78a87640 1 --2- 172.21.15.72:0/3344421191 >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 0x7f8d740cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d78a87640 1 -- 172.21.15.72:0/3344421191 >> v1:172.21.15.79:6789/0 conn(0x7f8d740d08f0 legacy=0x7f8d740b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d737fe640 1 -- 172.21.15.72:0/3344421191 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3661758768 0 0) 0x7f8d740d2d40 con 0x7f8d740d08f0 2024-03-24T10:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d78a87640 1 -- 172.21.15.72:0/3344421191 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d740cefb0 con 0x7f8d741608c0 2024-03-24T10:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.123+0000 7f8d73fff640 1 --2- 172.21.15.72:0/3344421191 >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 0x7f8d740cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d78a87640 1 --2- 172.21.15.72:0/3344421191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d741608c0 0x7f8d740d4a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d640097a0 tx=0x7f8d6402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1f6078996fcf21a server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d737fe640 1 -- 172.21.15.72:0/3344421191 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6402e070 con 0x7f8d741608c0 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d737fe640 1 -- 172.21.15.72:0/3344421191 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d640315a0 con 0x7f8d741608c0 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d737fe640 1 -- 172.21.15.72:0/3344421191 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d64031930 con 0x7f8d741608c0 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3344421191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d741608c0 msgr2=0x7f8d740d4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3344421191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d741608c0 0x7f8d740d4a80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d640097a0 tx=0x7f8d6402b840 comp rx=0 tx=0).stop 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.124+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3344421191 shutdown_connections 2024-03-24T10:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.125+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3344421191 >> v2:172.21.15.79:3300/0 conn(0x7f8d740d28e0 0x7f8d740cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.125+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3344421191 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d741608c0 0x7f8d740d4a80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.125+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3344421191 >> 172.21.15.72:0/3344421191 conn(0x7f8d7409d300 msgr2=0x7f8d740d3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.125+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3344421191 shutdown_connections 2024-03-24T10:37:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.125+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3344421191 wait complete. 2024-03-24T10:37:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.126+0000 7f8d7aceb640 1 Processor -- start 2024-03-24T10:37:36.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.126+0000 7f8d7aceb640 1 -- start start 2024-03-24T10:37:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.126+0000 7f8d7aceb640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d740d08f0 0x7f8d74150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.126+0000 7f8d7aceb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740d28e0 0x7f8d740b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.130 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d7aceb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 0x7f8d740b7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d7aceb640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d740b70b0 con 0x7f8d741608c0 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d7aceb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d740b64a0 con 0x7f8d740d28e0 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d7aceb640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8d740b6780 con 0x7f8d740d08f0 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 0x7f8d740b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 0x7f8d740b7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59186/0 (socket says 172.21.15.72:59186) 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 -- 172.21.15.72:0/3308666269 learned_addr learned my addr 172.21.15.72:0/3308666269 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d78a87640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d740d08f0 0x7f8d74150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d73fff640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740d28e0 0x7f8d740b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 -- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d740d08f0 msgr2=0x7f8d74150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d740d08f0 0x7f8d74150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 -- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740d28e0 msgr2=0x7f8d740b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.131 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740d28e0 0x7f8d740b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 -- 172.21.15.72:0/3308666269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d680094d0 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d79288640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 0x7f8d740b7420 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c780 tx=0x7f8d6c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003b70 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d6c003cd0 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c005270 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d64009400 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.127+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d740b6d40 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.128+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d740b7220 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.129+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8d6c0053d0 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.129+0000 7f8d717fa640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d6006b840 0x7f8d6006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.129+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f8d6c089e10 con 0x7f8d741608c0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.129+0000 7f8d78a87640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d6006b840 0x7f8d6006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.130+0000 7f8d78a87640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d6006b840 0x7f8d6006dd00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d64036000 tx=0x7f8d64008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:36.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.134+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8d6c054960 con 0x7f8d741608c0 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.306+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8d74073d50 con 0x7f8d741608c0 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.307+0000 7f8d717fa640 1 -- 172.21.15.72:0/3308666269 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f8d6c058020 con 0x7f8d741608c0 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2024-03-24T10:37:36.307 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2024-03-24T10:37:36.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2024-03-24T10:37:36.308 INFO:teuthology.orchestra.run.smithi072.stdout:] 2024-03-24T10:37:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d6006b840 msgr2=0x7f8d6006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d6006b840 0x7f8d6006dd00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8d64036000 tx=0x7f8d64008030 comp rx=0 tx=0).stop 2024-03-24T10:37:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 msgr2=0x7f8d740b7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 0x7f8d740b7420 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00c780 tx=0x7f8d6c00cb80 comp rx=0 tx=0).stop 2024-03-24T10:37:36.309 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 shutdown_connections 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8d6006b840 0x7f8d6006dd00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d741608c0 0x7f8d740b7420 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d740d28e0 0x7f8d740b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 --2- 172.21.15.72:0/3308666269 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d740d08f0 0x7f8d74150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.308+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 >> 172.21.15.72:0/3308666269 conn(0x7f8d7409d300 msgr2=0x7f8d740ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.309+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 shutdown_connections 2024-03-24T10:37:36.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.309+0000 7f8d7aceb640 1 -- 172.21.15.72:0/3308666269 wait complete. 2024-03-24T10:37:36.320 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-24T10:37:36.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-24T10:37:36.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.423+0000 7fafbb943640 1 Processor -- start 2024-03-24T10:37:36.423 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.423+0000 7fafbb943640 1 -- start start 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafbb943640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafb4070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafbb943640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb40b40c0 con 0x7fafb40b3010 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafbb943640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb40b34b0 con 0x7fafb415af10 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafbb943640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fafb40b3790 con 0x7fafb40b2bb0 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafb9ee0640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fafb40b3010 0x7fafb4150d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48196/0 (socket says 172.21.15.72:48196) 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafb9ee0640 1 -- 172.21.15.72:0/638071977 learned_addr learned my addr 172.21.15.72:0/638071977 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808428668 0 0) 0x7fafb40b40c0 con 0x7fafb40b3010 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafb8ede640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafb4070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.426 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa0003520 con 0x7fafb40b3010 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2355316037 0 0) 0x7fafa0003520 con 0x7fafb40b3010 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 msgr2=0x7fafb4070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafb4070fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 >> v1:172.21.15.79:6789/0 conn(0x7fafb415af10 legacy=0x7fafb415b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb40b3a70 con 0x7fafb40b3010 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7fafac0019f0 con 0x7fafb40b3010 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 >> v1:172.21.15.72:6789/0 conn(0x7fafb40b3010 legacy=0x7fafb4150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafa00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafa00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafa0004d00 0x7fafa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fafb40b3790 con 0x7fafa0003f20 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fafa000ba60 con 0x7fafa0004d00 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fafa000bc20 con 0x7fafb40b2bb0 2024-03-24T10:37:36.427 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafb8ede640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafa00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.424+0000 7fafb96df640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafa00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb9ee0640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafa0004d00 0x7fafa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb8ede640 1 -- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 msgr2=0x7fafa00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb8ede640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafa00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb8ede640 1 -- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafa0004d00 msgr2=0x7fafa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb8ede640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafa0004d00 0x7fafa0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb8ede640 1 -- 172.21.15.72:0/638071977 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa0003520 con 0x7fafa0003f20 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb96df640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb40b2bb0 0x7fafa00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafb8ede640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafa00047c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009ac0 tx=0x7fafa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6500c03a95274f server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.425+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa402c6b0 con 0x7fafa0003f20 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa402c810 con 0x7fafa0003f20 2024-03-24T10:37:36.428 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafabfff640 1 -- 172.21.15.72:0/638071977 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa402cba0 con 0x7fafa0003f20 2024-03-24T10:37:36.438 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafbb943640 1 -- 172.21.15.72:0/638071977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 msgr2=0x7fafa00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafbb943640 1 --2- 172.21.15.72:0/638071977 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafa00047c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fafa4009ac0 tx=0x7fafa00057f0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafb9ee0640 1 -- 172.21.15.72:0/638071977 reap_dead start 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafbb943640 1 -- 172.21.15.72:0/638071977 shutdown_connections 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafbb943640 1 -- 172.21.15.72:0/638071977 >> 172.21.15.72:0/638071977 conn(0x7fafb40b18b0 msgr2=0x7fafb40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafbb943640 1 -- 172.21.15.72:0/638071977 shutdown_connections 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.426+0000 7fafbb943640 1 -- 172.21.15.72:0/638071977 wait complete. 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.427+0000 7fafbb943640 1 Processor -- start 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.427+0000 7fafbb943640 1 -- start start 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafbb943640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafb414ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafbb943640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb414f240 0x7fafb4162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafbb943640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb409d690 0x7fafb41628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.439 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafbb943640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fafb4154fe0 con 0x7fafa0003f20 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafbb943640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fafb409adf0 con 0x7fafb409d690 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafbb943640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fafb409b0d0 con 0x7fafb414f240 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafb414ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafb414ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59190/0 (socket says 172.21.15.72:59190) 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 -- 172.21.15.72:0/19545343 learned_addr learned my addr 172.21.15.72:0/19545343 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb8ede640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb414f240 0x7fafb4162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb9ee0640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb409d690 0x7fafb41628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 -- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb414f240 msgr2=0x7fafb4162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb414f240 0x7fafb4162370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 -- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb409d690 msgr2=0x7fafb41628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb409d690 0x7fafb41628b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb96df640 1 -- 172.21.15.72:0/19545343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb409b3b0 con 0x7fafa0003f20 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.428+0000 7fafb9ee0640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb409d690 0x7fafb41628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:36.440 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.429+0000 7fafb96df640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafb414ed00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fafb000e600 tx=0x7fafb000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.429+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00052e0 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.429+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0005440 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.429+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb4152d00 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.429+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb00037f0 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.429+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb409a9d0 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.430+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb409abc0 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.430+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fafb0003950 con 0x7fafa0003f20 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.431+0000 7fafa9ffb640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf9806b810 0x7faf9806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.431+0000 7fafb8ede640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf9806b810 0x7faf9806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:36.441 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.431+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fafb0089df0 con 0x7fafa0003f20 2024-03-24T10:37:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.431+0000 7fafb8ede640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf9806b810 0x7faf9806dcd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafa4036000 tx=0x7fafa4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:36.442 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.435+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fafb00549d0 con 0x7fafa0003f20 2024-03-24T10:37:36.605 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.604+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fafb409e080 con 0x7fafa0003f20 2024-03-24T10:37:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.885+0000 7fafa9ffb640 1 -- 172.21.15.72:0/19545343 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7fafb0058090 con 0x7fafa0003f20 2024-03-24T10:37:36.886 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2024-03-24T10:37:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf9806b810 msgr2=0x7faf9806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf9806b810 0x7faf9806dcd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fafa4036000 tx=0x7fafa4030000 comp rx=0 tx=0).stop 2024-03-24T10:37:36.889 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 msgr2=0x7fafb414ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafb414ed00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fafb000e600 tx=0x7fafb000eac0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 shutdown_connections 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7faf9806b810 0x7faf9806dcd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafb409d690 0x7fafb41628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fafb414f240 0x7fafb4162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 --2- 172.21.15.72:0/19545343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fafa0003f20 0x7fafb414ed00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 >> 172.21.15.72:0/19545343 conn(0x7fafb40b18b0 msgr2=0x7fafb4070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 shutdown_connections 2024-03-24T10:37:36.890 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:36.889+0000 7fafbb943640 1 -- 172.21.15.72:0/19545343 wait complete. 2024-03-24T10:37:36.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-24T10:37:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.009+0000 7f07eaf81640 1 Processor -- start 2024-03-24T10:37:37.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.009+0000 7f07eaf81640 1 -- start start 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.009+0000 7f07eaf81640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f07e41633b0 0x7f07e41657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.009+0000 7f07eaf81640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e40b3f90 con 0x7f07e406dc60 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.009+0000 7f07eaf81640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e40b2ef0 con 0x7f07e4151680 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.009+0000 7f07eaf81640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f07e40b31d0 con 0x7f07e41633b0 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e3fff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f07e406dc60 0x7f07e415b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48206/0 (socket says 172.21.15.72:48206) 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e3fff640 1 -- 172.21.15.72:0/1244113091 learned_addr learned my addr 172.21.15.72:0/1244113091 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944009371 0 0) 0x7f07e40b3f90 con 0x7f07e406dc60 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e951e640 1 --2- 172.21.15.72:0/1244113091 >> v2:172.21.15.79:3300/0 conn(0x7f07e41633b0 0x7f07e41657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07d4003520 con 0x7f07e406dc60 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 491714617 0 0) 0x7f07d4003520 con 0x7f07e406dc60 2024-03-24T10:37:37.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 >> v2:172.21.15.79:3300/0 conn(0x7f07e41633b0 msgr2=0x7f07e41657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 --2- 172.21.15.72:0/1244113091 >> v2:172.21.15.79:3300/0 conn(0x7f07e41633b0 0x7f07e41657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 >> v1:172.21.15.79:6789/0 conn(0x7f07e4151680 legacy=0x7f07e406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e40b34b0 con 0x7f07e406dc60 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1306926201 0 0) 0x7f07d0001670 con 0x7f07e406dc60 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 >> v1:172.21.15.72:6789/0 conn(0x7f07e406dc60 legacy=0x7f07e415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07d4003970 0x7f07d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40047c0 0x7f07d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07e40b31d0 con 0x7f07d4005180 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07d400c020 con 0x7f07d40047c0 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f07d400c1e0 con 0x7f07d4003970 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e951e640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e3fff640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40047c0 0x7f07d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.010+0000 7f07e8d1d640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07d4003970 0x7f07d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 -- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07d4003970 msgr2=0x7f07d4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07d4003970 0x7f07d4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 -- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40047c0 msgr2=0x7f07d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07d40047c0 0x7f07d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 -- 172.21.15.72:0/1244113091 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07d4003520 con 0x7f07d4005180 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e8d1d640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07d4003970 0x7f07d4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 -- 172.21.15.72:0/1244113091 reap_dead start 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.011+0000 7f07e951e640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07d400b980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009fc0 tx=0x7f07d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584a7bbca2dadccc server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc02cc60 con 0x7f07d4005180 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07dc00f040 con 0x7f07d4005180 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07e37fe640 1 -- 172.21.15.72:0/1244113091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07dc003990 con 0x7f07d4005180 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 -- 172.21.15.72:0/1244113091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 msgr2=0x7f07d400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07d400b980 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f07dc009fc0 tx=0x7f07d40057f0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.015 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 -- 172.21.15.72:0/1244113091 shutdown_connections 2024-03-24T10:37:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1244113091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07d400b980 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 -- 172.21.15.72:0/1244113091 >> 172.21.15.72:0/1244113091 conn(0x7f07e40b1810 msgr2=0x7f07e40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 -- 172.21.15.72:0/1244113091 shutdown_connections 2024-03-24T10:37:37.016 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.012+0000 7f07eaf81640 1 -- 172.21.15.72:0/1244113091 wait complete. 2024-03-24T10:37:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.013+0000 7f07eaf81640 1 Processor -- start 2024-03-24T10:37:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.013+0000 7f07eaf81640 1 -- start start 2024-03-24T10:37:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07eaf81640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07e4160c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.018 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07eaf81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e41460c0 0x7f07e415f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07eaf81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07e412ce30 0x7f07e4162390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07eaf81640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f07e415f810 con 0x7f07d4005180 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07eaf81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f07e412da50 con 0x7f07e41460c0 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07eaf81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f07e41612f0 con 0x7f07e412ce30 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07e8d1d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07e4160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07e8d1d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07e4160c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59200/0 (socket says 172.21.15.72:59200) 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07e8d1d640 1 -- 172.21.15.72:0/1276487065 learned_addr learned my addr 172.21.15.72:0/1276487065 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.014+0000 7f07e3fff640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e41460c0 0x7f07e415f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e8d1d640 1 -- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07e412ce30 msgr2=0x7f07e4162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e8d1d640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07e412ce30 0x7f07e4162390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e8d1d640 1 -- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e41460c0 msgr2=0x7f07e415f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e8d1d640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e41460c0 0x7f07e415f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e8d1d640 1 -- 172.21.15.72:0/1276487065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e41615d0 con 0x7f07d4005180 2024-03-24T10:37:37.019 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e8d1d640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07e4160c30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d800e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d80052e0 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07d8005440 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8003830 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e41618b0 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.015+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e4161e70 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.016+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e4162000 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.016+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f07d8003990 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.017+0000 7f07e17fa640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f07c806b810 0x7f07c806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.017+0000 7f07e3fff640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f07c806b810 0x7f07c806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.017+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f07d8089930 con 0x7f07d4005180 2024-03-24T10:37:37.020 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.017+0000 7f07e3fff640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f07c806b810 0x7f07c806dcd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07d0001050 tx=0x7f07d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:37.022 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.022+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f07d8054450 con 0x7f07d4005180 2024-03-24T10:37:37.193 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.193+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f07e404f470 con 0x7f07d4005180 2024-03-24T10:37:37.888 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.888+0000 7f07e17fa640 1 -- 172.21.15.72:0/1276487065 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f07d8019020 con 0x7f07d4005180 2024-03-24T10:37:37.889 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2024-03-24T10:37:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.893+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f07c806b810 msgr2=0x7f07c806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.893+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f07c806b810 0x7f07c806dcd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07d0001050 tx=0x7f07d0009040 comp rx=0 tx=0).stop 2024-03-24T10:37:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.893+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 msgr2=0x7f07e4160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:37.894 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.893+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07e4160c30 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f07d8000c00 tx=0x7f07d800e8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.896+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 shutdown_connections 2024-03-24T10:37:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.896+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f07c806b810 0x7f07c806dcd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.896+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f07e412ce30 0x7f07e4162390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.896+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f07e41460c0 0x7f07e415f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.896+0000 7f07eaf81640 1 --2- 172.21.15.72:0/1276487065 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07d4005180 0x7f07e4160c30 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:37.899 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.896+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 >> 172.21.15.72:0/1276487065 conn(0x7f07e40b1810 msgr2=0x7f07e4070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:37.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.901+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 shutdown_connections 2024-03-24T10:37:37.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:37.901+0000 7f07eaf81640 1 -- 172.21.15.72:0/1276487065 wait complete. 2024-03-24T10:37:37.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-24T10:37:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.027+0000 7fb6cb7c2640 1 Processor -- start 2024-03-24T10:37:38.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.027+0000 7fb6cb7c2640 1 -- start start 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6cb7c2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c4142490 0x7fb6c40b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6cb7c2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40ce8c0 0x7fb6c40cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6cb7c2640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6c40b2f80 con 0x7fb6c40b2b10 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6cb7c2640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb6c40b3210 con 0x7fb6c4142490 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6cb7c2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c40b34f0 con 0x7fb6c40ce8c0 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c4142490 0x7fb6c40b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6c4142490 0x7fb6c40b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59216/0 (socket says 172.21.15.72:59216) 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 -- 172.21.15.72:0/4142869557 learned_addr learned my addr 172.21.15.72:0/4142869557 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:38.029 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 -- 172.21.15.72:0/4142869557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40ce8c0 msgr2=0x7fb6c40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:38.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c9d5f640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40ce8c0 0x7fb6c40cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:38.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40ce8c0 0x7fb6c40cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 -- 172.21.15.72:0/4142869557 >> v1:172.21.15.79:6789/0 conn(0x7fb6c40b2b10 legacy=0x7fb6c40ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:38.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c955e640 1 -- 172.21.15.72:0/4142869557 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c40b37d0 con 0x7fb6c4142490 2024-03-24T10:37:38.030 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.028+0000 7fb6c9d5f640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40ce8c0 0x7fb6c40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-24T10:37:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.029+0000 7fb6c955e640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c40b42b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4070800 tx=0x7fb6c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93820c36300e1e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.029+0000 7fb6bbfff640 1 -- 172.21.15.72:0/4142869557 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0031830 con 0x7fb6c4142490 2024-03-24T10:37:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.029+0000 7fb6bbfff640 1 -- 172.21.15.72:0/4142869557 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0031990 con 0x7fb6c4142490 2024-03-24T10:37:38.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.029+0000 7fb6bbfff640 1 -- 172.21.15.72:0/4142869557 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0031d20 con 0x7fb6c4142490 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/4142869557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 msgr2=0x7fb6c40b42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c40b42b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4070800 tx=0x7fb6c002b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/4142869557 shutdown_connections 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40ce8c0 0x7fb6c40cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/4142869557 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c40b42b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/4142869557 >> 172.21.15.72:0/4142869557 conn(0x7fb6c40b1810 msgr2=0x7fb6c40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/4142869557 shutdown_connections 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.030+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/4142869557 wait complete. 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.031+0000 7fb6cb7c2640 1 Processor -- start 2024-03-24T10:37:38.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.031+0000 7fb6cb7c2640 1 -- start start 2024-03-24T10:37:38.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40b2b10 0x7fb6c4151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:38.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c40ce8c0 0x7fb6c41394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:38.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c4159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:38.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c415a8f0 con 0x7fb6c4142490 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c41399f0 con 0x7fb6c40ce8c0 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c40c4c20 con 0x7fb6c40b2b10 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c4159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c4159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59222/0 (socket says 172.21.15.72:59222) 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 -- 172.21.15.72:0/3020560926 learned_addr learned my addr 172.21.15.72:0/3020560926 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c8d5d640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c40ce8c0 0x7fb6c41394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c955e640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40b2b10 0x7fb6c4151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 -- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40b2b10 msgr2=0x7fb6c4151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40b2b10 0x7fb6c4151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 -- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c40ce8c0 msgr2=0x7fb6c41394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c40ce8c0 0x7fb6c41394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 -- 172.21.15.72:0/3020560926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c00094d0 con 0x7fb6c4142490 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6c9d5f640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c4159de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00cef0 tx=0x7fb6bc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:38.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00d840 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc00d9c0 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c415a610 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.032+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00dd70 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.033+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c40c51a0 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.034+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c40c4a80 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.034+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb6bc01f440 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.034+0000 7fb6b9ffb640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6a806b810 0x7fb6a806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.035+0000 7fb6c955e640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6a806b810 0x7fb6a806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.035+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7fb6bc08acf0 con 0x7fb6c4142490 2024-03-24T10:37:38.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.035+0000 7fb6c955e640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6a806b810 0x7fb6a806dcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0036000 tx=0x7fb6c003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:38.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.039+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb6c40c4a80 con 0x7fb6c4142490 2024-03-24T10:37:38.249 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.248+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb6c40c4a80 con 0x7fb6c4142490 2024-03-24T10:37:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.898+0000 7fb6b9ffb640 1 -- 172.21.15.72:0/3020560926 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7fb6c40c4a80 con 0x7fb6c4142490 2024-03-24T10:37:38.900 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 5 and data pool 6 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6a806b810 msgr2=0x7fb6a806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6a806b810 0x7fb6a806dcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb6c0036000 tx=0x7fb6c003c040 comp rx=0 tx=0).stop 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 msgr2=0x7fb6c4159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c4159de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00cef0 tx=0x7fb6bc00a710 comp rx=0 tx=0).stop 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 shutdown_connections 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb6a806b810 0x7fb6a806dcd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.902 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6c4142490 0x7fb6c4159de0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb6c40ce8c0 0x7fb6c41394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 --2- 172.21.15.72:0/3020560926 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb6c40b2b10 0x7fb6c4151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 >> 172.21.15.72:0/3020560926 conn(0x7fb6c40b1810 msgr2=0x7fb6c40710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 shutdown_connections 2024-03-24T10:37:38.903 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:38.901+0000 7fb6cb7c2640 1 -- 172.21.15.72:0/3020560926 wait complete. 2024-03-24T10:37:38.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.026+0000 7fb237593640 1 Processor -- start 2024-03-24T10:37:39.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.026+0000 7fb237593640 1 -- start start 2024-03-24T10:37:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb237593640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb23015ae80 0x7fb23006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb237593640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23006e680 0x7fb230070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb237593640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300725b0 con 0x7fb230071380 2024-03-24T10:37:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb237593640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fb230071800 con 0x7fb23015ae80 2024-03-24T10:37:39.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb237593640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb230071a10 con 0x7fb23006e680 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb23532f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb23015ae80 0x7fb23006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb23532f640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb23015ae80 0x7fb23006cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59236/0 (socket says 172.21.15.72:59236) 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb23532f640 1 -- 172.21.15.72:0/3889453224 learned_addr learned my addr 172.21.15.72:0/3889453224 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb23532f640 1 -- 172.21.15.72:0/3889453224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23006e680 msgr2=0x7fb230070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.027+0000 7fb23532f640 1 --2- 172.21.15.72:0/3889453224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23006e680 0x7fb230070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.028+0000 7fb23532f640 1 -- 172.21.15.72:0/3889453224 >> v1:172.21.15.79:6789/0 conn(0x7fb230071380 legacy=0x7fb2300b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.028+0000 7fb23532f640 1 -- 172.21.15.72:0/3889453224 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23015b260 con 0x7fb23015ae80 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.028+0000 7fb23532f640 1 --2- 172.21.15.72:0/3889453224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23015ae80 0x7fb23006cce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00bb10 tx=0x7fb22c02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86862fe90d5069e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.028+0000 7fb227fff640 1 -- 172.21.15.72:0/3889453224 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c02ee70 con 0x7fb23015ae80 2024-03-24T10:37:39.037 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.028+0000 7fb227fff640 1 -- 172.21.15.72:0/3889453224 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c036440 con 0x7fb23015ae80 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.028+0000 7fb227fff640 1 -- 172.21.15.72:0/3889453224 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0367d0 con 0x7fb23015ae80 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 -- 172.21.15.72:0/3889453224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23015ae80 msgr2=0x7fb23006cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 --2- 172.21.15.72:0/3889453224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23015ae80 0x7fb23006cce0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00bb10 tx=0x7fb22c02e0c0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 -- 172.21.15.72:0/3889453224 shutdown_connections 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 --2- 172.21.15.72:0/3889453224 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23006e680 0x7fb230070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 --2- 172.21.15.72:0/3889453224 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23015ae80 0x7fb23006cce0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 -- 172.21.15.72:0/3889453224 >> 172.21.15.72:0/3889453224 conn(0x7fb2300b1920 msgr2=0x7fb2300b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 -- 172.21.15.72:0/3889453224 shutdown_connections 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.029+0000 7fb237593640 1 -- 172.21.15.72:0/3889453224 wait complete. 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.030+0000 7fb237593640 1 Processor -- start 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.030+0000 7fb237593640 1 -- start start 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb237593640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 0x7fb2300ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.038 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb237593640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb230071380 0x7fb23009c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb237593640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23015ae80 0x7fb23009c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb237593640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fb23009cc50 con 0x7fb23006e680 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb237593640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb23015c210 con 0x7fb230071380 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb237593640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fb2301e45f0 con 0x7fb23015ae80 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 0x7fb2300ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 0x7fb2300ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59240/0 (socket says 172.21.15.72:59240) 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 -- 172.21.15.72:0/2467353292 learned_addr learned my addr 172.21.15.72:0/2467353292 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb234b2e640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb230071380 0x7fb23009c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb235b30640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23015ae80 0x7fb23009c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 -- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23015ae80 msgr2=0x7fb23009c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23015ae80 0x7fb23009c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 -- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb230071380 msgr2=0x7fb23009c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb230071380 0x7fb23009c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 -- 172.21.15.72:0/2467353292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c00b770 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.031+0000 7fb23532f640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 0x7fb2300ce300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00b2c0 tx=0x7fb22c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.032+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c034950 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.032+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c034ad0 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.032+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2301e4310 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.032+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c034e80 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.032+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23015bea0 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.033+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23015ba20 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.033+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fb22c03d040 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.033+0000 7fb225ffb640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb21406b810 0x7fb21406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.034+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fb22c0aee70 con 0x7fb23006e680 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.034+0000 7fb234b2e640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb21406b810 0x7fb21406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.034+0000 7fb234b2e640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb21406b810 0x7fb21406dcd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb23014c7c0 tx=0x7fb220008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.038+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fb23015ba20 con 0x7fb23006e680 2024-03-24T10:37:39.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.210+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb23015ba20 con 0x7fb23006e680 2024-03-24T10:37:39.211 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.211+0000 7fb225ffb640 1 -- 172.21.15.72:0/2467353292 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16919 (secure 0 0 0) 0x7fb23015ba20 con 0x7fb23006e680 2024-03-24T10:37:39.212 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:39.212 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:38.250282+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:37:36.623646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-24T10:37:37.211680+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:39.213 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb21406b810 msgr2=0x7fb21406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb21406b810 0x7fb21406dcd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb23014c7c0 tx=0x7fb220008040 comp rx=0 tx=0).stop 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 msgr2=0x7fb2300ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 0x7fb2300ce300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb22c00b2c0 tx=0x7fb22c0046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 shutdown_connections 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fb21406b810 0x7fb21406dcd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fb23015ae80 0x7fb23009c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb230071380 0x7fb23009c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 --2- 172.21.15.72:0/2467353292 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb23006e680 0x7fb2300ce300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 >> 172.21.15.72:0/2467353292 conn(0x7fb2300b1920 msgr2=0x7fb230159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 shutdown_connections 2024-03-24T10:37:39.214 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.213+0000 7fb237593640 1 -- 172.21.15.72:0/2467353292 wait complete. 2024-03-24T10:37:39.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.324+0000 7ff3d1415640 1 Processor -- start 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.324+0000 7ff3d1415640 1 -- start start 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3d1415640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3cc0d4930 0x7ff3cc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3d1415640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc0d2450 0x7ff3cc0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3d1415640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3cc0d4e50 con 0x7ff3cc15e170 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3d1415640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7ff3cc0cf790 con 0x7ff3cc0d4930 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3d1415640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc0cfa70 con 0x7ff3cc0d2450 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3c3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3cc0d4930 0x7ff3cc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3caffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff3cc15e170 0x7ff3cc0d1d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48214/0 (socket says 172.21.15.72:48214) 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3c3fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3cc0d4930 0x7ff3cc15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59252/0 (socket says 172.21.15.72:59252) 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3caffd640 1 -- 172.21.15.72:0/3775411677 learned_addr learned my addr 172.21.15.72:0/3775411677 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:39.333 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3cb7fe640 1 --2- 172.21.15.72:0/3775411677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc0d2450 0x7ff3cc0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3c3fff640 1 -- 172.21.15.72:0/3775411677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc0d2450 msgr2=0x7ff3cc0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3c3fff640 1 --2- 172.21.15.72:0/3775411677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc0d2450 0x7ff3cc0b3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3c3fff640 1 -- 172.21.15.72:0/3775411677 >> v1:172.21.15.72:6789/0 conn(0x7ff3cc15e170 legacy=0x7ff3cc0d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3c3fff640 1 -- 172.21.15.72:0/3775411677 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3cc0cfd50 con 0x7ff3cc0d4930 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.325+0000 7ff3ca7fc640 1 -- 172.21.15.72:0/3775411677 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419689058 0 0) 0x7ff3cc0d4e50 con 0x7ff3cc15e170 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.326+0000 7ff3c3fff640 1 --2- 172.21.15.72:0/3775411677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc15e550 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40097a0 tx=0x7ff3b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2900ec87537f5df server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.326+0000 7ff3ca7fc640 1 -- 172.21.15.72:0/3775411677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b402e070 con 0x7ff3cc0d4930 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.326+0000 7ff3ca7fc640 1 -- 172.21.15.72:0/3775411677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40315a0 con 0x7ff3cc0d4930 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.326+0000 7ff3ca7fc640 1 -- 172.21.15.72:0/3775411677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4031930 con 0x7ff3cc0d4930 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 -- 172.21.15.72:0/3775411677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 msgr2=0x7ff3cc15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 --2- 172.21.15.72:0/3775411677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc15e550 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff3b40097a0 tx=0x7ff3b402b840 comp rx=0 tx=0).stop 2024-03-24T10:37:39.334 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 -- 172.21.15.72:0/3775411677 shutdown_connections 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 --2- 172.21.15.72:0/3775411677 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc0d2450 0x7ff3cc0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 --2- 172.21.15.72:0/3775411677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc15e550 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 -- 172.21.15.72:0/3775411677 >> 172.21.15.72:0/3775411677 conn(0x7ff3cc09d310 msgr2=0x7ff3cc0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 -- 172.21.15.72:0/3775411677 shutdown_connections 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.327+0000 7ff3d1415640 1 -- 172.21.15.72:0/3775411677 wait complete. 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.328+0000 7ff3d1415640 1 Processor -- start 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.328+0000 7ff3d1415640 1 -- start start 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3d1415640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3cc0d2450 0x7ff3cc1f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3d1415640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3d1415640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc15e170 0x7ff3cc1f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3d1415640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1f79d0 con 0x7ff3cc0d4930 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3d1415640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3cc1f7330 con 0x7ff3cc0d2450 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3d1415640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7ff3cc1f4870 con 0x7ff3cc15e170 2024-03-24T10:37:39.335 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc0b1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59256/0 (socket says 172.21.15.72:59256) 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 -- 172.21.15.72:0/2854517871 learned_addr learned my addr 172.21.15.72:0/2854517871 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3caffd640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3cc0d2450 0x7ff3cc1f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3cb7fe640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc15e170 0x7ff3cc1f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 -- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc15e170 msgr2=0x7ff3cc1f3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc15e170 0x7ff3cc1f3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 -- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3cc0d2450 msgr2=0x7ff3cc1f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3cc0d2450 0x7ff3cc1f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 -- 172.21.15.72:0/2854517871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b4009400 con 0x7ff3cc0d4930 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3caffd640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3cc0d2450 0x7ff3cc1f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3cb7fe640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc15e170 0x7ff3cc1f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.329+0000 7ff3c3fff640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc0b1040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4034040 tx=0x7ff3b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.330+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4032900 con 0x7ff3cc0d4930 2024-03-24T10:37:39.336 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.330+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b4032a60 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.330+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3cc1f4b50 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.330+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4032e10 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.330+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3cc0b6de0 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.331+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3cc15db40 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.331+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7ff3b404e430 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.331+0000 7ff3c37fe640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff3ac06b810 0x7ff3ac06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.332+0000 7ff3caffd640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff3ac06b810 0x7ff3ac06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.332+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff3b40ac490 con 0x7ff3cc0d4930 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.332+0000 7ff3caffd640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff3ac06b810 0x7ff3ac06dcd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc000f60 tx=0x7ff3bc007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.337 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.336+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7ff3b4076db0 con 0x7ff3cc0d4930 2024-03-24T10:37:39.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.506+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3cc1f7b10 con 0x7ff3cc0d4930 2024-03-24T10:37:39.508 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.507+0000 7ff3c37fe640 1 -- 172.21.15.72:0/2854517871 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16919 (secure 0 0 0) 0x7ff3cc1f7b10 con 0x7ff3cc0d4930 2024-03-24T10:37:39.508 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:39.508 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:38.250282+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:37:36.623646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-24T10:37:37.211680+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff3ac06b810 msgr2=0x7ff3ac06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff3ac06b810 0x7ff3ac06dcd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc000f60 tx=0x7ff3bc007cc0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 msgr2=0x7ff3cc0b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc0b1040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4034040 tx=0x7ff3b40046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 shutdown_connections 2024-03-24T10:37:39.510 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7ff3ac06b810 0x7ff3ac06dcd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff3cc15e170 0x7ff3cc1f3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3cc0d4930 0x7ff3cc0b1040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 --2- 172.21.15.72:0/2854517871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3cc0d2450 0x7ff3cc1f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 >> 172.21.15.72:0/2854517871 conn(0x7ff3cc09d310 msgr2=0x7ff3cc0d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:39.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 shutdown_connections 2024-03-24T10:37:39.511 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.509+0000 7ff3d1415640 1 -- 172.21.15.72:0/2854517871 wait complete. 2024-03-24T10:37:39.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-24T10:37:39.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.623+0000 7fabe1d97640 1 Processor -- start 2024-03-24T10:37:39.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.623+0000 7fabe1d97640 1 -- start start 2024-03-24T10:37:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabe1d97640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabe1d97640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 0x7fabdc0cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabe1d97640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc0d4950 con 0x7fabdc15e240 2024-03-24T10:37:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabe1d97640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fabdc0d2270 con 0x7fabdc0d0f70 2024-03-24T10:37:39.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabe1d97640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc0b38c0 con 0x7fabdc0d2b20 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 0x7fabdc0cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdaffd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdbfff640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 0x7fabdc0cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47298/0 (socket says 172.21.15.72:47298) 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdbfff640 1 -- 172.21.15.72:0/793757530 learned_addr learned my addr 172.21.15.72:0/793757530 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdaffd640 1 -- 172.21.15.72:0/793757530 >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 msgr2=0x7fabdc0cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdaffd640 1 --2- 172.21.15.72:0/793757530 >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 0x7fabdc0cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdaffd640 1 -- 172.21.15.72:0/793757530 >> v1:172.21.15.79:6789/0 conn(0x7fabdc15e240 legacy=0x7fabdc0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdaffd640 1 -- 172.21.15.72:0/793757530 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc0b3550 con 0x7fabdc0d2b20 2024-03-24T10:37:39.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.624+0000 7fabdbfff640 1 --2- 172.21.15.72:0/793757530 >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 0x7fabdc0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.625+0000 7fabdaffd640 1 --2- 172.21.15.72:0/793757530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc0cea40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabd00097a0 tx=0x7fabd002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e537078a6ac78924 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.625+0000 7fabda7fc640 1 -- 172.21.15.72:0/793757530 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0031780 con 0x7fabdc0d2b20 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.625+0000 7fabda7fc640 1 -- 172.21.15.72:0/793757530 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd00318e0 con 0x7fabdc0d2b20 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.625+0000 7fabda7fc640 1 -- 172.21.15.72:0/793757530 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0031c70 con 0x7fabdc0d2b20 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 -- 172.21.15.72:0/793757530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 msgr2=0x7fabdc0cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 --2- 172.21.15.72:0/793757530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc0cea40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fabd00097a0 tx=0x7fabd002b820 comp rx=0 tx=0).stop 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 -- 172.21.15.72:0/793757530 shutdown_connections 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 --2- 172.21.15.72:0/793757530 >> v2:172.21.15.79:3300/0 conn(0x7fabdc0d0f70 0x7fabdc0cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 --2- 172.21.15.72:0/793757530 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc0cea40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 -- 172.21.15.72:0/793757530 >> 172.21.15.72:0/793757530 conn(0x7fabdc0d3e30 msgr2=0x7fabdc0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 -- 172.21.15.72:0/793757530 shutdown_connections 2024-03-24T10:37:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.626+0000 7fabe1d97640 1 -- 172.21.15.72:0/793757530 wait complete. 2024-03-24T10:37:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.627+0000 7fabe1d97640 1 Processor -- start 2024-03-24T10:37:39.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.627+0000 7fabe1d97640 1 -- start start 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabe1d97640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0d0f70 0x7fabdc0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabe1d97640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabe1d97640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 0x7fabdc161430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabe1d97640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0c9680 con 0x7fabdc15e240 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabe1d97640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0c9aa0 con 0x7fabdc0d0f70 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabe1d97640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc0c8a00 con 0x7fabdc0d2b20 2024-03-24T10:37:39.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 0x7fabdc161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 0x7fabdc161430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59260/0 (socket says 172.21.15.72:59260) 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 -- 172.21.15.72:0/2655586040 learned_addr learned my addr 172.21.15.72:0/2655586040 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdb7fe640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0d0f70 0x7fabdc0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdaffd640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 -- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 msgr2=0x7fabdc160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 -- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0d0f70 msgr2=0x7fabdc0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0d0f70 0x7fabdc0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 -- 172.21.15.72:0/2655586040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd4009b30 con 0x7fabdc15e240 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.628+0000 7fabdbfff640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 0x7fabdc161430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009e70 tx=0x7fabd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.629+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd4018070 con 0x7fabdc15e240 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.629+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd400f040 con 0x7fabdc15e240 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.629+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd0009400 con 0x7fabdc15e240 2024-03-24T10:37:39.632 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.629+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd400ce00 con 0x7fabdc15e240 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.629+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc0c8fc0 con 0x7fabdc15e240 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.630+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc0c97c0 con 0x7fabdc15e240 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.630+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fabd4014480 con 0x7fabdc15e240 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.630+0000 7fabc3fff640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fabc806b810 0x7fabc806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.630+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7fabd408a5c0 con 0x7fabdc15e240 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.630+0000 7fabdb7fe640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fabc806b810 0x7fabc806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:39.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.631+0000 7fabdb7fe640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fabc806b810 0x7fabc806dcd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fabcc001640 tx=0x7fabcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:39.635 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.635+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fabdc0c97c0 con 0x7fabdc15e240 2024-03-24T10:37:39.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.840+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fabdc0c97c0 con 0x7fabdc15e240 2024-03-24T10:37:39.914 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.914+0000 7fabc3fff640 1 -- 172.21.15.72:0/2655586040 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7fabdc0c97c0 con 0x7fabdc15e240 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fabc806b810 msgr2=0x7fabc806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fabc806b810 0x7fabc806dcd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fabcc001640 tx=0x7fabcc009040 comp rx=0 tx=0).stop 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 msgr2=0x7fabdc161430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 0x7fabdc161430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009e70 tx=0x7fabd400c490 comp rx=0 tx=0).stop 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 shutdown_connections 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fabc806b810 0x7fabc806dcd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fabdc15e240 0x7fabdc161430 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fabdc0d2b20 0x7fabdc160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.917 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 --2- 172.21.15.72:0/2655586040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fabdc0d0f70 0x7fabdc0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:39.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 >> 172.21.15.72:0/2655586040 conn(0x7fabdc0d3e30 msgr2=0x7fabdc0d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:39.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 shutdown_connections 2024-03-24T10:37:39.918 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:39.916+0000 7fabe1d97640 1 -- 172.21.15.72:0/2655586040 wait complete. 2024-03-24T10:37:39.928 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-24T10:37:39.928 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-24T10:37:40.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.032+0000 7f29aed7a640 1 Processor -- start 2024-03-24T10:37:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.032+0000 7f29aed7a640 1 -- start start 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29aed7a640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f29a80d2b20 0x7f29a80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29aed7a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29aed7a640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a80d4950 con 0x7f29a815e240 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29aed7a640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f29a80d2270 con 0x7f29a80d2b20 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29aed7a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f29a80b38c0 con 0x7f29a80d0f70 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29acb16640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f29a815e240 0x7f29a80d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48224/0 (socket says 172.21.15.72:48224) 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29acb16640 1 -- 172.21.15.72:0/3082498106 learned_addr learned my addr 172.21.15.72:0/3082498106 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a7fff640 1 --2- 172.21.15.72:0/3082498106 >> v2:172.21.15.79:3300/0 conn(0x7f29a80d2b20 0x7f29a80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29ad317640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:40.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a77fe640 1 -- 172.21.15.72:0/3082498106 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439165546 0 0) 0x7f29a80d4950 con 0x7f29a815e240 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a77fe640 1 -- 172.21.15.72:0/3082498106 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2998003520 con 0x7f29a815e240 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a7fff640 1 -- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 msgr2=0x7f29a80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a7fff640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a80cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a7fff640 1 -- 172.21.15.72:0/3082498106 >> v1:172.21.15.72:6789/0 conn(0x7f29a815e240 legacy=0x7f29a80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29a7fff640 1 -- 172.21.15.72:0/3082498106 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a80b3550 con 0x7f29a80d2b20 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.033+0000 7f29ad317640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.034+0000 7f29a7fff640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80d2b20 0x7f29a80cea40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f29940097a0 tx=0x7f299402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43d4af8af1502b5b server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.034+0000 7f29a77fe640 1 -- 172.21.15.72:0/3082498106 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f299402e070 con 0x7f29a80d2b20 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.034+0000 7f29a77fe640 1 -- 172.21.15.72:0/3082498106 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29940315a0 con 0x7f29a80d2b20 2024-03-24T10:37:40.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.034+0000 7f29a77fe640 1 -- 172.21.15.72:0/3082498106 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994031910 con 0x7f29a80d2b20 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 -- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80d2b20 msgr2=0x7f29a80cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80d2b20 0x7f29a80cea40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f29940097a0 tx=0x7f299402b840 comp rx=0 tx=0).stop 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 -- 172.21.15.72:0/3082498106 shutdown_connections 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 --2- 172.21.15.72:0/3082498106 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a80d2b20 0x7f29a80cea40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 -- 172.21.15.72:0/3082498106 >> 172.21.15.72:0/3082498106 conn(0x7f29a80d3e30 msgr2=0x7f29a80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 -- 172.21.15.72:0/3082498106 shutdown_connections 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.035+0000 7f29aed7a640 1 -- 172.21.15.72:0/3082498106 wait complete. 2024-03-24T10:37:40.039 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.036+0000 7f29aed7a640 1 Processor -- start 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.036+0000 7f29aed7a640 1 -- start start 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29aed7a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a81f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29aed7a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 0x7f29a8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29aed7a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a815e240 0x7f29a80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29aed7a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f29a81f4b60 con 0x7f29a80d2b20 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29aed7a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29a80cc0d0 con 0x7f29a815e240 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29aed7a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f29a80cc3b0 con 0x7f29a80d0f70 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 0x7f29a8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 0x7f29a8153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59266/0 (socket says 172.21.15.72:59266) 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 -- 172.21.15.72:0/2085711669 learned_addr learned my addr 172.21.15.72:0/2085711669 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29acb16640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a81f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29ad317640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a815e240 0x7f29a80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 -- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 msgr2=0x7f29a81f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:40.040 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a81f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 -- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a815e240 msgr2=0x7f29a80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a815e240 0x7f29a80b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 -- 172.21.15.72:0/2085711669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a0009a70 con 0x7f29a80d2b20 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.037+0000 7f29a7fff640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 0x7f29a8153250 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2994034040 tx=0x7f29940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.038+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994032630 con 0x7f29a80d2b20 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.038+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2994032790 con 0x7f29a80d2b20 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.038+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2994032b20 con 0x7f29a80d2b20 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.038+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2994009400 con 0x7f29a80d2b20 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.038+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a80cc970 con 0x7f29a80d2b20 2024-03-24T10:37:40.041 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.039+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a80d13c0 con 0x7f29a80d2b20 2024-03-24T10:37:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.039+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f2994032c80 con 0x7f29a80d2b20 2024-03-24T10:37:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.039+0000 7f29a57fa640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f298c06b810 0x7f298c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.039+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f29940ac130 con 0x7f29a80d2b20 2024-03-24T10:37:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.039+0000 7f29acb16640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f298c06b810 0x7f298c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:40.042 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.040+0000 7f29acb16640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f298c06b810 0x7f298c06dcd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f299c005880 tx=0x7f299c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:40.044 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.044+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f29940769c0 con 0x7f29a80d2b20 2024-03-24T10:37:40.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.251+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f29a804f470 con 0x7f29a80d2b20 2024-03-24T10:37:40.929 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.928+0000 7f29a57fa640 1 -- 172.21.15.72:0/2085711669 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7f299407a080 con 0x7f29a80d2b20 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f298c06b810 msgr2=0x7f298c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f298c06b810 0x7f298c06dcd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f299c005880 tx=0x7f299c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 msgr2=0x7f29a8153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 0x7f29a8153250 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2994034040 tx=0x7f29940046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 shutdown_connections 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f298c06b810 0x7f298c06dcd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f29a815e240 0x7f29a80b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29a80d2b20 0x7f29a8153250 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 --2- 172.21.15.72:0/2085711669 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f29a80d0f70 0x7f29a81f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:40.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 >> 172.21.15.72:0/2085711669 conn(0x7f29a80d3e30 msgr2=0x7f29a806bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:40.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 shutdown_connections 2024-03-24T10:37:40.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:40.932+0000 7f29aed7a640 1 -- 172.21.15.72:0/2085711669 wait complete. 2024-03-24T10:37:40.947 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-24T10:37:40.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:37:41.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.053+0000 7f09236b5640 1 Processor -- start 2024-03-24T10:37:41.054 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.054+0000 7f09236b5640 1 -- start start 2024-03-24T10:37:41.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.054+0000 7f09236b5640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f091c15e170 0x7f091c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.054+0000 7f09236b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c0d4930 0x7f091c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.054+0000 7f09236b5640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091c0d4e50 con 0x7f091c0d2280 2024-03-24T10:37:41.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.054+0000 7f09236b5640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f091c0cf790 con 0x7f091c15e170 2024-03-24T10:37:41.056 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.054+0000 7f09236b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f091c0cfa70 con 0x7f091c0d4930 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f091c15e170 0x7f091c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f091c15e170 0x7f091c15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:47338/0 (socket says 172.21.15.72:47338) 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0920c50640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c0d4930 0x7f091c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 -- 172.21.15.72:0/1593615593 learned_addr learned my addr 172.21.15.72:0/1593615593 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 -- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c0d4930 msgr2=0x7f091c0d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 --2- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c0d4930 0x7f091c0d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 -- 172.21.15.72:0/1593615593 >> v1:172.21.15.79:6789/0 conn(0x7f091c0d2280 legacy=0x7f091c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0921451640 1 -- 172.21.15.72:0/1593615593 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f091c0cfd50 con 0x7f091c15e170 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f090ffff640 1 -- 172.21.15.72:0/1593615593 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257160218 0 0) 0x7f091c0d4e50 con 0x7f091c0d2280 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.055+0000 7f0920c50640 1 --2- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c0d4930 0x7f091c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f0921451640 1 --2- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c15e170 0x7f091c15e550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0918009870 tx=0x7f091802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ee5cccae63b71cd server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f090ffff640 1 -- 172.21.15.72:0/1593615593 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918031640 con 0x7f091c15e170 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f090ffff640 1 -- 172.21.15.72:0/1593615593 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09180317a0 con 0x7f091c15e170 2024-03-24T10:37:41.057 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f090ffff640 1 -- 172.21.15.72:0/1593615593 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918031b30 con 0x7f091c15e170 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f09236b5640 1 -- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c15e170 msgr2=0x7f091c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f09236b5640 1 --2- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c15e170 0x7f091c15e550 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0918009870 tx=0x7f091802b8f0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f09236b5640 1 -- 172.21.15.72:0/1593615593 shutdown_connections 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f09236b5640 1 --2- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c0d4930 0x7f091c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f09236b5640 1 --2- 172.21.15.72:0/1593615593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c15e170 0x7f091c15e550 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.056+0000 7f09236b5640 1 -- 172.21.15.72:0/1593615593 >> 172.21.15.72:0/1593615593 conn(0x7f091c09d310 msgr2=0x7f091c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.057+0000 7f09236b5640 1 -- 172.21.15.72:0/1593615593 shutdown_connections 2024-03-24T10:37:41.060 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.057+0000 7f09236b5640 1 -- 172.21.15.72:0/1593615593 wait complete. 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 Processor -- start 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 -- start start 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 0x7f091c1edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c0d4930 0x7f091c0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c15e170 0x7f091c0d0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f091c0cb370 con 0x7f091c0d2280 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f091c1f3c60 con 0x7f091c0d4930 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.058+0000 7f09236b5640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f091c1ee130 con 0x7f091c15e170 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 0x7f091c1edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 0x7f091c1edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59280/0 (socket says 172.21.15.72:59280) 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 -- 172.21.15.72:0/2346304770 learned_addr learned my addr 172.21.15.72:0/2346304770 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0920c50640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c0d4930 0x7f091c0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921c52640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c15e170 0x7f091c0d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.061 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 -- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c15e170 msgr2=0x7f091c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c15e170 0x7f091c0d0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 -- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c0d4930 msgr2=0x7f091c0d0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c0d4930 0x7f091c0d0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 -- 172.21.15.72:0/2346304770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910009400 con 0x7f091c0d2280 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f0921451640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 0x7f091c1edbf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0918009870 tx=0x7f09180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918004230 con 0x7f091c0d2280 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0918004390 con 0x7f091c0d2280 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09180094d0 con 0x7f091c0d2280 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0918003830 con 0x7f091c0d2280 2024-03-24T10:37:41.062 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.059+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f091c1f4bf0 con 0x7f091c0d2280 2024-03-24T10:37:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.061+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091c0a1ef0 con 0x7f091c0d2280 2024-03-24T10:37:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.061+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0918043070 con 0x7f091c0d2280 2024-03-24T10:37:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.061+0000 7f090dffb640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f090006b810 0x7f090006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.061+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f09180ac040 con 0x7f091c0d2280 2024-03-24T10:37:41.063 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.061+0000 7f0920c50640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f090006b810 0x7f090006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.064 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.062+0000 7f0920c50640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f090006b810 0x7f090006dcd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f091c0b0cc0 tx=0x7f0910009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.066+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0918076980 con 0x7f091c0d2280 2024-03-24T10:37:41.275 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.275+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f091c06d310 con 0x7f091c0d2280 2024-03-24T10:37:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.275+0000 7f090dffb640 1 -- 172.21.15.72:0/2346304770 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7f091807a040 con 0x7f091c0d2280 2024-03-24T10:37:41.276 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:41.276 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1580270591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1580270591},{"type":"v1","addr":"172.21.15.79:6835","nonce":1580270591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3906196145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3906196145},{"type":"v1","addr":"172.21.15.72:6835","nonce":3906196145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1450114813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1450114813},{"type":"v1","addr":"172.21.15.72:6837","nonce":1450114813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:37:38.250603+0000","modified":"2024-03-24T10:37:40.253296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5335},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5335":{"gid":5335,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6834/1435184674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1435184674},{"type":"v1","addr":"172.21.15.79:6834","nonce":1435184674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5335,"qdb_cluster":[5335]},"id":2}]} 2024-03-24T10:37:41.276 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-24T10:37:41.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f090006b810 msgr2=0x7f090006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f090006b810 0x7f090006dcd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f091c0b0cc0 tx=0x7f0910009190 comp rx=0 tx=0).stop 2024-03-24T10:37:41.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 msgr2=0x7f091c1edbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 0x7f091c1edbf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0918009870 tx=0x7f09180046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 shutdown_connections 2024-03-24T10:37:41.278 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f090006b810 0x7f090006dcd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f091c15e170 0x7f091c0d0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091c0d4930 0x7f091c0d0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 --2- 172.21.15.72:0/2346304770 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f091c0d2280 0x7f091c1edbf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 >> 172.21.15.72:0/2346304770 conn(0x7f091c09d310 msgr2=0x7f091c06cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 shutdown_connections 2024-03-24T10:37:41.279 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.277+0000 7f09236b5640 1 -- 172.21.15.72:0/2346304770 wait complete. 2024-03-24T10:37:41.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T10:37:41.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.387+0000 7f8390284640 1 Processor -- start 2024-03-24T10:37:41.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.387+0000 7f8390284640 1 -- start start 2024-03-24T10:37:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f8390284640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f838806e680 0x7f8388070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f8390284640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f83880ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f8390284640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83880725b0 con 0x7f838815ae80 2024-03-24T10:37:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f8390284640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8388071830 con 0x7f838806e680 2024-03-24T10:37:41.389 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f8390284640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8388071a10 con 0x7f8388071380 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838e020640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f838815ae80 0x7f838806cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:48226/0 (socket says 172.21.15.72:48226) 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838e020640 1 -- 172.21.15.72:0/4266814923 learned_addr learned my addr 172.21.15.72:0/4266814923 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d81f640 1 --2- 172.21.15.72:0/4266814923 >> v2:172.21.15.72:3300/0 conn(0x7f838806e680 0x7f8388070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838e821640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f83880ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d01e640 1 -- 172.21.15.72:0/4266814923 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517008214 0 0) 0x7f83880725b0 con 0x7f838815ae80 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d01e640 1 -- 172.21.15.72:0/4266814923 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8374003520 con 0x7f838815ae80 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d81f640 1 -- 172.21.15.72:0/4266814923 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 msgr2=0x7f83880ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d81f640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f83880ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d81f640 1 -- 172.21.15.72:0/4266814923 >> v1:172.21.15.72:6789/0 conn(0x7f838815ae80 legacy=0x7f838806cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838d81f640 1 -- 172.21.15.72:0/4266814923 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f838815b260 con 0x7f838806e680 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.388+0000 7f838e821640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f83880ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:41.390 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.389+0000 7f838d81f640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838806e680 0x7f8388070e40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f83780097a0 tx=0x7f837802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c6b4eb3a068fa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.389+0000 7f838d01e640 1 -- 172.21.15.72:0/4266814923 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378031830 con 0x7f838806e680 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.389+0000 7f838d01e640 1 -- 172.21.15.72:0/4266814923 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8378031990 con 0x7f838806e680 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.389+0000 7f838d01e640 1 -- 172.21.15.72:0/4266814923 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378031d00 con 0x7f838806e680 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 -- 172.21.15.72:0/4266814923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838806e680 msgr2=0x7f8388070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838806e680 0x7f8388070e40 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f83780097a0 tx=0x7f837802b8d0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 -- 172.21.15.72:0/4266814923 shutdown_connections 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f83880ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 --2- 172.21.15.72:0/4266814923 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838806e680 0x7f8388070e40 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 -- 172.21.15.72:0/4266814923 >> 172.21.15.72:0/4266814923 conn(0x7f83880b1920 msgr2=0x7f83880b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 -- 172.21.15.72:0/4266814923 shutdown_connections 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.390+0000 7f8390284640 1 -- 172.21.15.72:0/4266814923 wait complete. 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.391+0000 7f8390284640 1 Processor -- start 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.391+0000 7f8390284640 1 -- start start 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f8390284640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838806e680 0x7f83880ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f8390284640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f8388151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f8390284640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 0x7f83880ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f8390284640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f83880cd410 con 0x7f838815ae80 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f8390284640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83880ccb70 con 0x7f838806e680 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f8390284640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f83880cce50 con 0x7f8388071380 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 0x7f83880ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 0x7f83880ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:59308/0 (socket says 172.21.15.72:59308) 2024-03-24T10:37:41.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 -- 172.21.15.72:0/2900721353 learned_addr learned my addr 172.21.15.72:0/2900721353 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e020640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838806e680 0x7f83880ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838d81f640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f8388151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 -- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 msgr2=0x7f8388151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f8388151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 -- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838806e680 msgr2=0x7f83880ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838806e680 0x7f83880ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 -- 172.21.15.72:0/2900721353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8380009a70 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f838e821640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 0x7f83880ca570 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f838000efc0 tx=0x7f8380009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380009d70 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.392+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f838000f040 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.393+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8380003990 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.393+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8378009400 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.393+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83881f53d0 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.393+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8388068330 con 0x7f838815ae80 2024-03-24T10:37:41.397 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.394+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f83800144a0 con 0x7f838815ae80 2024-03-24T10:37:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.394+0000 7f837effd640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f836c06b810 0x7f836c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.394+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f838008ae40 con 0x7f838815ae80 2024-03-24T10:37:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.394+0000 7f838e020640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f836c06b810 0x7f836c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.398 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.395+0000 7f838e020640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f836c06b810 0x7f836c06dcd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8384005880 tx=0x7f8384009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.399 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.398+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8380055810 con 0x7f838815ae80 2024-03-24T10:37:41.570 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.570+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f838809e080 con 0x7f838815ae80 2024-03-24T10:37:41.571 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.571+0000 7f837effd640 1 -- 172.21.15.72:0/2900721353 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16906 (secure 0 0 0) 0x7f8380058ed0 con 0x7f838815ae80 2024-03-24T10:37:41.572 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:41.572 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T10:37:39.899970+0000","last_up_change":"2024-03-24T10:36:13.072604+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:37:36.623646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-24T10:37:37.211680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists","up"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists","up"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f836c06b810 msgr2=0x7f836c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f836c06b810 0x7f836c06dcd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8384005880 tx=0x7f8384009040 comp rx=0 tx=0).stop 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 msgr2=0x7f83880ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 0x7f83880ca570 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f838000efc0 tx=0x7f8380009f90 comp rx=0 tx=0).stop 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 shutdown_connections 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f836c06b810 0x7f836c06dcd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f838815ae80 0x7f83880ca570 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8388071380 0x7f8388151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 --2- 172.21.15.72:0/2900721353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f838806e680 0x7f83880ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 >> 172.21.15.72:0/2900721353 conn(0x7f83880b1920 msgr2=0x7f838806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 shutdown_connections 2024-03-24T10:37:41.574 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.573+0000 7f8390284640 1 -- 172.21.15.72:0/2900721353 wait complete. 2024-03-24T10:37:41.584 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-24T10:37:41.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:37:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.683+0000 7f64bcb81640 1 Processor -- start 2024-03-24T10:37:41.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.683+0000 7f64bcb81640 1 -- start start 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64bcb81640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64b806e680 0x7f64b8070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64bcb81640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f64b8071380 0x7f64b80ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64bcb81640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64b80725b0 con 0x7f64b815ae80 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64bcb81640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f64b8071830 con 0x7f64b806e680 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64bcb81640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f64b8071a10 con 0x7f64b8071380 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64b806e680 0x7f64b8070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f64b806e680 0x7f64b8070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51700/0 (socket says 172.21.15.72:51700) 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 -- 172.21.15.72:0/1557556788 learned_addr learned my addr 172.21.15.72:0/1557556788 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:41.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b6d9d640 1 --2- 172.21.15.72:0/1557556788 >> v2:172.21.15.79:3300/0 conn(0x7f64b8071380 0x7f64b80ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 -- 172.21.15.72:0/1557556788 >> v2:172.21.15.79:3300/0 conn(0x7f64b8071380 msgr2=0x7f64b80ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:41.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 --2- 172.21.15.72:0/1557556788 >> v2:172.21.15.79:3300/0 conn(0x7f64b8071380 0x7f64b80ad850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 -- 172.21.15.72:0/1557556788 >> v1:172.21.15.79:6789/0 conn(0x7f64b815ae80 legacy=0x7f64b806cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.684+0000 7f64b5d9b640 1 -- 172.21.15.72:0/1557556788 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b815b260 con 0x7f64b806e680 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.685+0000 7f64b5d9b640 1 --2- 172.21.15.72:0/1557556788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8070e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64b8070b10 tx=0x7f64ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210db65012424854 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.685+0000 7f64b559a640 1 -- 172.21.15.72:0/1557556788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac030860 con 0x7f64b806e680 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.685+0000 7f64b559a640 1 -- 172.21.15.72:0/1557556788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64ac0309c0 con 0x7f64b806e680 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.685+0000 7f64b559a640 1 -- 172.21.15.72:0/1557556788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64ac030d50 con 0x7f64b806e680 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 -- 172.21.15.72:0/1557556788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 msgr2=0x7f64b8070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 --2- 172.21.15.72:0/1557556788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8070e40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f64b8070b10 tx=0x7f64ac02b9a0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.687 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 -- 172.21.15.72:0/1557556788 shutdown_connections 2024-03-24T10:37:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 --2- 172.21.15.72:0/1557556788 >> v2:172.21.15.79:3300/0 conn(0x7f64b8071380 0x7f64b80ad850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 --2- 172.21.15.72:0/1557556788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8070e40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 -- 172.21.15.72:0/1557556788 >> 172.21.15.72:0/1557556788 conn(0x7f64b80b1920 msgr2=0x7f64b80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 -- 172.21.15.72:0/1557556788 shutdown_connections 2024-03-24T10:37:41.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.686+0000 7f64bcb81640 1 -- 172.21.15.72:0/1557556788 wait complete. 2024-03-24T10:37:41.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.687+0000 7f64bcb81640 1 Processor -- start 2024-03-24T10:37:41.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.687+0000 7f64bcb81640 1 -- start start 2024-03-24T10:37:41.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64bcb81640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64bcb81640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b8071380 0x7f64b80cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64bcb81640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64b815ae80 0x7f64b80ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64bcb81640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8146ac0 con 0x7f64b806e680 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64bcb81640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f64b80ce130 con 0x7f64b8071380 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64bcb81640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f64b80ccf30 con 0x7f64b815ae80 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8146580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51716/0 (socket says 172.21.15.72:51716) 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 -- 172.21.15.72:0/643646450 learned_addr learned my addr 172.21.15.72:0/643646450 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b5d9b640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b8071380 0x7f64b80cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b6d9d640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64b815ae80 0x7f64b80ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 -- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64b815ae80 msgr2=0x7f64b80ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64b815ae80 0x7f64b80ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 -- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b8071380 msgr2=0x7f64b80cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b8071380 0x7f64b80cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b659c640 1 -- 172.21.15.72:0/643646450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac0094d0 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b6d9d640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64b815ae80 0x7f64b80ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.688+0000 7f64b5d9b640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b8071380 0x7f64b80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.689+0000 7f64b659c640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8146580 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c3c0 tx=0x7f64a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.689+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a80052d0 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.689+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a8005450 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.689+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b80cd210 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.689+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8007260 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.689+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b80cddc0 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.690+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b809e080 con 0x7f64b806e680 2024-03-24T10:37:41.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.690+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f64a80073c0 con 0x7f64b806e680 2024-03-24T10:37:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.690+0000 7f64a6ffd640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f649806b810 0x7f649806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.691+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f64a8089710 con 0x7f64b806e680 2024-03-24T10:37:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.691+0000 7f64b5d9b640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f649806b810 0x7f649806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:41.693 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.691+0000 7f64b5d9b640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f649806b810 0x7f649806dcd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64ac036000 tx=0x7f64ac008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:41.695 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.695+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f64a8057b60 con 0x7f64b806e680 2024-03-24T10:37:41.864 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.864+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64b8072240 con 0x7f649806b810 2024-03-24T10:37:41.870 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.870+0000 7f64a6ffd640 1 -- 172.21.15.72:0/643646450 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246633 (secure 0 0 0) 0x7f64ac039450 con 0x7f649806b810 2024-03-24T10:37:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:41.875 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:37:41.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f649806b810 msgr2=0x7f649806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f649806b810 0x7f649806dcd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64ac036000 tx=0x7f64ac008030 comp rx=0 tx=0).stop 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 msgr2=0x7f64b8146580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8146580 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c3c0 tx=0x7f64a800c880 comp rx=0 tx=0).stop 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 shutdown_connections 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f649806b810 0x7f649806dcd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f64b815ae80 0x7f64b80ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f64b8071380 0x7f64b80cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 --2- 172.21.15.72:0/643646450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f64b806e680 0x7f64b8146580 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 >> 172.21.15.72:0/643646450 conn(0x7f64b80b1920 msgr2=0x7f64b806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 shutdown_connections 2024-03-24T10:37:41.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:41.873+0000 7f64bcb81640 1 -- 172.21.15.72:0/643646450 wait complete. 2024-03-24T10:37:41.884 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2024-03-24T10:37:40.154621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4521984,"data_stored":2587454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000652"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903688+0000","last_change":"2024-03-24T10:37:37.903688+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903688+0000","last_undegraded":"2024-03-24T10:37:37.903688+0000","last_fullsized":"2024-03-24T10:37:37.903688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903058+0000","last_change":"2024-03-24T10:37:37.903058+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903058+0000","last_undegraded":"2024-03-24T10:37:37.903058+0000","last_fullsized":"2024-03-24T10:37:37.903058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899438+0000","last_change":"2024-03-24T10:37:37.899438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899438+0000","last_undegraded":"2024-03-24T10:37:37.899438+0000","last_fullsized":"2024-03-24T10:37:37.899438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.893122+0000","last_change":"2024-03-24T10:37:37.893122+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.893122+0000","last_undegraded":"2024-03-24T10:37:37.893122+0000","last_fullsized":"2024-03-24T10:37:37.893122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892817+0000","last_change":"2024-03-24T10:37:37.892817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892817+0000","last_undegraded":"2024-03-24T10:37:37.892817+0000","last_fullsized":"2024-03-24T10:37:37.892817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896070+0000","last_change":"2024-03-24T10:37:37.896070+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896070+0000","last_undegraded":"2024-03-24T10:37:37.896070+0000","last_fullsized":"2024-03-24T10:37:37.896070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897525+0000","last_change":"2024-03-24T10:37:37.897525+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897525+0000","last_undegraded":"2024-03-24T10:37:37.897525+0000","last_fullsized":"2024-03-24T10:37:37.897525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902809+0000","last_change":"2024-03-24T10:37:37.902809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902809+0000","last_undegraded":"2024-03-24T10:37:37.902809+0000","last_fullsized":"2024-03-24T10:37:37.902809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897438+0000","last_change":"2024-03-24T10:37:37.897438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897438+0000","last_undegraded":"2024-03-24T10:37:37.897438+0000","last_fullsized":"2024-03-24T10:37:37.897438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900491+0000","last_change":"2024-03-24T10:37:37.900491+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900491+0000","last_undegraded":"2024-03-24T10:37:37.900491+0000","last_fullsized":"2024-03-24T10:37:37.900491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898449+0000","last_change":"2024-03-24T10:37:37.898449+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898449+0000","last_undegraded":"2024-03-24T10:37:37.898449+0000","last_fullsized":"2024-03-24T10:37:37.898449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897893+0000","last_change":"2024-03-24T10:37:37.897893+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897893+0000","last_undegraded":"2024-03-24T10:37:37.897893+0000","last_fullsized":"2024-03-24T10:37:37.897893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896759+0000","last_change":"2024-03-24T10:37:37.896759+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896759+0000","last_undegraded":"2024-03-24T10:37:37.896759+0000","last_fullsized":"2024-03-24T10:37:37.896759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896816+0000","last_change":"2024-03-24T10:37:37.896816+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896816+0000","last_undegraded":"2024-03-24T10:37:37.896816+0000","last_fullsized":"2024-03-24T10:37:37.896816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896809+0000","last_change":"2024-03-24T10:37:37.896809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896809+0000","last_undegraded":"2024-03-24T10:37:37.896809+0000","last_fullsized":"2024-03-24T10:37:37.896809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898296+0000","last_change":"2024-03-24T10:37:37.898296+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898296+0000","last_undegraded":"2024-03-24T10:37:37.898296+0000","last_fullsized":"2024-03-24T10:37:37.898296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895588+0000","last_change":"2024-03-24T10:37:37.895588+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895588+0000","last_undegraded":"2024-03-24T10:37:37.895588+0000","last_fullsized":"2024-03-24T10:37:37.895588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892669+0000","last_change":"2024-03-24T10:37:37.892669+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892669+0000","last_undegraded":"2024-03-24T10:37:37.892669+0000","last_fullsized":"2024-03-24T10:37:37.892669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892308+0000","last_change":"2024-03-24T10:37:37.892308+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892308+0000","last_undegraded":"2024-03-24T10:37:37.892308+0000","last_fullsized":"2024-03-24T10:37:37.892308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892152+0000","last_change":"2024-03-24T10:37:37.892152+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892152+0000","last_undegraded":"2024-03-24T10:37:37.892152+0000","last_fullsized":"2024-03-24T10:37:37.892152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897175+0000","last_change":"2024-03-24T10:37:37.897175+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897175+0000","last_undegraded":"2024-03-24T10:37:37.897175+0000","last_fullsized":"2024-03-24T10:37:37.897175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.894607+0000","last_change":"2024-03-24T10:37:37.894607+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.894607+0000","last_undegraded":"2024-03-24T10:37:37.894607+0000","last_fullsized":"2024-03-24T10:37:37.894607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896247+0000","last_change":"2024-03-24T10:37:37.896247+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896247+0000","last_undegraded":"2024-03-24T10:37:37.896247+0000","last_fullsized":"2024-03-24T10:37:37.896247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892180+0000","last_change":"2024-03-24T10:37:37.892180+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892180+0000","last_undegraded":"2024-03-24T10:37:37.892180+0000","last_fullsized":"2024-03-24T10:37:37.892180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892493+0000","last_change":"2024-03-24T10:37:37.892493+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892493+0000","last_undegraded":"2024-03-24T10:37:37.892493+0000","last_fullsized":"2024-03-24T10:37:37.892493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898870+0000","last_change":"2024-03-24T10:37:37.898870+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898870+0000","last_undegraded":"2024-03-24T10:37:37.898870+0000","last_fullsized":"2024-03-24T10:37:37.898870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892322+0000","last_change":"2024-03-24T10:37:37.892322+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892322+0000","last_undegraded":"2024-03-24T10:37:37.892322+0000","last_fullsized":"2024-03-24T10:37:37.892322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897226+0000","last_change":"2024-03-24T10:37:37.897226+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897226+0000","last_undegraded":"2024-03-24T10:37:37.897226+0000","last_fullsized":"2024-03-24T10:37:37.897226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892208+0000","last_change":"2024-03-24T10:37:37.892208+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892208+0000","last_undegraded":"2024-03-24T10:37:37.892208+0000","last_fullsized":"2024-03-24T10:37:37.892208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892128+0000","last_change":"2024-03-24T10:37:37.892128+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892128+0000","last_undegraded":"2024-03-24T10:37:37.892128+0000","last_fullsized":"2024-03-24T10:37:37.892128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895503+0000","last_change":"2024-03-24T10:37:37.895503+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895503+0000","last_undegraded":"2024-03-24T10:37:37.895503+0000","last_fullsized":"2024-03-24T10:37:37.895503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896106+0000","last_change":"2024-03-24T10:37:37.896106+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896106+0000","last_undegraded":"2024-03-24T10:37:37.896106+0000","last_fullsized":"2024-03-24T10:37:37.896106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898571+0000","last_change":"2024-03-24T10:37:37.898571+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898571+0000","last_undegraded":"2024-03-24T10:37:37.898571+0000","last_fullsized":"2024-03-24T10:37:37.898571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907166+0000","last_change":"2024-03-24T10:37:37.902780+0000","last_active":"2024-03-24T10:37:37.907166+0000","last_peered":"2024-03-24T10:37:37.907166+0000","last_clean":"2024-03-24T10:37:37.907166+0000","last_became_active":"2024-03-24T10:37:37.902533+0000","last_became_peered":"2024-03-24T10:37:37.902533+0000","last_unstale":"2024-03-24T10:37:37.907166+0000","last_undegraded":"2024-03-24T10:37:37.907166+0000","last_fullsized":"2024-03-24T10:37:37.907166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:49:58.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897531+0000","last_change":"2024-03-24T10:37:37.897531+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897531+0000","last_undegraded":"2024-03-24T10:37:37.897531+0000","last_fullsized":"2024-03-24T10:37:37.897531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909224+0000","last_change":"2024-03-24T10:37:37.906862+0000","last_active":"2024-03-24T10:37:37.909224+0000","last_peered":"2024-03-24T10:37:37.909224+0000","last_clean":"2024-03-24T10:37:37.909224+0000","last_became_active":"2024-03-24T10:37:37.906602+0000","last_became_peered":"2024-03-24T10:37:37.906602+0000","last_unstale":"2024-03-24T10:37:37.909224+0000","last_undegraded":"2024-03-24T10:37:37.909224+0000","last_fullsized":"2024-03-24T10:37:37.909224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895250+0000","last_change":"2024-03-24T10:37:37.895250+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895250+0000","last_undegraded":"2024-03-24T10:37:37.895250+0000","last_fullsized":"2024-03-24T10:37:37.895250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910444+0000","last_change":"2024-03-24T10:37:37.908810+0000","last_active":"2024-03-24T10:37:37.910444+0000","last_peered":"2024-03-24T10:37:37.910444+0000","last_clean":"2024-03-24T10:37:37.910444+0000","last_became_active":"2024-03-24T10:37:37.908519+0000","last_became_peered":"2024-03-24T10:37:37.908519+0000","last_unstale":"2024-03-24T10:37:37.910444+0000","last_undegraded":"2024-03-24T10:37:37.910444+0000","last_fullsized":"2024-03-24T10:37:37.910444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902283+0000","last_change":"2024-03-24T10:37:37.902283+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902283+0000","last_undegraded":"2024-03-24T10:37:37.902283+0000","last_fullsized":"2024-03-24T10:37:37.902283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909634+0000","last_change":"2024-03-24T10:37:37.903962+0000","last_active":"2024-03-24T10:37:37.909634+0000","last_peered":"2024-03-24T10:37:37.909634+0000","last_clean":"2024-03-24T10:37:37.909634+0000","last_became_active":"2024-03-24T10:37:37.903706+0000","last_became_peered":"2024-03-24T10:37:37.903706+0000","last_unstale":"2024-03-24T10:37:37.909634+0000","last_undegraded":"2024-03-24T10:37:37.909634+0000","last_fullsized":"2024-03-24T10:37:37.909634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:48:26.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900728+0000","last_change":"2024-03-24T10:37:37.900728+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900728+0000","last_undegraded":"2024-03-24T10:37:37.900728+0000","last_fullsized":"2024-03-24T10:37:37.900728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909177+0000","last_change":"2024-03-24T10:37:37.901965+0000","last_active":"2024-03-24T10:37:37.909177+0000","last_peered":"2024-03-24T10:37:37.909177+0000","last_clean":"2024-03-24T10:37:37.909177+0000","last_became_active":"2024-03-24T10:37:37.901710+0000","last_became_peered":"2024-03-24T10:37:37.901710+0000","last_unstale":"2024-03-24T10:37:37.909177+0000","last_undegraded":"2024-03-24T10:37:37.909177+0000","last_fullsized":"2024-03-24T10:37:37.909177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896382+0000","last_change":"2024-03-24T10:37:37.896382+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896382+0000","last_undegraded":"2024-03-24T10:37:37.896382+0000","last_fullsized":"2024-03-24T10:37:37.896382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.917775+0000","last_change":"2024-03-24T10:37:37.912877+0000","last_active":"2024-03-24T10:37:37.917775+0000","last_peered":"2024-03-24T10:37:37.917775+0000","last_clean":"2024-03-24T10:37:37.917775+0000","last_became_active":"2024-03-24T10:37:37.912621+0000","last_became_peered":"2024-03-24T10:37:37.912621+0000","last_unstale":"2024-03-24T10:37:37.917775+0000","last_undegraded":"2024-03-24T10:37:37.917775+0000","last_fullsized":"2024-03-24T10:37:37.917775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895952+0000","last_change":"2024-03-24T10:37:37.895952+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895952+0000","last_undegraded":"2024-03-24T10:37:37.895952+0000","last_fullsized":"2024-03-24T10:37:37.895952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911073+0000","last_change":"2024-03-24T10:37:37.910516+0000","last_active":"2024-03-24T10:37:37.911073+0000","last_peered":"2024-03-24T10:37:37.911073+0000","last_clean":"2024-03-24T10:37:37.911073+0000","last_became_active":"2024-03-24T10:37:37.910186+0000","last_became_peered":"2024-03-24T10:37:37.910186+0000","last_unstale":"2024-03-24T10:37:37.911073+0000","last_undegraded":"2024-03-24T10:37:37.911073+0000","last_fullsized":"2024-03-24T10:37:37.911073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898841+0000","last_change":"2024-03-24T10:37:37.898841+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898841+0000","last_undegraded":"2024-03-24T10:37:37.898841+0000","last_fullsized":"2024-03-24T10:37:37.898841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.904111+0000","last_change":"2024-03-24T10:37:37.899890+0000","last_active":"2024-03-24T10:37:37.904111+0000","last_peered":"2024-03-24T10:37:37.904111+0000","last_clean":"2024-03-24T10:37:37.904111+0000","last_became_active":"2024-03-24T10:37:37.899298+0000","last_became_peered":"2024-03-24T10:37:37.899298+0000","last_unstale":"2024-03-24T10:37:37.904111+0000","last_undegraded":"2024-03-24T10:37:37.904111+0000","last_fullsized":"2024-03-24T10:37:37.904111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891962+0000","last_change":"2024-03-24T10:37:37.891962+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891962+0000","last_undegraded":"2024-03-24T10:37:37.891962+0000","last_fullsized":"2024-03-24T10:37:37.891962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.905488+0000","last_change":"2024-03-24T10:37:37.904177+0000","last_active":"2024-03-24T10:37:37.905488+0000","last_peered":"2024-03-24T10:37:37.905488+0000","last_clean":"2024-03-24T10:37:37.905488+0000","last_became_active":"2024-03-24T10:37:37.903187+0000","last_became_peered":"2024-03-24T10:37:37.903187+0000","last_unstale":"2024-03-24T10:37:37.905488+0000","last_undegraded":"2024-03-24T10:37:37.905488+0000","last_fullsized":"2024-03-24T10:37:37.905488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896497+0000","last_change":"2024-03-24T10:37:37.896497+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896497+0000","last_undegraded":"2024-03-24T10:37:37.896497+0000","last_fullsized":"2024-03-24T10:37:37.896497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910132+0000","last_change":"2024-03-24T10:37:37.906772+0000","last_active":"2024-03-24T10:37:37.910132+0000","last_peered":"2024-03-24T10:37:37.910132+0000","last_clean":"2024-03-24T10:37:37.910132+0000","last_became_active":"2024-03-24T10:37:37.906391+0000","last_became_peered":"2024-03-24T10:37:37.906391+0000","last_unstale":"2024-03-24T10:37:37.910132+0000","last_undegraded":"2024-03-24T10:37:37.910132+0000","last_fullsized":"2024-03-24T10:37:37.910132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:18:19.260835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899213+0000","last_change":"2024-03-24T10:37:37.899213+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899213+0000","last_undegraded":"2024-03-24T10:37:37.899213+0000","last_fullsized":"2024-03-24T10:37:37.899213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915213+0000","last_change":"2024-03-24T10:37:37.910782+0000","last_active":"2024-03-24T10:37:37.915213+0000","last_peered":"2024-03-24T10:37:37.915213+0000","last_clean":"2024-03-24T10:37:37.915213+0000","last_became_active":"2024-03-24T10:37:37.910461+0000","last_became_peered":"2024-03-24T10:37:37.910461+0000","last_unstale":"2024-03-24T10:37:37.915213+0000","last_undegraded":"2024-03-24T10:37:37.915213+0000","last_fullsized":"2024-03-24T10:37:37.915213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897164+0000","last_change":"2024-03-24T10:37:37.897164+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897164+0000","last_undegraded":"2024-03-24T10:37:37.897164+0000","last_fullsized":"2024-03-24T10:37:37.897164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907142+0000","last_change":"2024-03-24T10:37:37.904351+0000","last_active":"2024-03-24T10:37:37.907142+0000","last_peered":"2024-03-24T10:37:37.907142+0000","last_clean":"2024-03-24T10:37:37.907142+0000","last_became_active":"2024-03-24T10:37:37.904065+0000","last_became_peered":"2024-03-24T10:37:37.904065+0000","last_unstale":"2024-03-24T10:37:37.907142+0000","last_undegraded":"2024-03-24T10:37:37.907142+0000","last_fullsized":"2024-03-24T10:37:37.907142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900328+0000","last_change":"2024-03-24T10:37:37.900328+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900328+0000","last_undegraded":"2024-03-24T10:37:37.900328+0000","last_fullsized":"2024-03-24T10:37:37.900328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906590+0000","last_change":"2024-03-24T10:37:37.904620+0000","last_active":"2024-03-24T10:37:37.906590+0000","last_peered":"2024-03-24T10:37:37.906590+0000","last_clean":"2024-03-24T10:37:37.906590+0000","last_became_active":"2024-03-24T10:37:37.904229+0000","last_became_peered":"2024-03-24T10:37:37.904229+0000","last_unstale":"2024-03-24T10:37:37.906590+0000","last_undegraded":"2024-03-24T10:37:37.906590+0000","last_fullsized":"2024-03-24T10:37:37.906590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:07:55.484727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896752+0000","last_change":"2024-03-24T10:37:37.896752+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896752+0000","last_undegraded":"2024-03-24T10:37:37.896752+0000","last_fullsized":"2024-03-24T10:37:37.896752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910949+0000","last_change":"2024-03-24T10:37:37.909979+0000","last_active":"2024-03-24T10:37:37.910949+0000","last_peered":"2024-03-24T10:37:37.910949+0000","last_clean":"2024-03-24T10:37:37.910949+0000","last_became_active":"2024-03-24T10:37:37.909723+0000","last_became_peered":"2024-03-24T10:37:37.909723+0000","last_unstale":"2024-03-24T10:37:37.910949+0000","last_undegraded":"2024-03-24T10:37:37.910949+0000","last_fullsized":"2024-03-24T10:37:37.910949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897882+0000","last_change":"2024-03-24T10:37:37.897882+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897882+0000","last_undegraded":"2024-03-24T10:37:37.897882+0000","last_fullsized":"2024-03-24T10:37:37.897882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907215+0000","last_change":"2024-03-24T10:37:37.903857+0000","last_active":"2024-03-24T10:37:37.907215+0000","last_peered":"2024-03-24T10:37:37.907215+0000","last_clean":"2024-03-24T10:37:37.907215+0000","last_became_active":"2024-03-24T10:37:37.903553+0000","last_became_peered":"2024-03-24T10:37:37.903553+0000","last_unstale":"2024-03-24T10:37:37.907215+0000","last_undegraded":"2024-03-24T10:37:37.907215+0000","last_fullsized":"2024-03-24T10:37:37.907215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897863+0000","last_change":"2024-03-24T10:37:37.897863+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897863+0000","last_undegraded":"2024-03-24T10:37:37.897863+0000","last_fullsized":"2024-03-24T10:37:37.897863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915092+0000","last_change":"2024-03-24T10:37:37.910698+0000","last_active":"2024-03-24T10:37:37.915092+0000","last_peered":"2024-03-24T10:37:37.915092+0000","last_clean":"2024-03-24T10:37:37.915092+0000","last_became_active":"2024-03-24T10:37:37.910415+0000","last_became_peered":"2024-03-24T10:37:37.910415+0000","last_unstale":"2024-03-24T10:37:37.915092+0000","last_undegraded":"2024-03-24T10:37:37.915092+0000","last_fullsized":"2024-03-24T10:37:37.915092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897156+0000","last_change":"2024-03-24T10:37:37.897156+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897156+0000","last_undegraded":"2024-03-24T10:37:37.897156+0000","last_fullsized":"2024-03-24T10:37:37.897156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915207+0000","last_change":"2024-03-24T10:37:37.910577+0000","last_active":"2024-03-24T10:37:37.915207+0000","last_peered":"2024-03-24T10:37:37.915207+0000","last_clean":"2024-03-24T10:37:37.915207+0000","last_became_active":"2024-03-24T10:37:37.910291+0000","last_became_peered":"2024-03-24T10:37:37.910291+0000","last_unstale":"2024-03-24T10:37:37.915207+0000","last_undegraded":"2024-03-24T10:37:37.915207+0000","last_fullsized":"2024-03-24T10:37:37.915207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:33.141389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897902+0000","last_change":"2024-03-24T10:37:37.897902+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897902+0000","last_undegraded":"2024-03-24T10:37:37.897902+0000","last_fullsized":"2024-03-24T10:37:37.897902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912319+0000","last_change":"2024-03-24T10:37:37.905571+0000","last_active":"2024-03-24T10:37:37.912319+0000","last_peered":"2024-03-24T10:37:37.912319+0000","last_clean":"2024-03-24T10:37:37.912319+0000","last_became_active":"2024-03-24T10:37:37.905308+0000","last_became_peered":"2024-03-24T10:37:37.905308+0000","last_unstale":"2024-03-24T10:37:37.912319+0000","last_undegraded":"2024-03-24T10:37:37.912319+0000","last_fullsized":"2024-03-24T10:37:37.912319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896234+0000","last_change":"2024-03-24T10:37:37.896234+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896234+0000","last_undegraded":"2024-03-24T10:37:37.896234+0000","last_fullsized":"2024-03-24T10:37:37.896234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907634+0000","last_change":"2024-03-24T10:37:37.905226+0000","last_active":"2024-03-24T10:37:37.907634+0000","last_peered":"2024-03-24T10:37:37.907634+0000","last_clean":"2024-03-24T10:37:37.907634+0000","last_became_active":"2024-03-24T10:37:37.904963+0000","last_became_peered":"2024-03-24T10:37:37.904963+0000","last_unstale":"2024-03-24T10:37:37.907634+0000","last_undegraded":"2024-03-24T10:37:37.907634+0000","last_fullsized":"2024-03-24T10:37:37.907634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:39:43.379881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891817+0000","last_change":"2024-03-24T10:37:37.891817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891817+0000","last_undegraded":"2024-03-24T10:37:37.891817+0000","last_fullsized":"2024-03-24T10:37:37.891817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911417+0000","last_change":"2024-03-24T10:37:37.910765+0000","last_active":"2024-03-24T10:37:37.911417+0000","last_peered":"2024-03-24T10:37:37.911417+0000","last_clean":"2024-03-24T10:37:37.911417+0000","last_became_active":"2024-03-24T10:37:37.910307+0000","last_became_peered":"2024-03-24T10:37:37.910307+0000","last_unstale":"2024-03-24T10:37:37.911417+0000","last_undegraded":"2024-03-24T10:37:37.911417+0000","last_fullsized":"2024-03-24T10:37:37.911417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896929+0000","last_change":"2024-03-24T10:37:37.896929+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896929+0000","last_undegraded":"2024-03-24T10:37:37.896929+0000","last_fullsized":"2024-03-24T10:37:37.896929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907030+0000","last_change":"2024-03-24T10:37:37.901724+0000","last_active":"2024-03-24T10:37:37.907030+0000","last_peered":"2024-03-24T10:37:37.907030+0000","last_clean":"2024-03-24T10:37:37.907030+0000","last_became_active":"2024-03-24T10:37:37.901315+0000","last_became_peered":"2024-03-24T10:37:37.901315+0000","last_unstale":"2024-03-24T10:37:37.907030+0000","last_undegraded":"2024-03-24T10:37:37.907030+0000","last_fullsized":"2024-03-24T10:37:37.907030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:28:51.991898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896823+0000","last_change":"2024-03-24T10:37:37.896823+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896823+0000","last_undegraded":"2024-03-24T10:37:37.896823+0000","last_fullsized":"2024-03-24T10:37:37.896823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907590+0000","last_change":"2024-03-24T10:37:37.903464+0000","last_active":"2024-03-24T10:37:37.907590+0000","last_peered":"2024-03-24T10:37:37.907590+0000","last_clean":"2024-03-24T10:37:37.907590+0000","last_became_active":"2024-03-24T10:37:37.903180+0000","last_became_peered":"2024-03-24T10:37:37.903180+0000","last_unstale":"2024-03-24T10:37:37.907590+0000","last_undegraded":"2024-03-24T10:37:37.907590+0000","last_fullsized":"2024-03-24T10:37:37.907590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:23:05.492306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899015+0000","last_change":"2024-03-24T10:37:37.899015+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899015+0000","last_undegraded":"2024-03-24T10:37:37.899015+0000","last_fullsized":"2024-03-24T10:37:37.899015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909797+0000","last_change":"2024-03-24T10:37:37.905304+0000","last_active":"2024-03-24T10:37:37.909797+0000","last_peered":"2024-03-24T10:37:37.909797+0000","last_clean":"2024-03-24T10:37:37.909797+0000","last_became_active":"2024-03-24T10:37:37.905048+0000","last_became_peered":"2024-03-24T10:37:37.905048+0000","last_unstale":"2024-03-24T10:37:37.909797+0000","last_undegraded":"2024-03-24T10:37:37.909797+0000","last_fullsized":"2024-03-24T10:37:37.909797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896172+0000","last_change":"2024-03-24T10:37:37.896172+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896172+0000","last_undegraded":"2024-03-24T10:37:37.896172+0000","last_fullsized":"2024-03-24T10:37:37.896172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.902478+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.901756+0000","last_became_peered":"2024-03-24T10:37:37.901756+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:08.271285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896774+0000","last_change":"2024-03-24T10:37:37.896774+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896774+0000","last_undegraded":"2024-03-24T10:37:37.896774+0000","last_fullsized":"2024-03-24T10:37:37.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915249+0000","last_change":"2024-03-24T10:37:37.911271+0000","last_active":"2024-03-24T10:37:37.915249+0000","last_peered":"2024-03-24T10:37:37.915249+0000","last_clean":"2024-03-24T10:37:37.915249+0000","last_became_active":"2024-03-24T10:37:37.910915+0000","last_became_peered":"2024-03-24T10:37:37.910915+0000","last_unstale":"2024-03-24T10:37:37.915249+0000","last_undegraded":"2024-03-24T10:37:37.915249+0000","last_fullsized":"2024-03-24T10:37:37.915249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896081+0000","last_change":"2024-03-24T10:37:37.896081+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896081+0000","last_undegraded":"2024-03-24T10:37:37.896081+0000","last_fullsized":"2024-03-24T10:37:37.896081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.905758+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.905480+0000","last_became_peered":"2024-03-24T10:37:37.905480+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:27.690294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895489+0000","last_change":"2024-03-24T10:37:37.895489+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895489+0000","last_undegraded":"2024-03-24T10:37:37.895489+0000","last_fullsized":"2024-03-24T10:37:37.895489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.908373+0000","last_change":"2024-03-24T10:37:37.903374+0000","last_active":"2024-03-24T10:37:37.908373+0000","last_peered":"2024-03-24T10:37:37.908373+0000","last_clean":"2024-03-24T10:37:37.908373+0000","last_became_active":"2024-03-24T10:37:37.903098+0000","last_became_peered":"2024-03-24T10:37:37.903098+0000","last_unstale":"2024-03-24T10:37:37.908373+0000","last_undegraded":"2024-03-24T10:37:37.908373+0000","last_fullsized":"2024-03-24T10:37:37.908373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897206+0000","last_change":"2024-03-24T10:37:37.897206+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897206+0000","last_undegraded":"2024-03-24T10:37:37.897206+0000","last_fullsized":"2024-03-24T10:37:37.897206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909111+0000","last_change":"2024-03-24T10:37:37.905326+0000","last_active":"2024-03-24T10:37:37.909111+0000","last_peered":"2024-03-24T10:37:37.909111+0000","last_clean":"2024-03-24T10:37:37.909111+0000","last_became_active":"2024-03-24T10:37:37.905024+0000","last_became_peered":"2024-03-24T10:37:37.905024+0000","last_unstale":"2024-03-24T10:37:37.909111+0000","last_undegraded":"2024-03-24T10:37:37.909111+0000","last_fullsized":"2024-03-24T10:37:37.909111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896545+0000","last_change":"2024-03-24T10:37:37.896545+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896545+0000","last_undegraded":"2024-03-24T10:37:37.896545+0000","last_fullsized":"2024-03-24T10:37:37.896545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907220+0000","last_change":"2024-03-24T10:37:37.901453+0000","last_active":"2024-03-24T10:37:37.907220+0000","last_peered":"2024-03-24T10:37:37.907220+0000","last_clean":"2024-03-24T10:37:37.907220+0000","last_became_active":"2024-03-24T10:37:37.901055+0000","last_became_peered":"2024-03-24T10:37:37.901055+0000","last_unstale":"2024-03-24T10:37:37.907220+0000","last_undegraded":"2024-03-24T10:37:37.907220+0000","last_fullsized":"2024-03-24T10:37:37.907220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:04:40.738769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896390+0000","last_change":"2024-03-24T10:37:37.896390+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896390+0000","last_undegraded":"2024-03-24T10:37:37.896390+0000","last_fullsized":"2024-03-24T10:37:37.896390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912259+0000","last_change":"2024-03-24T10:37:37.904998+0000","last_active":"2024-03-24T10:37:37.912259+0000","last_peered":"2024-03-24T10:37:37.912259+0000","last_clean":"2024-03-24T10:37:37.912259+0000","last_became_active":"2024-03-24T10:37:37.904745+0000","last_became_peered":"2024-03-24T10:37:37.904745+0000","last_unstale":"2024-03-24T10:37:37.912259+0000","last_undegraded":"2024-03-24T10:37:37.912259+0000","last_fullsized":"2024-03-24T10:37:37.912259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:11:58.871597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896013+0000","last_change":"2024-03-24T10:37:37.896013+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896013+0000","last_undegraded":"2024-03-24T10:37:37.896013+0000","last_fullsized":"2024-03-24T10:37:37.896013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906527+0000","last_change":"2024-03-24T10:37:37.904862+0000","last_active":"2024-03-24T10:37:37.906527+0000","last_peered":"2024-03-24T10:37:37.906527+0000","last_clean":"2024-03-24T10:37:37.906527+0000","last_became_active":"2024-03-24T10:37:37.904560+0000","last_became_peered":"2024-03-24T10:37:37.904560+0000","last_unstale":"2024-03-24T10:37:37.906527+0000","last_undegraded":"2024-03-24T10:37:37.906527+0000","last_fullsized":"2024-03-24T10:37:37.906527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:35.200711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.901263+0000","last_change":"2024-03-24T10:37:37.901263+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.901263+0000","last_undegraded":"2024-03-24T10:37:37.901263+0000","last_fullsized":"2024-03-24T10:37:37.901263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912379+0000","last_change":"2024-03-24T10:37:37.908640+0000","last_active":"2024-03-24T10:37:37.912379+0000","last_peered":"2024-03-24T10:37:37.912379+0000","last_clean":"2024-03-24T10:37:37.912379+0000","last_became_active":"2024-03-24T10:37:37.908411+0000","last_became_peered":"2024-03-24T10:37:37.908411+0000","last_unstale":"2024-03-24T10:37:37.912379+0000","last_undegraded":"2024-03-24T10:37:37.912379+0000","last_fullsized":"2024-03-24T10:37:37.912379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.898830+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:37:37.898830+0000","last_peered":"2024-03-24T10:37:37.898830+0000","last_clean":"2024-03-24T10:37:37.898830+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:37:37.898830+0000","last_undegraded":"2024-03-24T10:37:37.898830+0000","last_fullsized":"2024-03-24T10:37:37.898830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":771208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":180840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:37:41.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:37:42.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.024+0000 7f9da250c640 1 Processor -- start 2024-03-24T10:37:42.025 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.024+0000 7f9da250c640 1 -- start start 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da250c640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f9d9c15e170 0x7f9d9c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da250c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d9c0d4930 0x7f9d9c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da250c640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d9c0d4e50 con 0x7f9d9c0d2280 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da250c640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9c0cf790 con 0x7f9d9c0d4930 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da250c640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f9d9c0cfa70 con 0x7f9d9c15e170 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9d9b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d9c0d4930 0x7f9d9c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da0aa9640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9d9c0d2280 0x7f9d9c0d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42512/0 (socket says 172.21.15.72:42512) 2024-03-24T10:37:42.027 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9d9b7fe640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d9c0d4930 0x7f9d9c0d1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51732/0 (socket says 172.21.15.72:51732) 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9da0aa9640 1 -- 172.21.15.72:0/107320071 learned_addr learned my addr 172.21.15.72:0/107320071 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.025+0000 7f9d9bfff640 1 --2- 172.21.15.72:0/107320071 >> v2:172.21.15.79:3300/0 conn(0x7f9d9c15e170 0x7f9d9c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9b7fe640 1 -- 172.21.15.72:0/107320071 >> v2:172.21.15.79:3300/0 conn(0x7f9d9c15e170 msgr2=0x7f9d9c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9b7fe640 1 --2- 172.21.15.72:0/107320071 >> v2:172.21.15.79:3300/0 conn(0x7f9d9c15e170 0x7f9d9c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9b7fe640 1 -- 172.21.15.72:0/107320071 >> v1:172.21.15.72:6789/0 conn(0x7f9d9c0d2280 legacy=0x7f9d9c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9affd640 1 -- 172.21.15.72:0/107320071 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594065035 0 0) 0x7f9d9c0d4e50 con 0x7f9d9c0d2280 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9b7fe640 1 -- 172.21.15.72:0/107320071 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d9c0cfd50 con 0x7f9d9c0d4930 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9b7fe640 1 --2- 172.21.15.72:0/107320071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c0d4930 0x7f9d9c0d1d40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b6b20 tx=0x7f9d9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5161cc5491d66d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.026+0000 7f9d9affd640 1 -- 172.21.15.72:0/107320071 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9002e070 con 0x7f9d9c0d4930 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9d9affd640 1 -- 172.21.15.72:0/107320071 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d900315a0 con 0x7f9d9c0d4930 2024-03-24T10:37:42.028 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9d9affd640 1 -- 172.21.15.72:0/107320071 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d90031930 con 0x7f9d9c0d4930 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 -- 172.21.15.72:0/107320071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c0d4930 msgr2=0x7f9d9c0d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 --2- 172.21.15.72:0/107320071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c0d4930 0x7f9d9c0d1d40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0b6b20 tx=0x7f9d9002b840 comp rx=0 tx=0).stop 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 -- 172.21.15.72:0/107320071 shutdown_connections 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 --2- 172.21.15.72:0/107320071 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c0d4930 0x7f9d9c0d1d40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 --2- 172.21.15.72:0/107320071 >> v2:172.21.15.79:3300/0 conn(0x7f9d9c15e170 0x7f9d9c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 -- 172.21.15.72:0/107320071 >> 172.21.15.72:0/107320071 conn(0x7f9d9c09d310 msgr2=0x7f9d9c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 -- 172.21.15.72:0/107320071 shutdown_connections 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.027+0000 7f9da250c640 1 -- 172.21.15.72:0/107320071 wait complete. 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.028+0000 7f9da250c640 1 Processor -- start 2024-03-24T10:37:42.031 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.028+0000 7f9da250c640 1 -- start start 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da250c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9c0d2280 0x7f9d9c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da250c640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d9c0d4930 0x7f9d9c0b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da250c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 0x7f9d9c06bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da250c640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c0b8030 con 0x7f9d9c15e170 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da250c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9d9c0b7180 con 0x7f9d9c0d2280 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da250c640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f9d9c0b73b0 con 0x7f9d9c0d4930 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 0x7f9d9c06bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 0x7f9d9c06bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51736/0 (socket says 172.21.15.72:51736) 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 -- 172.21.15.72:0/579596435 learned_addr learned my addr 172.21.15.72:0/579596435 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9d9bfff640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9c0d2280 0x7f9d9c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9d9b7fe640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d9c0d4930 0x7f9d9c0b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 -- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d9c0d4930 msgr2=0x7f9d9c0b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.032 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d9c0d4930 0x7f9d9c0b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 -- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9c0d2280 msgr2=0x7f9d9c06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.029+0000 7f9da0aa9640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9c0d2280 0x7f9d9c06d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9da0aa9640 1 -- 172.21.15.72:0/579596435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d90009400 con 0x7f9d9c15e170 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9da0aa9640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 0x7f9d9c06bf50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400c700 tx=0x7f9d9400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400ce10 con 0x7f9d9c15e170 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9400a640 con 0x7f9d9c15e170 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d9c0b7690 con 0x7f9d9c15e170 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400aa70 con 0x7f9d9c15e170 2024-03-24T10:37:42.033 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.030+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d9c0b7c50 con 0x7f9d9c15e170 2024-03-24T10:37:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.031+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d9c0b8170 con 0x7f9d9c15e170 2024-03-24T10:37:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.031+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f9d9400abd0 con 0x7f9d9c15e170 2024-03-24T10:37:42.034 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.032+0000 7f9d98ff9640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9d8806b810 0x7f9d8806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.032+0000 7f9d9bfff640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9d8806b810 0x7f9d8806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.032+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9d94089a40 con 0x7f9d9c15e170 2024-03-24T10:37:42.035 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.032+0000 7f9d9bfff640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9d8806b810 0x7f9d8806dcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009b40 tx=0x7f9d8c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.036 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.036+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f9d9c0b8170 con 0x7f9d9c15e170 2024-03-24T10:37:42.205 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.204+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9d9c0b8170 con 0x7f9d8806b810 2024-03-24T10:37:42.210 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.210+0000 7f9d98ff9640 1 -- 172.21.15.72:0/579596435 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246633 (secure 0 0 0) 0x7f9d9c0b8170 con 0x7f9d8806b810 2024-03-24T10:37:42.213 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:42.214 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9d8806b810 msgr2=0x7f9d8806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9d8806b810 0x7f9d8806dcd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c009b40 tx=0x7f9d8c009190 comp rx=0 tx=0).stop 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 msgr2=0x7f9d9c06bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 0x7f9d9c06bf50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d9400c700 tx=0x7f9d9400cbc0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 shutdown_connections 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f9d8806b810 0x7f9d8806dcd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d9c15e170 0x7f9d9c06bf50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f9d9c0d4930 0x7f9d9c0b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 --2- 172.21.15.72:0/579596435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9d9c0d2280 0x7f9d9c06d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 >> 172.21.15.72:0/579596435 conn(0x7f9d9c09d310 msgr2=0x7f9d9c0d3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 shutdown_connections 2024-03-24T10:37:42.216 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.213+0000 7f9da250c640 1 -- 172.21.15.72:0/579596435 wait complete. 2024-03-24T10:37:42.224 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-24T10:37:42.154899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4521984,"data_stored":2587454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267558"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903688+0000","last_change":"2024-03-24T10:37:37.903688+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903688+0000","last_undegraded":"2024-03-24T10:37:37.903688+0000","last_fullsized":"2024-03-24T10:37:37.903688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903058+0000","last_change":"2024-03-24T10:37:37.903058+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903058+0000","last_undegraded":"2024-03-24T10:37:37.903058+0000","last_fullsized":"2024-03-24T10:37:37.903058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899438+0000","last_change":"2024-03-24T10:37:37.899438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899438+0000","last_undegraded":"2024-03-24T10:37:37.899438+0000","last_fullsized":"2024-03-24T10:37:37.899438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.893122+0000","last_change":"2024-03-24T10:37:37.893122+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.893122+0000","last_undegraded":"2024-03-24T10:37:37.893122+0000","last_fullsized":"2024-03-24T10:37:37.893122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892817+0000","last_change":"2024-03-24T10:37:37.892817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892817+0000","last_undegraded":"2024-03-24T10:37:37.892817+0000","last_fullsized":"2024-03-24T10:37:37.892817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896070+0000","last_change":"2024-03-24T10:37:37.896070+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896070+0000","last_undegraded":"2024-03-24T10:37:37.896070+0000","last_fullsized":"2024-03-24T10:37:37.896070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897525+0000","last_change":"2024-03-24T10:37:37.897525+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897525+0000","last_undegraded":"2024-03-24T10:37:37.897525+0000","last_fullsized":"2024-03-24T10:37:37.897525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902809+0000","last_change":"2024-03-24T10:37:37.902809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902809+0000","last_undegraded":"2024-03-24T10:37:37.902809+0000","last_fullsized":"2024-03-24T10:37:37.902809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897438+0000","last_change":"2024-03-24T10:37:37.897438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897438+0000","last_undegraded":"2024-03-24T10:37:37.897438+0000","last_fullsized":"2024-03-24T10:37:37.897438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900491+0000","last_change":"2024-03-24T10:37:37.900491+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900491+0000","last_undegraded":"2024-03-24T10:37:37.900491+0000","last_fullsized":"2024-03-24T10:37:37.900491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898449+0000","last_change":"2024-03-24T10:37:37.898449+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898449+0000","last_undegraded":"2024-03-24T10:37:37.898449+0000","last_fullsized":"2024-03-24T10:37:37.898449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897893+0000","last_change":"2024-03-24T10:37:37.897893+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897893+0000","last_undegraded":"2024-03-24T10:37:37.897893+0000","last_fullsized":"2024-03-24T10:37:37.897893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896759+0000","last_change":"2024-03-24T10:37:37.896759+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896759+0000","last_undegraded":"2024-03-24T10:37:37.896759+0000","last_fullsized":"2024-03-24T10:37:37.896759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896816+0000","last_change":"2024-03-24T10:37:37.896816+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896816+0000","last_undegraded":"2024-03-24T10:37:37.896816+0000","last_fullsized":"2024-03-24T10:37:37.896816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896809+0000","last_change":"2024-03-24T10:37:37.896809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896809+0000","last_undegraded":"2024-03-24T10:37:37.896809+0000","last_fullsized":"2024-03-24T10:37:37.896809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898296+0000","last_change":"2024-03-24T10:37:37.898296+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898296+0000","last_undegraded":"2024-03-24T10:37:37.898296+0000","last_fullsized":"2024-03-24T10:37:37.898296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895588+0000","last_change":"2024-03-24T10:37:37.895588+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895588+0000","last_undegraded":"2024-03-24T10:37:37.895588+0000","last_fullsized":"2024-03-24T10:37:37.895588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892669+0000","last_change":"2024-03-24T10:37:37.892669+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892669+0000","last_undegraded":"2024-03-24T10:37:37.892669+0000","last_fullsized":"2024-03-24T10:37:37.892669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892308+0000","last_change":"2024-03-24T10:37:37.892308+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892308+0000","last_undegraded":"2024-03-24T10:37:37.892308+0000","last_fullsized":"2024-03-24T10:37:37.892308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892152+0000","last_change":"2024-03-24T10:37:37.892152+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892152+0000","last_undegraded":"2024-03-24T10:37:37.892152+0000","last_fullsized":"2024-03-24T10:37:37.892152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897175+0000","last_change":"2024-03-24T10:37:37.897175+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897175+0000","last_undegraded":"2024-03-24T10:37:37.897175+0000","last_fullsized":"2024-03-24T10:37:37.897175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.894607+0000","last_change":"2024-03-24T10:37:37.894607+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.894607+0000","last_undegraded":"2024-03-24T10:37:37.894607+0000","last_fullsized":"2024-03-24T10:37:37.894607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896247+0000","last_change":"2024-03-24T10:37:37.896247+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896247+0000","last_undegraded":"2024-03-24T10:37:37.896247+0000","last_fullsized":"2024-03-24T10:37:37.896247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892180+0000","last_change":"2024-03-24T10:37:37.892180+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892180+0000","last_undegraded":"2024-03-24T10:37:37.892180+0000","last_fullsized":"2024-03-24T10:37:37.892180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892493+0000","last_change":"2024-03-24T10:37:37.892493+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892493+0000","last_undegraded":"2024-03-24T10:37:37.892493+0000","last_fullsized":"2024-03-24T10:37:37.892493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898870+0000","last_change":"2024-03-24T10:37:37.898870+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898870+0000","last_undegraded":"2024-03-24T10:37:37.898870+0000","last_fullsized":"2024-03-24T10:37:37.898870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892322+0000","last_change":"2024-03-24T10:37:37.892322+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892322+0000","last_undegraded":"2024-03-24T10:37:37.892322+0000","last_fullsized":"2024-03-24T10:37:37.892322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897226+0000","last_change":"2024-03-24T10:37:37.897226+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897226+0000","last_undegraded":"2024-03-24T10:37:37.897226+0000","last_fullsized":"2024-03-24T10:37:37.897226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892208+0000","last_change":"2024-03-24T10:37:37.892208+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892208+0000","last_undegraded":"2024-03-24T10:37:37.892208+0000","last_fullsized":"2024-03-24T10:37:37.892208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892128+0000","last_change":"2024-03-24T10:37:37.892128+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892128+0000","last_undegraded":"2024-03-24T10:37:37.892128+0000","last_fullsized":"2024-03-24T10:37:37.892128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895503+0000","last_change":"2024-03-24T10:37:37.895503+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895503+0000","last_undegraded":"2024-03-24T10:37:37.895503+0000","last_fullsized":"2024-03-24T10:37:37.895503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896106+0000","last_change":"2024-03-24T10:37:37.896106+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896106+0000","last_undegraded":"2024-03-24T10:37:37.896106+0000","last_fullsized":"2024-03-24T10:37:37.896106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898571+0000","last_change":"2024-03-24T10:37:37.898571+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898571+0000","last_undegraded":"2024-03-24T10:37:37.898571+0000","last_fullsized":"2024-03-24T10:37:37.898571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907166+0000","last_change":"2024-03-24T10:37:37.902780+0000","last_active":"2024-03-24T10:37:37.907166+0000","last_peered":"2024-03-24T10:37:37.907166+0000","last_clean":"2024-03-24T10:37:37.907166+0000","last_became_active":"2024-03-24T10:37:37.902533+0000","last_became_peered":"2024-03-24T10:37:37.902533+0000","last_unstale":"2024-03-24T10:37:37.907166+0000","last_undegraded":"2024-03-24T10:37:37.907166+0000","last_fullsized":"2024-03-24T10:37:37.907166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:49:58.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897531+0000","last_change":"2024-03-24T10:37:37.897531+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897531+0000","last_undegraded":"2024-03-24T10:37:37.897531+0000","last_fullsized":"2024-03-24T10:37:37.897531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909224+0000","last_change":"2024-03-24T10:37:37.906862+0000","last_active":"2024-03-24T10:37:37.909224+0000","last_peered":"2024-03-24T10:37:37.909224+0000","last_clean":"2024-03-24T10:37:37.909224+0000","last_became_active":"2024-03-24T10:37:37.906602+0000","last_became_peered":"2024-03-24T10:37:37.906602+0000","last_unstale":"2024-03-24T10:37:37.909224+0000","last_undegraded":"2024-03-24T10:37:37.909224+0000","last_fullsized":"2024-03-24T10:37:37.909224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895250+0000","last_change":"2024-03-24T10:37:37.895250+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895250+0000","last_undegraded":"2024-03-24T10:37:37.895250+0000","last_fullsized":"2024-03-24T10:37:37.895250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910444+0000","last_change":"2024-03-24T10:37:37.908810+0000","last_active":"2024-03-24T10:37:37.910444+0000","last_peered":"2024-03-24T10:37:37.910444+0000","last_clean":"2024-03-24T10:37:37.910444+0000","last_became_active":"2024-03-24T10:37:37.908519+0000","last_became_peered":"2024-03-24T10:37:37.908519+0000","last_unstale":"2024-03-24T10:37:37.910444+0000","last_undegraded":"2024-03-24T10:37:37.910444+0000","last_fullsized":"2024-03-24T10:37:37.910444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902283+0000","last_change":"2024-03-24T10:37:37.902283+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902283+0000","last_undegraded":"2024-03-24T10:37:37.902283+0000","last_fullsized":"2024-03-24T10:37:37.902283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909634+0000","last_change":"2024-03-24T10:37:37.903962+0000","last_active":"2024-03-24T10:37:37.909634+0000","last_peered":"2024-03-24T10:37:37.909634+0000","last_clean":"2024-03-24T10:37:37.909634+0000","last_became_active":"2024-03-24T10:37:37.903706+0000","last_became_peered":"2024-03-24T10:37:37.903706+0000","last_unstale":"2024-03-24T10:37:37.909634+0000","last_undegraded":"2024-03-24T10:37:37.909634+0000","last_fullsized":"2024-03-24T10:37:37.909634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:48:26.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900728+0000","last_change":"2024-03-24T10:37:37.900728+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900728+0000","last_undegraded":"2024-03-24T10:37:37.900728+0000","last_fullsized":"2024-03-24T10:37:37.900728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909177+0000","last_change":"2024-03-24T10:37:37.901965+0000","last_active":"2024-03-24T10:37:37.909177+0000","last_peered":"2024-03-24T10:37:37.909177+0000","last_clean":"2024-03-24T10:37:37.909177+0000","last_became_active":"2024-03-24T10:37:37.901710+0000","last_became_peered":"2024-03-24T10:37:37.901710+0000","last_unstale":"2024-03-24T10:37:37.909177+0000","last_undegraded":"2024-03-24T10:37:37.909177+0000","last_fullsized":"2024-03-24T10:37:37.909177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896382+0000","last_change":"2024-03-24T10:37:37.896382+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896382+0000","last_undegraded":"2024-03-24T10:37:37.896382+0000","last_fullsized":"2024-03-24T10:37:37.896382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.917775+0000","last_change":"2024-03-24T10:37:37.912877+0000","last_active":"2024-03-24T10:37:37.917775+0000","last_peered":"2024-03-24T10:37:37.917775+0000","last_clean":"2024-03-24T10:37:37.917775+0000","last_became_active":"2024-03-24T10:37:37.912621+0000","last_became_peered":"2024-03-24T10:37:37.912621+0000","last_unstale":"2024-03-24T10:37:37.917775+0000","last_undegraded":"2024-03-24T10:37:37.917775+0000","last_fullsized":"2024-03-24T10:37:37.917775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895952+0000","last_change":"2024-03-24T10:37:37.895952+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895952+0000","last_undegraded":"2024-03-24T10:37:37.895952+0000","last_fullsized":"2024-03-24T10:37:37.895952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911073+0000","last_change":"2024-03-24T10:37:37.910516+0000","last_active":"2024-03-24T10:37:37.911073+0000","last_peered":"2024-03-24T10:37:37.911073+0000","last_clean":"2024-03-24T10:37:37.911073+0000","last_became_active":"2024-03-24T10:37:37.910186+0000","last_became_peered":"2024-03-24T10:37:37.910186+0000","last_unstale":"2024-03-24T10:37:37.911073+0000","last_undegraded":"2024-03-24T10:37:37.911073+0000","last_fullsized":"2024-03-24T10:37:37.911073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898841+0000","last_change":"2024-03-24T10:37:37.898841+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898841+0000","last_undegraded":"2024-03-24T10:37:37.898841+0000","last_fullsized":"2024-03-24T10:37:37.898841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.904111+0000","last_change":"2024-03-24T10:37:37.899890+0000","last_active":"2024-03-24T10:37:37.904111+0000","last_peered":"2024-03-24T10:37:37.904111+0000","last_clean":"2024-03-24T10:37:37.904111+0000","last_became_active":"2024-03-24T10:37:37.899298+0000","last_became_peered":"2024-03-24T10:37:37.899298+0000","last_unstale":"2024-03-24T10:37:37.904111+0000","last_undegraded":"2024-03-24T10:37:37.904111+0000","last_fullsized":"2024-03-24T10:37:37.904111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891962+0000","last_change":"2024-03-24T10:37:37.891962+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891962+0000","last_undegraded":"2024-03-24T10:37:37.891962+0000","last_fullsized":"2024-03-24T10:37:37.891962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.905488+0000","last_change":"2024-03-24T10:37:37.904177+0000","last_active":"2024-03-24T10:37:37.905488+0000","last_peered":"2024-03-24T10:37:37.905488+0000","last_clean":"2024-03-24T10:37:37.905488+0000","last_became_active":"2024-03-24T10:37:37.903187+0000","last_became_peered":"2024-03-24T10:37:37.903187+0000","last_unstale":"2024-03-24T10:37:37.905488+0000","last_undegraded":"2024-03-24T10:37:37.905488+0000","last_fullsized":"2024-03-24T10:37:37.905488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896497+0000","last_change":"2024-03-24T10:37:37.896497+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896497+0000","last_undegraded":"2024-03-24T10:37:37.896497+0000","last_fullsized":"2024-03-24T10:37:37.896497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910132+0000","last_change":"2024-03-24T10:37:37.906772+0000","last_active":"2024-03-24T10:37:37.910132+0000","last_peered":"2024-03-24T10:37:37.910132+0000","last_clean":"2024-03-24T10:37:37.910132+0000","last_became_active":"2024-03-24T10:37:37.906391+0000","last_became_peered":"2024-03-24T10:37:37.906391+0000","last_unstale":"2024-03-24T10:37:37.910132+0000","last_undegraded":"2024-03-24T10:37:37.910132+0000","last_fullsized":"2024-03-24T10:37:37.910132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:18:19.260835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899213+0000","last_change":"2024-03-24T10:37:37.899213+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899213+0000","last_undegraded":"2024-03-24T10:37:37.899213+0000","last_fullsized":"2024-03-24T10:37:37.899213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915213+0000","last_change":"2024-03-24T10:37:37.910782+0000","last_active":"2024-03-24T10:37:37.915213+0000","last_peered":"2024-03-24T10:37:37.915213+0000","last_clean":"2024-03-24T10:37:37.915213+0000","last_became_active":"2024-03-24T10:37:37.910461+0000","last_became_peered":"2024-03-24T10:37:37.910461+0000","last_unstale":"2024-03-24T10:37:37.915213+0000","last_undegraded":"2024-03-24T10:37:37.915213+0000","last_fullsized":"2024-03-24T10:37:37.915213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897164+0000","last_change":"2024-03-24T10:37:37.897164+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897164+0000","last_undegraded":"2024-03-24T10:37:37.897164+0000","last_fullsized":"2024-03-24T10:37:37.897164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907142+0000","last_change":"2024-03-24T10:37:37.904351+0000","last_active":"2024-03-24T10:37:37.907142+0000","last_peered":"2024-03-24T10:37:37.907142+0000","last_clean":"2024-03-24T10:37:37.907142+0000","last_became_active":"2024-03-24T10:37:37.904065+0000","last_became_peered":"2024-03-24T10:37:37.904065+0000","last_unstale":"2024-03-24T10:37:37.907142+0000","last_undegraded":"2024-03-24T10:37:37.907142+0000","last_fullsized":"2024-03-24T10:37:37.907142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900328+0000","last_change":"2024-03-24T10:37:37.900328+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900328+0000","last_undegraded":"2024-03-24T10:37:37.900328+0000","last_fullsized":"2024-03-24T10:37:37.900328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906590+0000","last_change":"2024-03-24T10:37:37.904620+0000","last_active":"2024-03-24T10:37:37.906590+0000","last_peered":"2024-03-24T10:37:37.906590+0000","last_clean":"2024-03-24T10:37:37.906590+0000","last_became_active":"2024-03-24T10:37:37.904229+0000","last_became_peered":"2024-03-24T10:37:37.904229+0000","last_unstale":"2024-03-24T10:37:37.906590+0000","last_undegraded":"2024-03-24T10:37:37.906590+0000","last_fullsized":"2024-03-24T10:37:37.906590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:07:55.484727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896752+0000","last_change":"2024-03-24T10:37:37.896752+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896752+0000","last_undegraded":"2024-03-24T10:37:37.896752+0000","last_fullsized":"2024-03-24T10:37:37.896752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910949+0000","last_change":"2024-03-24T10:37:37.909979+0000","last_active":"2024-03-24T10:37:37.910949+0000","last_peered":"2024-03-24T10:37:37.910949+0000","last_clean":"2024-03-24T10:37:37.910949+0000","last_became_active":"2024-03-24T10:37:37.909723+0000","last_became_peered":"2024-03-24T10:37:37.909723+0000","last_unstale":"2024-03-24T10:37:37.910949+0000","last_undegraded":"2024-03-24T10:37:37.910949+0000","last_fullsized":"2024-03-24T10:37:37.910949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897882+0000","last_change":"2024-03-24T10:37:37.897882+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897882+0000","last_undegraded":"2024-03-24T10:37:37.897882+0000","last_fullsized":"2024-03-24T10:37:37.897882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907215+0000","last_change":"2024-03-24T10:37:37.903857+0000","last_active":"2024-03-24T10:37:37.907215+0000","last_peered":"2024-03-24T10:37:37.907215+0000","last_clean":"2024-03-24T10:37:37.907215+0000","last_became_active":"2024-03-24T10:37:37.903553+0000","last_became_peered":"2024-03-24T10:37:37.903553+0000","last_unstale":"2024-03-24T10:37:37.907215+0000","last_undegraded":"2024-03-24T10:37:37.907215+0000","last_fullsized":"2024-03-24T10:37:37.907215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897863+0000","last_change":"2024-03-24T10:37:37.897863+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897863+0000","last_undegraded":"2024-03-24T10:37:37.897863+0000","last_fullsized":"2024-03-24T10:37:37.897863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915092+0000","last_change":"2024-03-24T10:37:37.910698+0000","last_active":"2024-03-24T10:37:37.915092+0000","last_peered":"2024-03-24T10:37:37.915092+0000","last_clean":"2024-03-24T10:37:37.915092+0000","last_became_active":"2024-03-24T10:37:37.910415+0000","last_became_peered":"2024-03-24T10:37:37.910415+0000","last_unstale":"2024-03-24T10:37:37.915092+0000","last_undegraded":"2024-03-24T10:37:37.915092+0000","last_fullsized":"2024-03-24T10:37:37.915092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897156+0000","last_change":"2024-03-24T10:37:37.897156+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897156+0000","last_undegraded":"2024-03-24T10:37:37.897156+0000","last_fullsized":"2024-03-24T10:37:37.897156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915207+0000","last_change":"2024-03-24T10:37:37.910577+0000","last_active":"2024-03-24T10:37:37.915207+0000","last_peered":"2024-03-24T10:37:37.915207+0000","last_clean":"2024-03-24T10:37:37.915207+0000","last_became_active":"2024-03-24T10:37:37.910291+0000","last_became_peered":"2024-03-24T10:37:37.910291+0000","last_unstale":"2024-03-24T10:37:37.915207+0000","last_undegraded":"2024-03-24T10:37:37.915207+0000","last_fullsized":"2024-03-24T10:37:37.915207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:33.141389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897902+0000","last_change":"2024-03-24T10:37:37.897902+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897902+0000","last_undegraded":"2024-03-24T10:37:37.897902+0000","last_fullsized":"2024-03-24T10:37:37.897902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912319+0000","last_change":"2024-03-24T10:37:37.905571+0000","last_active":"2024-03-24T10:37:37.912319+0000","last_peered":"2024-03-24T10:37:37.912319+0000","last_clean":"2024-03-24T10:37:37.912319+0000","last_became_active":"2024-03-24T10:37:37.905308+0000","last_became_peered":"2024-03-24T10:37:37.905308+0000","last_unstale":"2024-03-24T10:37:37.912319+0000","last_undegraded":"2024-03-24T10:37:37.912319+0000","last_fullsized":"2024-03-24T10:37:37.912319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896234+0000","last_change":"2024-03-24T10:37:37.896234+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896234+0000","last_undegraded":"2024-03-24T10:37:37.896234+0000","last_fullsized":"2024-03-24T10:37:37.896234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907634+0000","last_change":"2024-03-24T10:37:37.905226+0000","last_active":"2024-03-24T10:37:37.907634+0000","last_peered":"2024-03-24T10:37:37.907634+0000","last_clean":"2024-03-24T10:37:37.907634+0000","last_became_active":"2024-03-24T10:37:37.904963+0000","last_became_peered":"2024-03-24T10:37:37.904963+0000","last_unstale":"2024-03-24T10:37:37.907634+0000","last_undegraded":"2024-03-24T10:37:37.907634+0000","last_fullsized":"2024-03-24T10:37:37.907634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:39:43.379881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891817+0000","last_change":"2024-03-24T10:37:37.891817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891817+0000","last_undegraded":"2024-03-24T10:37:37.891817+0000","last_fullsized":"2024-03-24T10:37:37.891817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911417+0000","last_change":"2024-03-24T10:37:37.910765+0000","last_active":"2024-03-24T10:37:37.911417+0000","last_peered":"2024-03-24T10:37:37.911417+0000","last_clean":"2024-03-24T10:37:37.911417+0000","last_became_active":"2024-03-24T10:37:37.910307+0000","last_became_peered":"2024-03-24T10:37:37.910307+0000","last_unstale":"2024-03-24T10:37:37.911417+0000","last_undegraded":"2024-03-24T10:37:37.911417+0000","last_fullsized":"2024-03-24T10:37:37.911417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896929+0000","last_change":"2024-03-24T10:37:37.896929+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896929+0000","last_undegraded":"2024-03-24T10:37:37.896929+0000","last_fullsized":"2024-03-24T10:37:37.896929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907030+0000","last_change":"2024-03-24T10:37:37.901724+0000","last_active":"2024-03-24T10:37:37.907030+0000","last_peered":"2024-03-24T10:37:37.907030+0000","last_clean":"2024-03-24T10:37:37.907030+0000","last_became_active":"2024-03-24T10:37:37.901315+0000","last_became_peered":"2024-03-24T10:37:37.901315+0000","last_unstale":"2024-03-24T10:37:37.907030+0000","last_undegraded":"2024-03-24T10:37:37.907030+0000","last_fullsized":"2024-03-24T10:37:37.907030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:28:51.991898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896823+0000","last_change":"2024-03-24T10:37:37.896823+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896823+0000","last_undegraded":"2024-03-24T10:37:37.896823+0000","last_fullsized":"2024-03-24T10:37:37.896823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907590+0000","last_change":"2024-03-24T10:37:37.903464+0000","last_active":"2024-03-24T10:37:37.907590+0000","last_peered":"2024-03-24T10:37:37.907590+0000","last_clean":"2024-03-24T10:37:37.907590+0000","last_became_active":"2024-03-24T10:37:37.903180+0000","last_became_peered":"2024-03-24T10:37:37.903180+0000","last_unstale":"2024-03-24T10:37:37.907590+0000","last_undegraded":"2024-03-24T10:37:37.907590+0000","last_fullsized":"2024-03-24T10:37:37.907590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:23:05.492306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899015+0000","last_change":"2024-03-24T10:37:37.899015+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899015+0000","last_undegraded":"2024-03-24T10:37:37.899015+0000","last_fullsized":"2024-03-24T10:37:37.899015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909797+0000","last_change":"2024-03-24T10:37:37.905304+0000","last_active":"2024-03-24T10:37:37.909797+0000","last_peered":"2024-03-24T10:37:37.909797+0000","last_clean":"2024-03-24T10:37:37.909797+0000","last_became_active":"2024-03-24T10:37:37.905048+0000","last_became_peered":"2024-03-24T10:37:37.905048+0000","last_unstale":"2024-03-24T10:37:37.909797+0000","last_undegraded":"2024-03-24T10:37:37.909797+0000","last_fullsized":"2024-03-24T10:37:37.909797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896172+0000","last_change":"2024-03-24T10:37:37.896172+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896172+0000","last_undegraded":"2024-03-24T10:37:37.896172+0000","last_fullsized":"2024-03-24T10:37:37.896172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.902478+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.901756+0000","last_became_peered":"2024-03-24T10:37:37.901756+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:08.271285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896774+0000","last_change":"2024-03-24T10:37:37.896774+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896774+0000","last_undegraded":"2024-03-24T10:37:37.896774+0000","last_fullsized":"2024-03-24T10:37:37.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915249+0000","last_change":"2024-03-24T10:37:37.911271+0000","last_active":"2024-03-24T10:37:37.915249+0000","last_peered":"2024-03-24T10:37:37.915249+0000","last_clean":"2024-03-24T10:37:37.915249+0000","last_became_active":"2024-03-24T10:37:37.910915+0000","last_became_peered":"2024-03-24T10:37:37.910915+0000","last_unstale":"2024-03-24T10:37:37.915249+0000","last_undegraded":"2024-03-24T10:37:37.915249+0000","last_fullsized":"2024-03-24T10:37:37.915249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896081+0000","last_change":"2024-03-24T10:37:37.896081+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896081+0000","last_undegraded":"2024-03-24T10:37:37.896081+0000","last_fullsized":"2024-03-24T10:37:37.896081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.905758+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.905480+0000","last_became_peered":"2024-03-24T10:37:37.905480+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:27.690294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895489+0000","last_change":"2024-03-24T10:37:37.895489+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895489+0000","last_undegraded":"2024-03-24T10:37:37.895489+0000","last_fullsized":"2024-03-24T10:37:37.895489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.908373+0000","last_change":"2024-03-24T10:37:37.903374+0000","last_active":"2024-03-24T10:37:37.908373+0000","last_peered":"2024-03-24T10:37:37.908373+0000","last_clean":"2024-03-24T10:37:37.908373+0000","last_became_active":"2024-03-24T10:37:37.903098+0000","last_became_peered":"2024-03-24T10:37:37.903098+0000","last_unstale":"2024-03-24T10:37:37.908373+0000","last_undegraded":"2024-03-24T10:37:37.908373+0000","last_fullsized":"2024-03-24T10:37:37.908373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897206+0000","last_change":"2024-03-24T10:37:37.897206+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897206+0000","last_undegraded":"2024-03-24T10:37:37.897206+0000","last_fullsized":"2024-03-24T10:37:37.897206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909111+0000","last_change":"2024-03-24T10:37:37.905326+0000","last_active":"2024-03-24T10:37:37.909111+0000","last_peered":"2024-03-24T10:37:37.909111+0000","last_clean":"2024-03-24T10:37:37.909111+0000","last_became_active":"2024-03-24T10:37:37.905024+0000","last_became_peered":"2024-03-24T10:37:37.905024+0000","last_unstale":"2024-03-24T10:37:37.909111+0000","last_undegraded":"2024-03-24T10:37:37.909111+0000","last_fullsized":"2024-03-24T10:37:37.909111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896545+0000","last_change":"2024-03-24T10:37:37.896545+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896545+0000","last_undegraded":"2024-03-24T10:37:37.896545+0000","last_fullsized":"2024-03-24T10:37:37.896545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907220+0000","last_change":"2024-03-24T10:37:37.901453+0000","last_active":"2024-03-24T10:37:37.907220+0000","last_peered":"2024-03-24T10:37:37.907220+0000","last_clean":"2024-03-24T10:37:37.907220+0000","last_became_active":"2024-03-24T10:37:37.901055+0000","last_became_peered":"2024-03-24T10:37:37.901055+0000","last_unstale":"2024-03-24T10:37:37.907220+0000","last_undegraded":"2024-03-24T10:37:37.907220+0000","last_fullsized":"2024-03-24T10:37:37.907220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:04:40.738769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896390+0000","last_change":"2024-03-24T10:37:37.896390+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896390+0000","last_undegraded":"2024-03-24T10:37:37.896390+0000","last_fullsized":"2024-03-24T10:37:37.896390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912259+0000","last_change":"2024-03-24T10:37:37.904998+0000","last_active":"2024-03-24T10:37:37.912259+0000","last_peered":"2024-03-24T10:37:37.912259+0000","last_clean":"2024-03-24T10:37:37.912259+0000","last_became_active":"2024-03-24T10:37:37.904745+0000","last_became_peered":"2024-03-24T10:37:37.904745+0000","last_unstale":"2024-03-24T10:37:37.912259+0000","last_undegraded":"2024-03-24T10:37:37.912259+0000","last_fullsized":"2024-03-24T10:37:37.912259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:11:58.871597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896013+0000","last_change":"2024-03-24T10:37:37.896013+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896013+0000","last_undegraded":"2024-03-24T10:37:37.896013+0000","last_fullsized":"2024-03-24T10:37:37.896013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906527+0000","last_change":"2024-03-24T10:37:37.904862+0000","last_active":"2024-03-24T10:37:37.906527+0000","last_peered":"2024-03-24T10:37:37.906527+0000","last_clean":"2024-03-24T10:37:37.906527+0000","last_became_active":"2024-03-24T10:37:37.904560+0000","last_became_peered":"2024-03-24T10:37:37.904560+0000","last_unstale":"2024-03-24T10:37:37.906527+0000","last_undegraded":"2024-03-24T10:37:37.906527+0000","last_fullsized":"2024-03-24T10:37:37.906527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:35.200711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.901263+0000","last_change":"2024-03-24T10:37:37.901263+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.901263+0000","last_undegraded":"2024-03-24T10:37:37.901263+0000","last_fullsized":"2024-03-24T10:37:37.901263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912379+0000","last_change":"2024-03-24T10:37:37.908640+0000","last_active":"2024-03-24T10:37:37.912379+0000","last_peered":"2024-03-24T10:37:37.912379+0000","last_clean":"2024-03-24T10:37:37.912379+0000","last_became_active":"2024-03-24T10:37:37.908411+0000","last_became_peered":"2024-03-24T10:37:37.908411+0000","last_unstale":"2024-03-24T10:37:37.912379+0000","last_undegraded":"2024-03-24T10:37:37.912379+0000","last_fullsized":"2024-03-24T10:37:37.912379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.898830+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:37:37.898830+0000","last_peered":"2024-03-24T10:37:37.898830+0000","last_clean":"2024-03-24T10:37:37.898830+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:37:37.898830+0000","last_undegraded":"2024-03-24T10:37:37.898830+0000","last_fullsized":"2024-03-24T10:37:37.898830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":771208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":180840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:37:42.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:37:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.364+0000 7f36ef46b640 1 Processor -- start 2024-03-24T10:37:42.364 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.364+0000 7f36ef46b640 1 -- start start 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ef46b640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36e8072fc0 0x7f36e815c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ef46b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152f60 0x7f36e8165e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ef46b640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36e81533d0 con 0x7f36e8152b80 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ef46b640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f36e815f8b0 con 0x7f36e8072fc0 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ef46b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f36e815d3d0 con 0x7f36e8152f60 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eda08640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152f60 0x7f36e8165e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eca06640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f36e8072fc0 0x7f36e815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ed207640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f36e8152b80 0x7f36e80728b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:53488/0 (socket says 172.21.15.72:53488) 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36ed207640 1 -- 172.21.15.72:0/980064991 learned_addr learned my addr 172.21.15.72:0/980064991 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36dffff640 1 -- 172.21.15.72:0/980064991 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829136557 0 0) 0x7f36e81533d0 con 0x7f36e8152b80 2024-03-24T10:37:42.366 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36dffff640 1 -- 172.21.15.72:0/980064991 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36d4003520 con 0x7f36e8152b80 2024-03-24T10:37:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eda08640 1 -- 172.21.15.72:0/980064991 >> v2:172.21.15.79:3300/0 conn(0x7f36e8072fc0 msgr2=0x7f36e815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eda08640 1 --2- 172.21.15.72:0/980064991 >> v2:172.21.15.79:3300/0 conn(0x7f36e8072fc0 0x7f36e815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eda08640 1 -- 172.21.15.72:0/980064991 >> v1:172.21.15.79:6789/0 conn(0x7f36e8152b80 legacy=0x7f36e80728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eda08640 1 -- 172.21.15.72:0/980064991 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36e80af8a0 con 0x7f36e8152f60 2024-03-24T10:37:42.367 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.365+0000 7f36eca06640 1 --2- 172.21.15.72:0/980064991 >> v2:172.21.15.79:3300/0 conn(0x7f36e8072fc0 0x7f36e815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:37:42.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.366+0000 7f36eda08640 1 --2- 172.21.15.72:0/980064991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152f60 0x7f36e8165e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=877ccc6d86b176ac server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.366+0000 7f36dffff640 1 -- 172.21.15.72:0/980064991 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e002cbc0 con 0x7f36e8152f60 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.366+0000 7f36dffff640 1 -- 172.21.15.72:0/980064991 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e002cd20 con 0x7f36e8152f60 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.366+0000 7f36dffff640 1 -- 172.21.15.72:0/980064991 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0034640 con 0x7f36e8152f60 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 -- 172.21.15.72:0/980064991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152f60 msgr2=0x7f36e8165e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 --2- 172.21.15.72:0/980064991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152f60 0x7f36e8165e10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e002be10 comp rx=0 tx=0).stop 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 -- 172.21.15.72:0/980064991 shutdown_connections 2024-03-24T10:37:42.373 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 --2- 172.21.15.72:0/980064991 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152f60 0x7f36e8165e10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 --2- 172.21.15.72:0/980064991 >> v2:172.21.15.79:3300/0 conn(0x7f36e8072fc0 0x7f36e815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 -- 172.21.15.72:0/980064991 >> 172.21.15.72:0/980064991 conn(0x7f36e80b1b70 msgr2=0x7f36e80b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 -- 172.21.15.72:0/980064991 shutdown_connections 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.367+0000 7f36ef46b640 1 -- 172.21.15.72:0/980064991 wait complete. 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.368+0000 7f36ef46b640 1 Processor -- start 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.368+0000 7f36ef46b640 1 -- start start 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36e8072fc0 0x7f36e814f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152b80 0x7f36e81548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 0x7f36e814ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f36e809b1a0 con 0x7f36e8152f60 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f36e809b480 con 0x7f36e8072fc0 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f36e809b760 con 0x7f36e8152b80 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 0x7f36e814ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.374 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 0x7f36e814ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51738/0 (socket says 172.21.15.72:51738) 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 -- 172.21.15.72:0/3689705119 learned_addr learned my addr 172.21.15.72:0/3689705119 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ed207640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36e8072fc0 0x7f36e814f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eca06640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152b80 0x7f36e81548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 -- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152b80 msgr2=0x7f36e81548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152b80 0x7f36e81548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 -- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36e8072fc0 msgr2=0x7f36e814f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36e8072fc0 0x7f36e814f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 -- 172.21.15.72:0/3689705119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d8009400 con 0x7f36e8152f60 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36eda08640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 0x7f36e814ed00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e0007000 con 0x7f36e8152f60 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e002ce90 con 0x7f36e8152f60 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36e0009a70 con 0x7f36e8152f60 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.369+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00408b0 con 0x7f36e8152f60 2024-03-24T10:37:42.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.370+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36e809bd20 con 0x7f36e8152f60 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.370+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36e809bf10 con 0x7f36e8152f60 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.371+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f36e0040a10 con 0x7f36e8152f60 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.371+0000 7f36ddffb640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f36cc06b810 0x7f36cc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.372+0000 7f36ed207640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f36cc06b810 0x7f36cc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.372+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f36e00acd30 con 0x7f36e8152f60 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.372+0000 7f36ed207640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f36cc06b810 0x7f36cc06dcd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36e4005880 tx=0x7f36e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.376 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.376+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f36e00777c0 con 0x7f36e8152f60 2024-03-24T10:37:42.543 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.542+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36e80b5b50 con 0x7f36cc06b810 2024-03-24T10:37:42.549 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.548+0000 7f36ddffb640 1 -- 172.21.15.72:0/3689705119 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246633 (secure 0 0 0) 0x7f36e80b5b50 con 0x7f36cc06b810 2024-03-24T10:37:42.551 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:42.552 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f36cc06b810 msgr2=0x7f36cc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f36cc06b810 0x7f36cc06dcd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36e4005880 tx=0x7f36e4009040 comp rx=0 tx=0).stop 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 msgr2=0x7f36e814ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 0x7f36e814ed00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009d90 tx=0x7f36e0004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 shutdown_connections 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f36cc06b810 0x7f36cc06dcd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f36e8152f60 0x7f36e814ed00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f36e8152b80 0x7f36e81548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.554 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 --2- 172.21.15.72:0/3689705119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f36e8072fc0 0x7f36e814f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 >> 172.21.15.72:0/3689705119 conn(0x7f36e80b1b70 msgr2=0x7f36e80b1f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:42.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 shutdown_connections 2024-03-24T10:37:42.555 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.551+0000 7f36ef46b640 1 -- 172.21.15.72:0/3689705119 wait complete. 2024-03-24T10:37:42.562 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-24T10:37:42.154899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4521984,"data_stored":2587454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267558"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903688+0000","last_change":"2024-03-24T10:37:37.903688+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903688+0000","last_undegraded":"2024-03-24T10:37:37.903688+0000","last_fullsized":"2024-03-24T10:37:37.903688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903058+0000","last_change":"2024-03-24T10:37:37.903058+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903058+0000","last_undegraded":"2024-03-24T10:37:37.903058+0000","last_fullsized":"2024-03-24T10:37:37.903058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899438+0000","last_change":"2024-03-24T10:37:37.899438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899438+0000","last_undegraded":"2024-03-24T10:37:37.899438+0000","last_fullsized":"2024-03-24T10:37:37.899438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.893122+0000","last_change":"2024-03-24T10:37:37.893122+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.893122+0000","last_undegraded":"2024-03-24T10:37:37.893122+0000","last_fullsized":"2024-03-24T10:37:37.893122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892817+0000","last_change":"2024-03-24T10:37:37.892817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892817+0000","last_undegraded":"2024-03-24T10:37:37.892817+0000","last_fullsized":"2024-03-24T10:37:37.892817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896070+0000","last_change":"2024-03-24T10:37:37.896070+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896070+0000","last_undegraded":"2024-03-24T10:37:37.896070+0000","last_fullsized":"2024-03-24T10:37:37.896070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897525+0000","last_change":"2024-03-24T10:37:37.897525+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897525+0000","last_undegraded":"2024-03-24T10:37:37.897525+0000","last_fullsized":"2024-03-24T10:37:37.897525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902809+0000","last_change":"2024-03-24T10:37:37.902809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902809+0000","last_undegraded":"2024-03-24T10:37:37.902809+0000","last_fullsized":"2024-03-24T10:37:37.902809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897438+0000","last_change":"2024-03-24T10:37:37.897438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897438+0000","last_undegraded":"2024-03-24T10:37:37.897438+0000","last_fullsized":"2024-03-24T10:37:37.897438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900491+0000","last_change":"2024-03-24T10:37:37.900491+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900491+0000","last_undegraded":"2024-03-24T10:37:37.900491+0000","last_fullsized":"2024-03-24T10:37:37.900491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898449+0000","last_change":"2024-03-24T10:37:37.898449+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898449+0000","last_undegraded":"2024-03-24T10:37:37.898449+0000","last_fullsized":"2024-03-24T10:37:37.898449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897893+0000","last_change":"2024-03-24T10:37:37.897893+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897893+0000","last_undegraded":"2024-03-24T10:37:37.897893+0000","last_fullsized":"2024-03-24T10:37:37.897893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896759+0000","last_change":"2024-03-24T10:37:37.896759+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896759+0000","last_undegraded":"2024-03-24T10:37:37.896759+0000","last_fullsized":"2024-03-24T10:37:37.896759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896816+0000","last_change":"2024-03-24T10:37:37.896816+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896816+0000","last_undegraded":"2024-03-24T10:37:37.896816+0000","last_fullsized":"2024-03-24T10:37:37.896816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896809+0000","last_change":"2024-03-24T10:37:37.896809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896809+0000","last_undegraded":"2024-03-24T10:37:37.896809+0000","last_fullsized":"2024-03-24T10:37:37.896809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898296+0000","last_change":"2024-03-24T10:37:37.898296+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898296+0000","last_undegraded":"2024-03-24T10:37:37.898296+0000","last_fullsized":"2024-03-24T10:37:37.898296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895588+0000","last_change":"2024-03-24T10:37:37.895588+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895588+0000","last_undegraded":"2024-03-24T10:37:37.895588+0000","last_fullsized":"2024-03-24T10:37:37.895588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892669+0000","last_change":"2024-03-24T10:37:37.892669+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892669+0000","last_undegraded":"2024-03-24T10:37:37.892669+0000","last_fullsized":"2024-03-24T10:37:37.892669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892308+0000","last_change":"2024-03-24T10:37:37.892308+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892308+0000","last_undegraded":"2024-03-24T10:37:37.892308+0000","last_fullsized":"2024-03-24T10:37:37.892308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892152+0000","last_change":"2024-03-24T10:37:37.892152+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892152+0000","last_undegraded":"2024-03-24T10:37:37.892152+0000","last_fullsized":"2024-03-24T10:37:37.892152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897175+0000","last_change":"2024-03-24T10:37:37.897175+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897175+0000","last_undegraded":"2024-03-24T10:37:37.897175+0000","last_fullsized":"2024-03-24T10:37:37.897175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.894607+0000","last_change":"2024-03-24T10:37:37.894607+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.894607+0000","last_undegraded":"2024-03-24T10:37:37.894607+0000","last_fullsized":"2024-03-24T10:37:37.894607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896247+0000","last_change":"2024-03-24T10:37:37.896247+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896247+0000","last_undegraded":"2024-03-24T10:37:37.896247+0000","last_fullsized":"2024-03-24T10:37:37.896247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892180+0000","last_change":"2024-03-24T10:37:37.892180+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892180+0000","last_undegraded":"2024-03-24T10:37:37.892180+0000","last_fullsized":"2024-03-24T10:37:37.892180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892493+0000","last_change":"2024-03-24T10:37:37.892493+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892493+0000","last_undegraded":"2024-03-24T10:37:37.892493+0000","last_fullsized":"2024-03-24T10:37:37.892493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898870+0000","last_change":"2024-03-24T10:37:37.898870+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898870+0000","last_undegraded":"2024-03-24T10:37:37.898870+0000","last_fullsized":"2024-03-24T10:37:37.898870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892322+0000","last_change":"2024-03-24T10:37:37.892322+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892322+0000","last_undegraded":"2024-03-24T10:37:37.892322+0000","last_fullsized":"2024-03-24T10:37:37.892322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897226+0000","last_change":"2024-03-24T10:37:37.897226+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897226+0000","last_undegraded":"2024-03-24T10:37:37.897226+0000","last_fullsized":"2024-03-24T10:37:37.897226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892208+0000","last_change":"2024-03-24T10:37:37.892208+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892208+0000","last_undegraded":"2024-03-24T10:37:37.892208+0000","last_fullsized":"2024-03-24T10:37:37.892208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892128+0000","last_change":"2024-03-24T10:37:37.892128+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892128+0000","last_undegraded":"2024-03-24T10:37:37.892128+0000","last_fullsized":"2024-03-24T10:37:37.892128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895503+0000","last_change":"2024-03-24T10:37:37.895503+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895503+0000","last_undegraded":"2024-03-24T10:37:37.895503+0000","last_fullsized":"2024-03-24T10:37:37.895503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896106+0000","last_change":"2024-03-24T10:37:37.896106+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896106+0000","last_undegraded":"2024-03-24T10:37:37.896106+0000","last_fullsized":"2024-03-24T10:37:37.896106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898571+0000","last_change":"2024-03-24T10:37:37.898571+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898571+0000","last_undegraded":"2024-03-24T10:37:37.898571+0000","last_fullsized":"2024-03-24T10:37:37.898571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907166+0000","last_change":"2024-03-24T10:37:37.902780+0000","last_active":"2024-03-24T10:37:37.907166+0000","last_peered":"2024-03-24T10:37:37.907166+0000","last_clean":"2024-03-24T10:37:37.907166+0000","last_became_active":"2024-03-24T10:37:37.902533+0000","last_became_peered":"2024-03-24T10:37:37.902533+0000","last_unstale":"2024-03-24T10:37:37.907166+0000","last_undegraded":"2024-03-24T10:37:37.907166+0000","last_fullsized":"2024-03-24T10:37:37.907166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:49:58.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897531+0000","last_change":"2024-03-24T10:37:37.897531+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897531+0000","last_undegraded":"2024-03-24T10:37:37.897531+0000","last_fullsized":"2024-03-24T10:37:37.897531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909224+0000","last_change":"2024-03-24T10:37:37.906862+0000","last_active":"2024-03-24T10:37:37.909224+0000","last_peered":"2024-03-24T10:37:37.909224+0000","last_clean":"2024-03-24T10:37:37.909224+0000","last_became_active":"2024-03-24T10:37:37.906602+0000","last_became_peered":"2024-03-24T10:37:37.906602+0000","last_unstale":"2024-03-24T10:37:37.909224+0000","last_undegraded":"2024-03-24T10:37:37.909224+0000","last_fullsized":"2024-03-24T10:37:37.909224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895250+0000","last_change":"2024-03-24T10:37:37.895250+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895250+0000","last_undegraded":"2024-03-24T10:37:37.895250+0000","last_fullsized":"2024-03-24T10:37:37.895250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910444+0000","last_change":"2024-03-24T10:37:37.908810+0000","last_active":"2024-03-24T10:37:37.910444+0000","last_peered":"2024-03-24T10:37:37.910444+0000","last_clean":"2024-03-24T10:37:37.910444+0000","last_became_active":"2024-03-24T10:37:37.908519+0000","last_became_peered":"2024-03-24T10:37:37.908519+0000","last_unstale":"2024-03-24T10:37:37.910444+0000","last_undegraded":"2024-03-24T10:37:37.910444+0000","last_fullsized":"2024-03-24T10:37:37.910444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902283+0000","last_change":"2024-03-24T10:37:37.902283+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902283+0000","last_undegraded":"2024-03-24T10:37:37.902283+0000","last_fullsized":"2024-03-24T10:37:37.902283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909634+0000","last_change":"2024-03-24T10:37:37.903962+0000","last_active":"2024-03-24T10:37:37.909634+0000","last_peered":"2024-03-24T10:37:37.909634+0000","last_clean":"2024-03-24T10:37:37.909634+0000","last_became_active":"2024-03-24T10:37:37.903706+0000","last_became_peered":"2024-03-24T10:37:37.903706+0000","last_unstale":"2024-03-24T10:37:37.909634+0000","last_undegraded":"2024-03-24T10:37:37.909634+0000","last_fullsized":"2024-03-24T10:37:37.909634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:48:26.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900728+0000","last_change":"2024-03-24T10:37:37.900728+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900728+0000","last_undegraded":"2024-03-24T10:37:37.900728+0000","last_fullsized":"2024-03-24T10:37:37.900728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909177+0000","last_change":"2024-03-24T10:37:37.901965+0000","last_active":"2024-03-24T10:37:37.909177+0000","last_peered":"2024-03-24T10:37:37.909177+0000","last_clean":"2024-03-24T10:37:37.909177+0000","last_became_active":"2024-03-24T10:37:37.901710+0000","last_became_peered":"2024-03-24T10:37:37.901710+0000","last_unstale":"2024-03-24T10:37:37.909177+0000","last_undegraded":"2024-03-24T10:37:37.909177+0000","last_fullsized":"2024-03-24T10:37:37.909177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896382+0000","last_change":"2024-03-24T10:37:37.896382+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896382+0000","last_undegraded":"2024-03-24T10:37:37.896382+0000","last_fullsized":"2024-03-24T10:37:37.896382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.917775+0000","last_change":"2024-03-24T10:37:37.912877+0000","last_active":"2024-03-24T10:37:37.917775+0000","last_peered":"2024-03-24T10:37:37.917775+0000","last_clean":"2024-03-24T10:37:37.917775+0000","last_became_active":"2024-03-24T10:37:37.912621+0000","last_became_peered":"2024-03-24T10:37:37.912621+0000","last_unstale":"2024-03-24T10:37:37.917775+0000","last_undegraded":"2024-03-24T10:37:37.917775+0000","last_fullsized":"2024-03-24T10:37:37.917775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895952+0000","last_change":"2024-03-24T10:37:37.895952+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895952+0000","last_undegraded":"2024-03-24T10:37:37.895952+0000","last_fullsized":"2024-03-24T10:37:37.895952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911073+0000","last_change":"2024-03-24T10:37:37.910516+0000","last_active":"2024-03-24T10:37:37.911073+0000","last_peered":"2024-03-24T10:37:37.911073+0000","last_clean":"2024-03-24T10:37:37.911073+0000","last_became_active":"2024-03-24T10:37:37.910186+0000","last_became_peered":"2024-03-24T10:37:37.910186+0000","last_unstale":"2024-03-24T10:37:37.911073+0000","last_undegraded":"2024-03-24T10:37:37.911073+0000","last_fullsized":"2024-03-24T10:37:37.911073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898841+0000","last_change":"2024-03-24T10:37:37.898841+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898841+0000","last_undegraded":"2024-03-24T10:37:37.898841+0000","last_fullsized":"2024-03-24T10:37:37.898841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.904111+0000","last_change":"2024-03-24T10:37:37.899890+0000","last_active":"2024-03-24T10:37:37.904111+0000","last_peered":"2024-03-24T10:37:37.904111+0000","last_clean":"2024-03-24T10:37:37.904111+0000","last_became_active":"2024-03-24T10:37:37.899298+0000","last_became_peered":"2024-03-24T10:37:37.899298+0000","last_unstale":"2024-03-24T10:37:37.904111+0000","last_undegraded":"2024-03-24T10:37:37.904111+0000","last_fullsized":"2024-03-24T10:37:37.904111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891962+0000","last_change":"2024-03-24T10:37:37.891962+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891962+0000","last_undegraded":"2024-03-24T10:37:37.891962+0000","last_fullsized":"2024-03-24T10:37:37.891962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.905488+0000","last_change":"2024-03-24T10:37:37.904177+0000","last_active":"2024-03-24T10:37:37.905488+0000","last_peered":"2024-03-24T10:37:37.905488+0000","last_clean":"2024-03-24T10:37:37.905488+0000","last_became_active":"2024-03-24T10:37:37.903187+0000","last_became_peered":"2024-03-24T10:37:37.903187+0000","last_unstale":"2024-03-24T10:37:37.905488+0000","last_undegraded":"2024-03-24T10:37:37.905488+0000","last_fullsized":"2024-03-24T10:37:37.905488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896497+0000","last_change":"2024-03-24T10:37:37.896497+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896497+0000","last_undegraded":"2024-03-24T10:37:37.896497+0000","last_fullsized":"2024-03-24T10:37:37.896497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910132+0000","last_change":"2024-03-24T10:37:37.906772+0000","last_active":"2024-03-24T10:37:37.910132+0000","last_peered":"2024-03-24T10:37:37.910132+0000","last_clean":"2024-03-24T10:37:37.910132+0000","last_became_active":"2024-03-24T10:37:37.906391+0000","last_became_peered":"2024-03-24T10:37:37.906391+0000","last_unstale":"2024-03-24T10:37:37.910132+0000","last_undegraded":"2024-03-24T10:37:37.910132+0000","last_fullsized":"2024-03-24T10:37:37.910132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:18:19.260835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899213+0000","last_change":"2024-03-24T10:37:37.899213+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899213+0000","last_undegraded":"2024-03-24T10:37:37.899213+0000","last_fullsized":"2024-03-24T10:37:37.899213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915213+0000","last_change":"2024-03-24T10:37:37.910782+0000","last_active":"2024-03-24T10:37:37.915213+0000","last_peered":"2024-03-24T10:37:37.915213+0000","last_clean":"2024-03-24T10:37:37.915213+0000","last_became_active":"2024-03-24T10:37:37.910461+0000","last_became_peered":"2024-03-24T10:37:37.910461+0000","last_unstale":"2024-03-24T10:37:37.915213+0000","last_undegraded":"2024-03-24T10:37:37.915213+0000","last_fullsized":"2024-03-24T10:37:37.915213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897164+0000","last_change":"2024-03-24T10:37:37.897164+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897164+0000","last_undegraded":"2024-03-24T10:37:37.897164+0000","last_fullsized":"2024-03-24T10:37:37.897164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907142+0000","last_change":"2024-03-24T10:37:37.904351+0000","last_active":"2024-03-24T10:37:37.907142+0000","last_peered":"2024-03-24T10:37:37.907142+0000","last_clean":"2024-03-24T10:37:37.907142+0000","last_became_active":"2024-03-24T10:37:37.904065+0000","last_became_peered":"2024-03-24T10:37:37.904065+0000","last_unstale":"2024-03-24T10:37:37.907142+0000","last_undegraded":"2024-03-24T10:37:37.907142+0000","last_fullsized":"2024-03-24T10:37:37.907142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900328+0000","last_change":"2024-03-24T10:37:37.900328+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900328+0000","last_undegraded":"2024-03-24T10:37:37.900328+0000","last_fullsized":"2024-03-24T10:37:37.900328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906590+0000","last_change":"2024-03-24T10:37:37.904620+0000","last_active":"2024-03-24T10:37:37.906590+0000","last_peered":"2024-03-24T10:37:37.906590+0000","last_clean":"2024-03-24T10:37:37.906590+0000","last_became_active":"2024-03-24T10:37:37.904229+0000","last_became_peered":"2024-03-24T10:37:37.904229+0000","last_unstale":"2024-03-24T10:37:37.906590+0000","last_undegraded":"2024-03-24T10:37:37.906590+0000","last_fullsized":"2024-03-24T10:37:37.906590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:07:55.484727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896752+0000","last_change":"2024-03-24T10:37:37.896752+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896752+0000","last_undegraded":"2024-03-24T10:37:37.896752+0000","last_fullsized":"2024-03-24T10:37:37.896752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910949+0000","last_change":"2024-03-24T10:37:37.909979+0000","last_active":"2024-03-24T10:37:37.910949+0000","last_peered":"2024-03-24T10:37:37.910949+0000","last_clean":"2024-03-24T10:37:37.910949+0000","last_became_active":"2024-03-24T10:37:37.909723+0000","last_became_peered":"2024-03-24T10:37:37.909723+0000","last_unstale":"2024-03-24T10:37:37.910949+0000","last_undegraded":"2024-03-24T10:37:37.910949+0000","last_fullsized":"2024-03-24T10:37:37.910949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897882+0000","last_change":"2024-03-24T10:37:37.897882+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897882+0000","last_undegraded":"2024-03-24T10:37:37.897882+0000","last_fullsized":"2024-03-24T10:37:37.897882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907215+0000","last_change":"2024-03-24T10:37:37.903857+0000","last_active":"2024-03-24T10:37:37.907215+0000","last_peered":"2024-03-24T10:37:37.907215+0000","last_clean":"2024-03-24T10:37:37.907215+0000","last_became_active":"2024-03-24T10:37:37.903553+0000","last_became_peered":"2024-03-24T10:37:37.903553+0000","last_unstale":"2024-03-24T10:37:37.907215+0000","last_undegraded":"2024-03-24T10:37:37.907215+0000","last_fullsized":"2024-03-24T10:37:37.907215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897863+0000","last_change":"2024-03-24T10:37:37.897863+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897863+0000","last_undegraded":"2024-03-24T10:37:37.897863+0000","last_fullsized":"2024-03-24T10:37:37.897863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915092+0000","last_change":"2024-03-24T10:37:37.910698+0000","last_active":"2024-03-24T10:37:37.915092+0000","last_peered":"2024-03-24T10:37:37.915092+0000","last_clean":"2024-03-24T10:37:37.915092+0000","last_became_active":"2024-03-24T10:37:37.910415+0000","last_became_peered":"2024-03-24T10:37:37.910415+0000","last_unstale":"2024-03-24T10:37:37.915092+0000","last_undegraded":"2024-03-24T10:37:37.915092+0000","last_fullsized":"2024-03-24T10:37:37.915092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897156+0000","last_change":"2024-03-24T10:37:37.897156+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897156+0000","last_undegraded":"2024-03-24T10:37:37.897156+0000","last_fullsized":"2024-03-24T10:37:37.897156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915207+0000","last_change":"2024-03-24T10:37:37.910577+0000","last_active":"2024-03-24T10:37:37.915207+0000","last_peered":"2024-03-24T10:37:37.915207+0000","last_clean":"2024-03-24T10:37:37.915207+0000","last_became_active":"2024-03-24T10:37:37.910291+0000","last_became_peered":"2024-03-24T10:37:37.910291+0000","last_unstale":"2024-03-24T10:37:37.915207+0000","last_undegraded":"2024-03-24T10:37:37.915207+0000","last_fullsized":"2024-03-24T10:37:37.915207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:33.141389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897902+0000","last_change":"2024-03-24T10:37:37.897902+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897902+0000","last_undegraded":"2024-03-24T10:37:37.897902+0000","last_fullsized":"2024-03-24T10:37:37.897902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912319+0000","last_change":"2024-03-24T10:37:37.905571+0000","last_active":"2024-03-24T10:37:37.912319+0000","last_peered":"2024-03-24T10:37:37.912319+0000","last_clean":"2024-03-24T10:37:37.912319+0000","last_became_active":"2024-03-24T10:37:37.905308+0000","last_became_peered":"2024-03-24T10:37:37.905308+0000","last_unstale":"2024-03-24T10:37:37.912319+0000","last_undegraded":"2024-03-24T10:37:37.912319+0000","last_fullsized":"2024-03-24T10:37:37.912319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896234+0000","last_change":"2024-03-24T10:37:37.896234+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896234+0000","last_undegraded":"2024-03-24T10:37:37.896234+0000","last_fullsized":"2024-03-24T10:37:37.896234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907634+0000","last_change":"2024-03-24T10:37:37.905226+0000","last_active":"2024-03-24T10:37:37.907634+0000","last_peered":"2024-03-24T10:37:37.907634+0000","last_clean":"2024-03-24T10:37:37.907634+0000","last_became_active":"2024-03-24T10:37:37.904963+0000","last_became_peered":"2024-03-24T10:37:37.904963+0000","last_unstale":"2024-03-24T10:37:37.907634+0000","last_undegraded":"2024-03-24T10:37:37.907634+0000","last_fullsized":"2024-03-24T10:37:37.907634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:39:43.379881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891817+0000","last_change":"2024-03-24T10:37:37.891817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891817+0000","last_undegraded":"2024-03-24T10:37:37.891817+0000","last_fullsized":"2024-03-24T10:37:37.891817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911417+0000","last_change":"2024-03-24T10:37:37.910765+0000","last_active":"2024-03-24T10:37:37.911417+0000","last_peered":"2024-03-24T10:37:37.911417+0000","last_clean":"2024-03-24T10:37:37.911417+0000","last_became_active":"2024-03-24T10:37:37.910307+0000","last_became_peered":"2024-03-24T10:37:37.910307+0000","last_unstale":"2024-03-24T10:37:37.911417+0000","last_undegraded":"2024-03-24T10:37:37.911417+0000","last_fullsized":"2024-03-24T10:37:37.911417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896929+0000","last_change":"2024-03-24T10:37:37.896929+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896929+0000","last_undegraded":"2024-03-24T10:37:37.896929+0000","last_fullsized":"2024-03-24T10:37:37.896929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907030+0000","last_change":"2024-03-24T10:37:37.901724+0000","last_active":"2024-03-24T10:37:37.907030+0000","last_peered":"2024-03-24T10:37:37.907030+0000","last_clean":"2024-03-24T10:37:37.907030+0000","last_became_active":"2024-03-24T10:37:37.901315+0000","last_became_peered":"2024-03-24T10:37:37.901315+0000","last_unstale":"2024-03-24T10:37:37.907030+0000","last_undegraded":"2024-03-24T10:37:37.907030+0000","last_fullsized":"2024-03-24T10:37:37.907030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:28:51.991898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896823+0000","last_change":"2024-03-24T10:37:37.896823+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896823+0000","last_undegraded":"2024-03-24T10:37:37.896823+0000","last_fullsized":"2024-03-24T10:37:37.896823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907590+0000","last_change":"2024-03-24T10:37:37.903464+0000","last_active":"2024-03-24T10:37:37.907590+0000","last_peered":"2024-03-24T10:37:37.907590+0000","last_clean":"2024-03-24T10:37:37.907590+0000","last_became_active":"2024-03-24T10:37:37.903180+0000","last_became_peered":"2024-03-24T10:37:37.903180+0000","last_unstale":"2024-03-24T10:37:37.907590+0000","last_undegraded":"2024-03-24T10:37:37.907590+0000","last_fullsized":"2024-03-24T10:37:37.907590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:23:05.492306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899015+0000","last_change":"2024-03-24T10:37:37.899015+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899015+0000","last_undegraded":"2024-03-24T10:37:37.899015+0000","last_fullsized":"2024-03-24T10:37:37.899015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909797+0000","last_change":"2024-03-24T10:37:37.905304+0000","last_active":"2024-03-24T10:37:37.909797+0000","last_peered":"2024-03-24T10:37:37.909797+0000","last_clean":"2024-03-24T10:37:37.909797+0000","last_became_active":"2024-03-24T10:37:37.905048+0000","last_became_peered":"2024-03-24T10:37:37.905048+0000","last_unstale":"2024-03-24T10:37:37.909797+0000","last_undegraded":"2024-03-24T10:37:37.909797+0000","last_fullsized":"2024-03-24T10:37:37.909797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896172+0000","last_change":"2024-03-24T10:37:37.896172+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896172+0000","last_undegraded":"2024-03-24T10:37:37.896172+0000","last_fullsized":"2024-03-24T10:37:37.896172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.902478+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.901756+0000","last_became_peered":"2024-03-24T10:37:37.901756+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:08.271285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896774+0000","last_change":"2024-03-24T10:37:37.896774+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896774+0000","last_undegraded":"2024-03-24T10:37:37.896774+0000","last_fullsized":"2024-03-24T10:37:37.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915249+0000","last_change":"2024-03-24T10:37:37.911271+0000","last_active":"2024-03-24T10:37:37.915249+0000","last_peered":"2024-03-24T10:37:37.915249+0000","last_clean":"2024-03-24T10:37:37.915249+0000","last_became_active":"2024-03-24T10:37:37.910915+0000","last_became_peered":"2024-03-24T10:37:37.910915+0000","last_unstale":"2024-03-24T10:37:37.915249+0000","last_undegraded":"2024-03-24T10:37:37.915249+0000","last_fullsized":"2024-03-24T10:37:37.915249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896081+0000","last_change":"2024-03-24T10:37:37.896081+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896081+0000","last_undegraded":"2024-03-24T10:37:37.896081+0000","last_fullsized":"2024-03-24T10:37:37.896081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.905758+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.905480+0000","last_became_peered":"2024-03-24T10:37:37.905480+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:27.690294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895489+0000","last_change":"2024-03-24T10:37:37.895489+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895489+0000","last_undegraded":"2024-03-24T10:37:37.895489+0000","last_fullsized":"2024-03-24T10:37:37.895489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.908373+0000","last_change":"2024-03-24T10:37:37.903374+0000","last_active":"2024-03-24T10:37:37.908373+0000","last_peered":"2024-03-24T10:37:37.908373+0000","last_clean":"2024-03-24T10:37:37.908373+0000","last_became_active":"2024-03-24T10:37:37.903098+0000","last_became_peered":"2024-03-24T10:37:37.903098+0000","last_unstale":"2024-03-24T10:37:37.908373+0000","last_undegraded":"2024-03-24T10:37:37.908373+0000","last_fullsized":"2024-03-24T10:37:37.908373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897206+0000","last_change":"2024-03-24T10:37:37.897206+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897206+0000","last_undegraded":"2024-03-24T10:37:37.897206+0000","last_fullsized":"2024-03-24T10:37:37.897206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909111+0000","last_change":"2024-03-24T10:37:37.905326+0000","last_active":"2024-03-24T10:37:37.909111+0000","last_peered":"2024-03-24T10:37:37.909111+0000","last_clean":"2024-03-24T10:37:37.909111+0000","last_became_active":"2024-03-24T10:37:37.905024+0000","last_became_peered":"2024-03-24T10:37:37.905024+0000","last_unstale":"2024-03-24T10:37:37.909111+0000","last_undegraded":"2024-03-24T10:37:37.909111+0000","last_fullsized":"2024-03-24T10:37:37.909111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896545+0000","last_change":"2024-03-24T10:37:37.896545+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896545+0000","last_undegraded":"2024-03-24T10:37:37.896545+0000","last_fullsized":"2024-03-24T10:37:37.896545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907220+0000","last_change":"2024-03-24T10:37:37.901453+0000","last_active":"2024-03-24T10:37:37.907220+0000","last_peered":"2024-03-24T10:37:37.907220+0000","last_clean":"2024-03-24T10:37:37.907220+0000","last_became_active":"2024-03-24T10:37:37.901055+0000","last_became_peered":"2024-03-24T10:37:37.901055+0000","last_unstale":"2024-03-24T10:37:37.907220+0000","last_undegraded":"2024-03-24T10:37:37.907220+0000","last_fullsized":"2024-03-24T10:37:37.907220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:04:40.738769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896390+0000","last_change":"2024-03-24T10:37:37.896390+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896390+0000","last_undegraded":"2024-03-24T10:37:37.896390+0000","last_fullsized":"2024-03-24T10:37:37.896390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912259+0000","last_change":"2024-03-24T10:37:37.904998+0000","last_active":"2024-03-24T10:37:37.912259+0000","last_peered":"2024-03-24T10:37:37.912259+0000","last_clean":"2024-03-24T10:37:37.912259+0000","last_became_active":"2024-03-24T10:37:37.904745+0000","last_became_peered":"2024-03-24T10:37:37.904745+0000","last_unstale":"2024-03-24T10:37:37.912259+0000","last_undegraded":"2024-03-24T10:37:37.912259+0000","last_fullsized":"2024-03-24T10:37:37.912259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:11:58.871597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896013+0000","last_change":"2024-03-24T10:37:37.896013+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896013+0000","last_undegraded":"2024-03-24T10:37:37.896013+0000","last_fullsized":"2024-03-24T10:37:37.896013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906527+0000","last_change":"2024-03-24T10:37:37.904862+0000","last_active":"2024-03-24T10:37:37.906527+0000","last_peered":"2024-03-24T10:37:37.906527+0000","last_clean":"2024-03-24T10:37:37.906527+0000","last_became_active":"2024-03-24T10:37:37.904560+0000","last_became_peered":"2024-03-24T10:37:37.904560+0000","last_unstale":"2024-03-24T10:37:37.906527+0000","last_undegraded":"2024-03-24T10:37:37.906527+0000","last_fullsized":"2024-03-24T10:37:37.906527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:35.200711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.901263+0000","last_change":"2024-03-24T10:37:37.901263+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.901263+0000","last_undegraded":"2024-03-24T10:37:37.901263+0000","last_fullsized":"2024-03-24T10:37:37.901263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912379+0000","last_change":"2024-03-24T10:37:37.908640+0000","last_active":"2024-03-24T10:37:37.912379+0000","last_peered":"2024-03-24T10:37:37.912379+0000","last_clean":"2024-03-24T10:37:37.912379+0000","last_became_active":"2024-03-24T10:37:37.908411+0000","last_became_peered":"2024-03-24T10:37:37.908411+0000","last_unstale":"2024-03-24T10:37:37.912379+0000","last_undegraded":"2024-03-24T10:37:37.912379+0000","last_fullsized":"2024-03-24T10:37:37.912379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.898830+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:37:37.898830+0000","last_peered":"2024-03-24T10:37:37.898830+0000","last_clean":"2024-03-24T10:37:37.898830+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:37:37.898830+0000","last_undegraded":"2024-03-24T10:37:37.898830+0000","last_fullsized":"2024-03-24T10:37:37.898830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":771208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":180840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:37:42.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-03-24T10:37:42.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.903688+0000', 'last_change': '2024-03-24T10:37:37.903688+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.903688+0000', 'last_undegraded': '2024-03-24T10:37:37.903688+0000', 'last_fullsized': '2024-03-24T10:37:37.903688+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.566 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-03-24T10:37:42.566 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.903058+0000', 'last_change': '2024-03-24T10:37:37.903058+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.903058+0000', 'last_undegraded': '2024-03-24T10:37:37.903058+0000', 'last_fullsized': '2024-03-24T10:37:37.903058+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.899438+0000', 'last_change': '2024-03-24T10:37:37.899438+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.899438+0000', 'last_undegraded': '2024-03-24T10:37:37.899438+0000', 'last_fullsized': '2024-03-24T10:37:37.899438+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.893122+0000', 'last_change': '2024-03-24T10:37:37.893122+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.893122+0000', 'last_undegraded': '2024-03-24T10:37:37.893122+0000', 'last_fullsized': '2024-03-24T10:37:37.893122+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892817+0000', 'last_change': '2024-03-24T10:37:37.892817+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892817+0000', 'last_undegraded': '2024-03-24T10:37:37.892817+0000', 'last_fullsized': '2024-03-24T10:37:37.892817+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896070+0000', 'last_change': '2024-03-24T10:37:37.896070+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896070+0000', 'last_undegraded': '2024-03-24T10:37:37.896070+0000', 'last_fullsized': '2024-03-24T10:37:37.896070+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:37:42.567 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897525+0000', 'last_change': '2024-03-24T10:37:37.897525+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897525+0000', 'last_undegraded': '2024-03-24T10:37:37.897525+0000', 'last_fullsized': '2024-03-24T10:37:37.897525+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.902809+0000', 'last_change': '2024-03-24T10:37:37.902809+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.902809+0000', 'last_undegraded': '2024-03-24T10:37:37.902809+0000', 'last_fullsized': '2024-03-24T10:37:37.902809+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897438+0000', 'last_change': '2024-03-24T10:37:37.897438+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897438+0000', 'last_undegraded': '2024-03-24T10:37:37.897438+0000', 'last_fullsized': '2024-03-24T10:37:37.897438+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.900491+0000', 'last_change': '2024-03-24T10:37:37.900491+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.900491+0000', 'last_undegraded': '2024-03-24T10:37:37.900491+0000', 'last_fullsized': '2024-03-24T10:37:37.900491+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.898449+0000', 'last_change': '2024-03-24T10:37:37.898449+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.898449+0000', 'last_undegraded': '2024-03-24T10:37:37.898449+0000', 'last_fullsized': '2024-03-24T10:37:37.898449+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-03-24T10:37:42.568 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897893+0000', 'last_change': '2024-03-24T10:37:37.897893+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897893+0000', 'last_undegraded': '2024-03-24T10:37:37.897893+0000', 'last_fullsized': '2024-03-24T10:37:37.897893+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896759+0000', 'last_change': '2024-03-24T10:37:37.896759+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896759+0000', 'last_undegraded': '2024-03-24T10:37:37.896759+0000', 'last_fullsized': '2024-03-24T10:37:37.896759+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896816+0000', 'last_change': '2024-03-24T10:37:37.896816+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896816+0000', 'last_undegraded': '2024-03-24T10:37:37.896816+0000', 'last_fullsized': '2024-03-24T10:37:37.896816+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896809+0000', 'last_change': '2024-03-24T10:37:37.896809+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896809+0000', 'last_undegraded': '2024-03-24T10:37:37.896809+0000', 'last_fullsized': '2024-03-24T10:37:37.896809+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.898296+0000', 'last_change': '2024-03-24T10:37:37.898296+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.898296+0000', 'last_undegraded': '2024-03-24T10:37:37.898296+0000', 'last_fullsized': '2024-03-24T10:37:37.898296+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-03-24T10:37:42.569 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.895588+0000', 'last_change': '2024-03-24T10:37:37.895588+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.895588+0000', 'last_undegraded': '2024-03-24T10:37:37.895588+0000', 'last_fullsized': '2024-03-24T10:37:37.895588+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892669+0000', 'last_change': '2024-03-24T10:37:37.892669+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892669+0000', 'last_undegraded': '2024-03-24T10:37:37.892669+0000', 'last_fullsized': '2024-03-24T10:37:37.892669+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892308+0000', 'last_change': '2024-03-24T10:37:37.892308+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892308+0000', 'last_undegraded': '2024-03-24T10:37:37.892308+0000', 'last_fullsized': '2024-03-24T10:37:37.892308+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892152+0000', 'last_change': '2024-03-24T10:37:37.892152+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892152+0000', 'last_undegraded': '2024-03-24T10:37:37.892152+0000', 'last_fullsized': '2024-03-24T10:37:37.892152+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897175+0000', 'last_change': '2024-03-24T10:37:37.897175+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897175+0000', 'last_undegraded': '2024-03-24T10:37:37.897175+0000', 'last_fullsized': '2024-03-24T10:37:37.897175+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-03-24T10:37:42.570 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.894607+0000', 'last_change': '2024-03-24T10:37:37.894607+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.894607+0000', 'last_undegraded': '2024-03-24T10:37:37.894607+0000', 'last_fullsized': '2024-03-24T10:37:37.894607+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896247+0000', 'last_change': '2024-03-24T10:37:37.896247+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896247+0000', 'last_undegraded': '2024-03-24T10:37:37.896247+0000', 'last_fullsized': '2024-03-24T10:37:37.896247+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892180+0000', 'last_change': '2024-03-24T10:37:37.892180+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892180+0000', 'last_undegraded': '2024-03-24T10:37:37.892180+0000', 'last_fullsized': '2024-03-24T10:37:37.892180+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892493+0000', 'last_change': '2024-03-24T10:37:37.892493+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892493+0000', 'last_undegraded': '2024-03-24T10:37:37.892493+0000', 'last_fullsized': '2024-03-24T10:37:37.892493+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-24T10:37:42.571 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.898870+0000', 'last_change': '2024-03-24T10:37:37.898870+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.898870+0000', 'last_undegraded': '2024-03-24T10:37:37.898870+0000', 'last_fullsized': '2024-03-24T10:37:37.898870+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892322+0000', 'last_change': '2024-03-24T10:37:37.892322+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892322+0000', 'last_undegraded': '2024-03-24T10:37:37.892322+0000', 'last_fullsized': '2024-03-24T10:37:37.892322+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897226+0000', 'last_change': '2024-03-24T10:37:37.897226+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897226+0000', 'last_undegraded': '2024-03-24T10:37:37.897226+0000', 'last_fullsized': '2024-03-24T10:37:37.897226+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892208+0000', 'last_change': '2024-03-24T10:37:37.892208+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892208+0000', 'last_undegraded': '2024-03-24T10:37:37.892208+0000', 'last_fullsized': '2024-03-24T10:37:37.892208+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-24T10:37:42.573 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.892128+0000', 'last_change': '2024-03-24T10:37:37.892128+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.892128+0000', 'last_undegraded': '2024-03-24T10:37:37.892128+0000', 'last_fullsized': '2024-03-24T10:37:37.892128+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.895503+0000', 'last_change': '2024-03-24T10:37:37.895503+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.895503+0000', 'last_undegraded': '2024-03-24T10:37:37.895503+0000', 'last_fullsized': '2024-03-24T10:37:37.895503+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896106+0000', 'last_change': '2024-03-24T10:37:37.896106+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896106+0000', 'last_undegraded': '2024-03-24T10:37:37.896106+0000', 'last_fullsized': '2024-03-24T10:37:37.896106+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.898571+0000', 'last_change': '2024-03-24T10:37:37.898571+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.898571+0000', 'last_undegraded': '2024-03-24T10:37:37.898571+0000', 'last_fullsized': '2024-03-24T10:37:37.898571+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897531+0000', 'last_change': '2024-03-24T10:37:37.897531+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897531+0000', 'last_undegraded': '2024-03-24T10:37:37.897531+0000', 'last_fullsized': '2024-03-24T10:37:37.897531+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:37:42.574 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.895250+0000', 'last_change': '2024-03-24T10:37:37.895250+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.895250+0000', 'last_undegraded': '2024-03-24T10:37:37.895250+0000', 'last_fullsized': '2024-03-24T10:37:37.895250+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.902283+0000', 'last_change': '2024-03-24T10:37:37.902283+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.902283+0000', 'last_undegraded': '2024-03-24T10:37:37.902283+0000', 'last_fullsized': '2024-03-24T10:37:37.902283+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.900728+0000', 'last_change': '2024-03-24T10:37:37.900728+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.900728+0000', 'last_undegraded': '2024-03-24T10:37:37.900728+0000', 'last_fullsized': '2024-03-24T10:37:37.900728+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896382+0000', 'last_change': '2024-03-24T10:37:37.896382+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896382+0000', 'last_undegraded': '2024-03-24T10:37:37.896382+0000', 'last_fullsized': '2024-03-24T10:37:37.896382+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.895952+0000', 'last_change': '2024-03-24T10:37:37.895952+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.895952+0000', 'last_undegraded': '2024-03-24T10:37:37.895952+0000', 'last_fullsized': '2024-03-24T10:37:37.895952+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.898841+0000', 'last_change': '2024-03-24T10:37:37.898841+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.898841+0000', 'last_undegraded': '2024-03-24T10:37:37.898841+0000', 'last_fullsized': '2024-03-24T10:37:37.898841+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.575 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.891962+0000', 'last_change': '2024-03-24T10:37:37.891962+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.891962+0000', 'last_undegraded': '2024-03-24T10:37:37.891962+0000', 'last_fullsized': '2024-03-24T10:37:37.891962+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896497+0000', 'last_change': '2024-03-24T10:37:37.896497+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896497+0000', 'last_undegraded': '2024-03-24T10:37:37.896497+0000', 'last_fullsized': '2024-03-24T10:37:37.896497+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.899213+0000', 'last_change': '2024-03-24T10:37:37.899213+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.899213+0000', 'last_undegraded': '2024-03-24T10:37:37.899213+0000', 'last_fullsized': '2024-03-24T10:37:37.899213+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897164+0000', 'last_change': '2024-03-24T10:37:37.897164+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897164+0000', 'last_undegraded': '2024-03-24T10:37:37.897164+0000', 'last_fullsized': '2024-03-24T10:37:37.897164+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.900328+0000', 'last_change': '2024-03-24T10:37:37.900328+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.900328+0000', 'last_undegraded': '2024-03-24T10:37:37.900328+0000', 'last_fullsized': '2024-03-24T10:37:37.900328+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-03-24T10:37:42.576 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896752+0000', 'last_change': '2024-03-24T10:37:37.896752+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896752+0000', 'last_undegraded': '2024-03-24T10:37:37.896752+0000', 'last_fullsized': '2024-03-24T10:37:37.896752+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897882+0000', 'last_change': '2024-03-24T10:37:37.897882+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897882+0000', 'last_undegraded': '2024-03-24T10:37:37.897882+0000', 'last_fullsized': '2024-03-24T10:37:37.897882+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897863+0000', 'last_change': '2024-03-24T10:37:37.897863+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897863+0000', 'last_undegraded': '2024-03-24T10:37:37.897863+0000', 'last_fullsized': '2024-03-24T10:37:37.897863+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897156+0000', 'last_change': '2024-03-24T10:37:37.897156+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897156+0000', 'last_undegraded': '2024-03-24T10:37:37.897156+0000', 'last_fullsized': '2024-03-24T10:37:37.897156+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897902+0000', 'last_change': '2024-03-24T10:37:37.897902+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897902+0000', 'last_undegraded': '2024-03-24T10:37:37.897902+0000', 'last_fullsized': '2024-03-24T10:37:37.897902+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896234+0000', 'last_change': '2024-03-24T10:37:37.896234+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896234+0000', 'last_undegraded': '2024-03-24T10:37:37.896234+0000', 'last_fullsized': '2024-03-24T10:37:37.896234+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.577 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.891817+0000', 'last_change': '2024-03-24T10:37:37.891817+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.891817+0000', 'last_undegraded': '2024-03-24T10:37:37.891817+0000', 'last_fullsized': '2024-03-24T10:37:37.891817+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896929+0000', 'last_change': '2024-03-24T10:37:37.896929+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896929+0000', 'last_undegraded': '2024-03-24T10:37:37.896929+0000', 'last_fullsized': '2024-03-24T10:37:37.896929+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896823+0000', 'last_change': '2024-03-24T10:37:37.896823+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896823+0000', 'last_undegraded': '2024-03-24T10:37:37.896823+0000', 'last_fullsized': '2024-03-24T10:37:37.896823+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.899015+0000', 'last_change': '2024-03-24T10:37:37.899015+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.899015+0000', 'last_undegraded': '2024-03-24T10:37:37.899015+0000', 'last_fullsized': '2024-03-24T10:37:37.899015+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896172+0000', 'last_change': '2024-03-24T10:37:37.896172+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896172+0000', 'last_undegraded': '2024-03-24T10:37:37.896172+0000', 'last_fullsized': '2024-03-24T10:37:37.896172+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.578 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896774+0000', 'last_change': '2024-03-24T10:37:37.896774+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896774+0000', 'last_undegraded': '2024-03-24T10:37:37.896774+0000', 'last_fullsized': '2024-03-24T10:37:37.896774+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896081+0000', 'last_change': '2024-03-24T10:37:37.896081+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896081+0000', 'last_undegraded': '2024-03-24T10:37:37.896081+0000', 'last_fullsized': '2024-03-24T10:37:37.896081+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.895489+0000', 'last_change': '2024-03-24T10:37:37.895489+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.895489+0000', 'last_undegraded': '2024-03-24T10:37:37.895489+0000', 'last_fullsized': '2024-03-24T10:37:37.895489+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.897206+0000', 'last_change': '2024-03-24T10:37:37.897206+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.897206+0000', 'last_undegraded': '2024-03-24T10:37:37.897206+0000', 'last_fullsized': '2024-03-24T10:37:37.897206+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896545+0000', 'last_change': '2024-03-24T10:37:37.896545+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896545+0000', 'last_undegraded': '2024-03-24T10:37:37.896545+0000', 'last_fullsized': '2024-03-24T10:37:37.896545+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-03-24T10:37:42.579 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896390+0000', 'last_change': '2024-03-24T10:37:37.896390+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896390+0000', 'last_undegraded': '2024-03-24T10:37:37.896390+0000', 'last_fullsized': '2024-03-24T10:37:37.896390+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-24T10:37:42.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-03-24T10:37:42.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.896013+0000', 'last_change': '2024-03-24T10:37:37.896013+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.896013+0000', 'last_undegraded': '2024-03-24T10:37:37.896013+0000', 'last_fullsized': '2024-03-24T10:37:37.896013+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-24T10:37:42.580 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-03-24T10:37:42.580 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-03-24T10:37:37.901263+0000', 'last_change': '2024-03-24T10:37:37.901263+0000', 'last_active': '2024-03-24T10:37:37.886910+0000', 'last_peered': '2024-03-24T10:37:37.886910+0000', 'last_clean': '2024-03-24T10:37:37.886910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-24T10:37:37.901263+0000', 'last_undegraded': '2024-03-24T10:37:37.901263+0000', 'last_fullsized': '2024-03-24T10:37:37.901263+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'last_clean_scrub_stamp': '2024-03-24T10:37:37.886910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-24T10:37:42.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-24T10:37:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.702+0000 7fd1ce13e640 1 Processor -- start 2024-03-24T10:37:42.703 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.702+0000 7fd1ce13e640 1 -- start start 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1ce13e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fd1c806e500 0x7fd1c8071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1ce13e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1c8160040 0x7fd1c80cf310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1ce13e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1c8071630 con 0x7fd1c80cee90 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1ce13e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c8160940 con 0x7fd1c8160040 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1ce13e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fd1c80cf850 con 0x7fd1c806e500 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c7fff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1c8160040 0x7fd1c80cf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.704 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c6ffd640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd1c80cee90 0x7fd1c815f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42518/0 (socket says 172.21.15.72:42518) 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c6ffd640 1 -- 172.21.15.72:0/2488469521 learned_addr learned my addr 172.21.15.72:0/2488469521 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c77fe640 1 --2- 172.21.15.72:0/2488469521 >> v2:172.21.15.79:3300/0 conn(0x7fd1c806e500 0x7fd1c8071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c7fff640 1 -- 172.21.15.72:0/2488469521 >> v2:172.21.15.79:3300/0 conn(0x7fd1c806e500 msgr2=0x7fd1c8071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c7fff640 1 --2- 172.21.15.72:0/2488469521 >> v2:172.21.15.79:3300/0 conn(0x7fd1c806e500 0x7fd1c8071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c7fff640 1 -- 172.21.15.72:0/2488469521 >> v1:172.21.15.72:6789/0 conn(0x7fd1c80cee90 legacy=0x7fd1c815f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c7fff640 1 -- 172.21.15.72:0/2488469521 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c815c220 con 0x7fd1c8160040 2024-03-24T10:37:42.705 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.703+0000 7fd1c67fc640 1 -- 172.21.15.72:0/2488469521 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3098539814 0 0) 0x7fd1c8071630 con 0x7fd1c80cee90 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.704+0000 7fd1c7fff640 1 --2- 172.21.15.72:0/2488469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c8160040 0x7fd1c80cf310 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80d0b80 tx=0x7fd1c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3980db320f6ab0bc server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.704+0000 7fd1c67fc640 1 -- 172.21.15.72:0/2488469521 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c002cc80 con 0x7fd1c8160040 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.704+0000 7fd1c67fc640 1 -- 172.21.15.72:0/2488469521 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c002cde0 con 0x7fd1c8160040 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.704+0000 7fd1c67fc640 1 -- 172.21.15.72:0/2488469521 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c0034660 con 0x7fd1c8160040 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2488469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c8160040 msgr2=0x7fd1c80cf310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2488469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c8160040 0x7fd1c80cf310 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80d0b80 tx=0x7fd1c002bed0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2488469521 shutdown_connections 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2488469521 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c8160040 0x7fd1c80cf310 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2488469521 >> v2:172.21.15.79:3300/0 conn(0x7fd1c806e500 0x7fd1c8071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2488469521 >> 172.21.15.72:0/2488469521 conn(0x7fd1c80b1920 msgr2=0x7fd1c80b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2488469521 shutdown_connections 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.705+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2488469521 wait complete. 2024-03-24T10:37:42.707 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.706+0000 7fd1ce13e640 1 Processor -- start 2024-03-24T10:37:42.708 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.706+0000 7fd1ce13e640 1 -- start start 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1ce13e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c806e500 0x7fd1c80b4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1ce13e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 0x7fd1c8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1ce13e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8160040 0x7fd1c80b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1ce13e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c80b4310 con 0x7fd1c80cee90 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1ce13e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c80b3690 con 0x7fd1c8160040 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1ce13e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fd1c80b3970 con 0x7fd1c806e500 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 0x7fd1c8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 0x7fd1c8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51766/0 (socket says 172.21.15.72:51766) 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 -- 172.21.15.72:0/2454321334 learned_addr learned my addr 172.21.15.72:0/2454321334 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:42.710 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c77fe640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c806e500 0x7fd1c80b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c7fff640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8160040 0x7fd1c80b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 -- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c806e500 msgr2=0x7fd1c80b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c806e500 0x7fd1c80b4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 -- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8160040 msgr2=0x7fd1c80b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8160040 0x7fd1c80b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.707+0000 7fd1c6ffd640 1 -- 172.21.15.72:0/2454321334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c0009a70 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.708+0000 7fd1c6ffd640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 0x7fd1c8150360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00c4d0 tx=0x7fd1bc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.708+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0074e0 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.708+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1bc007660 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.708+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c80b3c50 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.708+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc004a20 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.708+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c80b4c70 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.709+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c80b4450 con 0x7fd1c80cee90 2024-03-24T10:37:42.711 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.709+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fd1bc004b80 con 0x7fd1c80cee90 2024-03-24T10:37:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.710+0000 7fd1affff640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd1b406b840 0x7fd1b406dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.710+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd1bc0893f0 con 0x7fd1c80cee90 2024-03-24T10:37:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.710+0000 7fd1c77fe640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd1b406b840 0x7fd1b406dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:42.712 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.710+0000 7fd1c77fe640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd1b406b840 0x7fd1b406dd00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009b40 tx=0x7fd1b8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:42.714 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.714+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fd1bc053d40 con 0x7fd1c80cee90 2024-03-24T10:37:42.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.953+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd1c804f550 con 0x7fd1c80cee90 2024-03-24T10:37:42.954 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.953+0000 7fd1affff640 1 -- 172.21.15.72:0/2454321334 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1034 (secure 0 0 0) 0x7fd1bc057400 con 0x7fd1c80cee90 2024-03-24T10:37:42.954 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:42.954 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":101,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1711276573,"num_in_osds":8,"osd_in_since":1711276564,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225878016,"bytes_avail":772868235264,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5335}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-03-24T10:37:28.152733+0000","services":{}},"progress_events":{}} 2024-03-24T10:37:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd1b406b840 msgr2=0x7fd1b406dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd1b406b840 0x7fd1b406dd00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009b40 tx=0x7fd1b8009190 comp rx=0 tx=0).stop 2024-03-24T10:37:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 msgr2=0x7fd1c8150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 0x7fd1c8150360 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00c4d0 tx=0x7fd1bc00c990 comp rx=0 tx=0).stop 2024-03-24T10:37:42.956 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 shutdown_connections 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fd1b406b840 0x7fd1b406dd00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd1c8160040 0x7fd1c80b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1c80cee90 0x7fd1c8150360 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 --2- 172.21.15.72:0/2454321334 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fd1c806e500 0x7fd1c80b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.955+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 >> 172.21.15.72:0/2454321334 conn(0x7fd1c80b1920 msgr2=0x7fd1c815da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.956+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 shutdown_connections 2024-03-24T10:37:42.957 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:42.956+0000 7fd1ce13e640 1 -- 172.21.15.72:0/2454321334 wait complete. 2024-03-24T10:37:42.967 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-24T10:37:42.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:37:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.065+0000 7f863fc07640 1 Processor -- start 2024-03-24T10:37:43.066 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.066+0000 7f863fc07640 1 -- start start 2024-03-24T10:37:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.066+0000 7f863fc07640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f863806e680 0x7f8638070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.066+0000 7f863fc07640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86380725b0 con 0x7f863815ae80 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.066+0000 7f863fc07640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8638071a10 con 0x7f8638071380 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.066+0000 7f863fc07640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8638071830 con 0x7f863806e680 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863d9a3640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f863815ae80 0x7f863806cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42534/0 (socket says 172.21.15.72:42534) 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863d9a3640 1 -- 172.21.15.72:0/833970363 learned_addr learned my addr 172.21.15.72:0/833970363 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863d1a2640 1 --2- 172.21.15.72:0/833970363 >> v2:172.21.15.72:3300/0 conn(0x7f863806e680 0x7f8638070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863c9a1640 1 -- 172.21.15.72:0/833970363 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498544419 0 0) 0x7f86380725b0 con 0x7f863815ae80 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863c9a1640 1 -- 172.21.15.72:0/833970363 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8624003520 con 0x7f863815ae80 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863d1a2640 1 -- 172.21.15.72:0/833970363 >> v1:172.21.15.79:6789/0 conn(0x7f8638071380 legacy=0x7f86380ad850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863d1a2640 1 -- 172.21.15.72:0/833970363 >> v1:172.21.15.72:6789/0 conn(0x7f863815ae80 legacy=0x7f863806cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863c9a1640 1 -- 172.21.15.72:0/833970363 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266659114 0 0) 0x7f8638071a10 con 0x7f8638071380 2024-03-24T10:37:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.067+0000 7f863d1a2640 1 -- 172.21.15.72:0/833970363 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863815b260 con 0x7f863806e680 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863d1a2640 1 --2- 172.21.15.72:0/833970363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863806e680 0x7f8638070e40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86280097a0 tx=0x7f862802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e487d82992f140e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863c9a1640 1 -- 172.21.15.72:0/833970363 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628030610 con 0x7f863806e680 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863c9a1640 1 -- 172.21.15.72:0/833970363 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8628030770 con 0x7f863806e680 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863c9a1640 1 -- 172.21.15.72:0/833970363 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8628030b00 con 0x7f863806e680 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 -- 172.21.15.72:0/833970363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863806e680 msgr2=0x7f8638070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 --2- 172.21.15.72:0/833970363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863806e680 0x7f8638070e40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f86280097a0 tx=0x7f862802b960 comp rx=0 tx=0).stop 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 -- 172.21.15.72:0/833970363 shutdown_connections 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 --2- 172.21.15.72:0/833970363 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863806e680 0x7f8638070e40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.070 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 -- 172.21.15.72:0/833970363 >> 172.21.15.72:0/833970363 conn(0x7f86380b1920 msgr2=0x7f86380b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 -- 172.21.15.72:0/833970363 shutdown_connections 2024-03-24T10:37:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.068+0000 7f863fc07640 1 -- 172.21.15.72:0/833970363 wait complete. 2024-03-24T10:37:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 Processor -- start 2024-03-24T10:37:43.071 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 -- start start 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f863806e680 0x7f863815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8638071380 0x7f8638150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 0x7f86380cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f863815e2b0 con 0x7f863815ae80 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86380cb2b0 con 0x7f863806e680 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863fc07640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f863815d910 con 0x7f8638071380 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863e1a4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 0x7f86380cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863e1a4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 0x7f86380cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51794/0 (socket says 172.21.15.72:51794) 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863e1a4640 1 -- 172.21.15.72:0/696886735 learned_addr learned my addr 172.21.15.72:0/696886735 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:43.074 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863d1a2640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8638071380 0x7f8638150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.070+0000 7f863d9a3640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f863806e680 0x7f863815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863e1a4640 1 -- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8638071380 msgr2=0x7f8638150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863e1a4640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8638071380 0x7f8638150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863e1a4640 1 -- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f863806e680 msgr2=0x7f863815b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863e1a4640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f863806e680 0x7f863815b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863e1a4640 1 -- 172.21.15.72:0/696886735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8628009400 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863e1a4640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 0x7f86380cc600 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f863000c760 tx=0x7f863000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630003da0 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f863000ce70 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f863815dbf0 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8630005290 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.071+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f863815b930 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.072+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f863809e080 con 0x7f863815ae80 2024-03-24T10:37:43.075 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.072+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f86300053f0 con 0x7f863815ae80 2024-03-24T10:37:43.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.073+0000 7f862e7fc640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f861c06b840 0x7f861c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:43.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.073+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8630089ff0 con 0x7f863815ae80 2024-03-24T10:37:43.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.073+0000 7f863d9a3640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f861c06b840 0x7f861c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:43.076 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.073+0000 7f863d9a3640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f861c06b840 0x7f861c06dd00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8634005880 tx=0x7f8634009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:43.077 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.077+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f86300549c0 con 0x7f863815ae80 2024-03-24T10:37:43.247 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.247+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8638072240 con 0x7f861c06b840 2024-03-24T10:37:43.252 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.252+0000 7f862e7fc640 1 -- 172.21.15.72:0/696886735 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246633 (secure 0 0 0) 0x7f863400f820 con 0x7f861c06b840 2024-03-24T10:37:43.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:43.257 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f861c06b840 msgr2=0x7f861c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f861c06b840 0x7f861c06dd00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8634005880 tx=0x7f8634009040 comp rx=0 tx=0).stop 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 msgr2=0x7f86380cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 0x7f86380cc600 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f863000c760 tx=0x7f863000cc20 comp rx=0 tx=0).stop 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 shutdown_connections 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f861c06b840 0x7f861c06dd00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f863815ae80 0x7f86380cc600 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8638071380 0x7f8638150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 --2- 172.21.15.72:0/696886735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f863806e680 0x7f863815b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:43.259 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 >> 172.21.15.72:0/696886735 conn(0x7f86380b1920 msgr2=0x7f863814e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 shutdown_connections 2024-03-24T10:37:43.260 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:43.255+0000 7f863fc07640 1 -- 172.21.15.72:0/696886735 wait complete. 2024-03-24T10:37:43.267 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2024-03-24T10:37:42.154899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220584,"kb_used_data":4416,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754136,"statfs":{"total":773094113280,"available":772868235264,"internally_reserved":0,"allocated":4521984,"data_stored":2587454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.267558"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903688+0000","last_change":"2024-03-24T10:37:37.903688+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903688+0000","last_undegraded":"2024-03-24T10:37:37.903688+0000","last_fullsized":"2024-03-24T10:37:37.903688+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.903058+0000","last_change":"2024-03-24T10:37:37.903058+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.903058+0000","last_undegraded":"2024-03-24T10:37:37.903058+0000","last_fullsized":"2024-03-24T10:37:37.903058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899438+0000","last_change":"2024-03-24T10:37:37.899438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899438+0000","last_undegraded":"2024-03-24T10:37:37.899438+0000","last_fullsized":"2024-03-24T10:37:37.899438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.893122+0000","last_change":"2024-03-24T10:37:37.893122+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.893122+0000","last_undegraded":"2024-03-24T10:37:37.893122+0000","last_fullsized":"2024-03-24T10:37:37.893122+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892817+0000","last_change":"2024-03-24T10:37:37.892817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892817+0000","last_undegraded":"2024-03-24T10:37:37.892817+0000","last_fullsized":"2024-03-24T10:37:37.892817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896070+0000","last_change":"2024-03-24T10:37:37.896070+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896070+0000","last_undegraded":"2024-03-24T10:37:37.896070+0000","last_fullsized":"2024-03-24T10:37:37.896070+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897525+0000","last_change":"2024-03-24T10:37:37.897525+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897525+0000","last_undegraded":"2024-03-24T10:37:37.897525+0000","last_fullsized":"2024-03-24T10:37:37.897525+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902809+0000","last_change":"2024-03-24T10:37:37.902809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902809+0000","last_undegraded":"2024-03-24T10:37:37.902809+0000","last_fullsized":"2024-03-24T10:37:37.902809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897438+0000","last_change":"2024-03-24T10:37:37.897438+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897438+0000","last_undegraded":"2024-03-24T10:37:37.897438+0000","last_fullsized":"2024-03-24T10:37:37.897438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900491+0000","last_change":"2024-03-24T10:37:37.900491+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900491+0000","last_undegraded":"2024-03-24T10:37:37.900491+0000","last_fullsized":"2024-03-24T10:37:37.900491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898449+0000","last_change":"2024-03-24T10:37:37.898449+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898449+0000","last_undegraded":"2024-03-24T10:37:37.898449+0000","last_fullsized":"2024-03-24T10:37:37.898449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897893+0000","last_change":"2024-03-24T10:37:37.897893+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897893+0000","last_undegraded":"2024-03-24T10:37:37.897893+0000","last_fullsized":"2024-03-24T10:37:37.897893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896759+0000","last_change":"2024-03-24T10:37:37.896759+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896759+0000","last_undegraded":"2024-03-24T10:37:37.896759+0000","last_fullsized":"2024-03-24T10:37:37.896759+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896816+0000","last_change":"2024-03-24T10:37:37.896816+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896816+0000","last_undegraded":"2024-03-24T10:37:37.896816+0000","last_fullsized":"2024-03-24T10:37:37.896816+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896809+0000","last_change":"2024-03-24T10:37:37.896809+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896809+0000","last_undegraded":"2024-03-24T10:37:37.896809+0000","last_fullsized":"2024-03-24T10:37:37.896809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898296+0000","last_change":"2024-03-24T10:37:37.898296+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898296+0000","last_undegraded":"2024-03-24T10:37:37.898296+0000","last_fullsized":"2024-03-24T10:37:37.898296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895588+0000","last_change":"2024-03-24T10:37:37.895588+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895588+0000","last_undegraded":"2024-03-24T10:37:37.895588+0000","last_fullsized":"2024-03-24T10:37:37.895588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892669+0000","last_change":"2024-03-24T10:37:37.892669+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892669+0000","last_undegraded":"2024-03-24T10:37:37.892669+0000","last_fullsized":"2024-03-24T10:37:37.892669+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892308+0000","last_change":"2024-03-24T10:37:37.892308+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892308+0000","last_undegraded":"2024-03-24T10:37:37.892308+0000","last_fullsized":"2024-03-24T10:37:37.892308+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892152+0000","last_change":"2024-03-24T10:37:37.892152+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892152+0000","last_undegraded":"2024-03-24T10:37:37.892152+0000","last_fullsized":"2024-03-24T10:37:37.892152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897175+0000","last_change":"2024-03-24T10:37:37.897175+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897175+0000","last_undegraded":"2024-03-24T10:37:37.897175+0000","last_fullsized":"2024-03-24T10:37:37.897175+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.894607+0000","last_change":"2024-03-24T10:37:37.894607+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.894607+0000","last_undegraded":"2024-03-24T10:37:37.894607+0000","last_fullsized":"2024-03-24T10:37:37.894607+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896247+0000","last_change":"2024-03-24T10:37:37.896247+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896247+0000","last_undegraded":"2024-03-24T10:37:37.896247+0000","last_fullsized":"2024-03-24T10:37:37.896247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892180+0000","last_change":"2024-03-24T10:37:37.892180+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892180+0000","last_undegraded":"2024-03-24T10:37:37.892180+0000","last_fullsized":"2024-03-24T10:37:37.892180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892493+0000","last_change":"2024-03-24T10:37:37.892493+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892493+0000","last_undegraded":"2024-03-24T10:37:37.892493+0000","last_fullsized":"2024-03-24T10:37:37.892493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898870+0000","last_change":"2024-03-24T10:37:37.898870+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898870+0000","last_undegraded":"2024-03-24T10:37:37.898870+0000","last_fullsized":"2024-03-24T10:37:37.898870+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892322+0000","last_change":"2024-03-24T10:37:37.892322+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892322+0000","last_undegraded":"2024-03-24T10:37:37.892322+0000","last_fullsized":"2024-03-24T10:37:37.892322+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897226+0000","last_change":"2024-03-24T10:37:37.897226+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897226+0000","last_undegraded":"2024-03-24T10:37:37.897226+0000","last_fullsized":"2024-03-24T10:37:37.897226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892208+0000","last_change":"2024-03-24T10:37:37.892208+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892208+0000","last_undegraded":"2024-03-24T10:37:37.892208+0000","last_fullsized":"2024-03-24T10:37:37.892208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.892128+0000","last_change":"2024-03-24T10:37:37.892128+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.892128+0000","last_undegraded":"2024-03-24T10:37:37.892128+0000","last_fullsized":"2024-03-24T10:37:37.892128+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895503+0000","last_change":"2024-03-24T10:37:37.895503+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895503+0000","last_undegraded":"2024-03-24T10:37:37.895503+0000","last_fullsized":"2024-03-24T10:37:37.895503+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896106+0000","last_change":"2024-03-24T10:37:37.896106+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896106+0000","last_undegraded":"2024-03-24T10:37:37.896106+0000","last_fullsized":"2024-03-24T10:37:37.896106+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898571+0000","last_change":"2024-03-24T10:37:37.898571+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898571+0000","last_undegraded":"2024-03-24T10:37:37.898571+0000","last_fullsized":"2024-03-24T10:37:37.898571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907166+0000","last_change":"2024-03-24T10:37:37.902780+0000","last_active":"2024-03-24T10:37:37.907166+0000","last_peered":"2024-03-24T10:37:37.907166+0000","last_clean":"2024-03-24T10:37:37.907166+0000","last_became_active":"2024-03-24T10:37:37.902533+0000","last_became_peered":"2024-03-24T10:37:37.902533+0000","last_unstale":"2024-03-24T10:37:37.907166+0000","last_undegraded":"2024-03-24T10:37:37.907166+0000","last_fullsized":"2024-03-24T10:37:37.907166+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:49:58.320808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897531+0000","last_change":"2024-03-24T10:37:37.897531+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897531+0000","last_undegraded":"2024-03-24T10:37:37.897531+0000","last_fullsized":"2024-03-24T10:37:37.897531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909224+0000","last_change":"2024-03-24T10:37:37.906862+0000","last_active":"2024-03-24T10:37:37.909224+0000","last_peered":"2024-03-24T10:37:37.909224+0000","last_clean":"2024-03-24T10:37:37.909224+0000","last_became_active":"2024-03-24T10:37:37.906602+0000","last_became_peered":"2024-03-24T10:37:37.906602+0000","last_unstale":"2024-03-24T10:37:37.909224+0000","last_undegraded":"2024-03-24T10:37:37.909224+0000","last_fullsized":"2024-03-24T10:37:37.909224+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895250+0000","last_change":"2024-03-24T10:37:37.895250+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895250+0000","last_undegraded":"2024-03-24T10:37:37.895250+0000","last_fullsized":"2024-03-24T10:37:37.895250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910444+0000","last_change":"2024-03-24T10:37:37.908810+0000","last_active":"2024-03-24T10:37:37.910444+0000","last_peered":"2024-03-24T10:37:37.910444+0000","last_clean":"2024-03-24T10:37:37.910444+0000","last_became_active":"2024-03-24T10:37:37.908519+0000","last_became_peered":"2024-03-24T10:37:37.908519+0000","last_unstale":"2024-03-24T10:37:37.910444+0000","last_undegraded":"2024-03-24T10:37:37.910444+0000","last_fullsized":"2024-03-24T10:37:37.910444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.902283+0000","last_change":"2024-03-24T10:37:37.902283+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.902283+0000","last_undegraded":"2024-03-24T10:37:37.902283+0000","last_fullsized":"2024-03-24T10:37:37.902283+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909634+0000","last_change":"2024-03-24T10:37:37.903962+0000","last_active":"2024-03-24T10:37:37.909634+0000","last_peered":"2024-03-24T10:37:37.909634+0000","last_clean":"2024-03-24T10:37:37.909634+0000","last_became_active":"2024-03-24T10:37:37.903706+0000","last_became_peered":"2024-03-24T10:37:37.903706+0000","last_unstale":"2024-03-24T10:37:37.909634+0000","last_undegraded":"2024-03-24T10:37:37.909634+0000","last_fullsized":"2024-03-24T10:37:37.909634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:48:26.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900728+0000","last_change":"2024-03-24T10:37:37.900728+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900728+0000","last_undegraded":"2024-03-24T10:37:37.900728+0000","last_fullsized":"2024-03-24T10:37:37.900728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909177+0000","last_change":"2024-03-24T10:37:37.901965+0000","last_active":"2024-03-24T10:37:37.909177+0000","last_peered":"2024-03-24T10:37:37.909177+0000","last_clean":"2024-03-24T10:37:37.909177+0000","last_became_active":"2024-03-24T10:37:37.901710+0000","last_became_peered":"2024-03-24T10:37:37.901710+0000","last_unstale":"2024-03-24T10:37:37.909177+0000","last_undegraded":"2024-03-24T10:37:37.909177+0000","last_fullsized":"2024-03-24T10:37:37.909177+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896382+0000","last_change":"2024-03-24T10:37:37.896382+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896382+0000","last_undegraded":"2024-03-24T10:37:37.896382+0000","last_fullsized":"2024-03-24T10:37:37.896382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.917775+0000","last_change":"2024-03-24T10:37:37.912877+0000","last_active":"2024-03-24T10:37:37.917775+0000","last_peered":"2024-03-24T10:37:37.917775+0000","last_clean":"2024-03-24T10:37:37.917775+0000","last_became_active":"2024-03-24T10:37:37.912621+0000","last_became_peered":"2024-03-24T10:37:37.912621+0000","last_unstale":"2024-03-24T10:37:37.917775+0000","last_undegraded":"2024-03-24T10:37:37.917775+0000","last_fullsized":"2024-03-24T10:37:37.917775+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895952+0000","last_change":"2024-03-24T10:37:37.895952+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895952+0000","last_undegraded":"2024-03-24T10:37:37.895952+0000","last_fullsized":"2024-03-24T10:37:37.895952+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911073+0000","last_change":"2024-03-24T10:37:37.910516+0000","last_active":"2024-03-24T10:37:37.911073+0000","last_peered":"2024-03-24T10:37:37.911073+0000","last_clean":"2024-03-24T10:37:37.911073+0000","last_became_active":"2024-03-24T10:37:37.910186+0000","last_became_peered":"2024-03-24T10:37:37.910186+0000","last_unstale":"2024-03-24T10:37:37.911073+0000","last_undegraded":"2024-03-24T10:37:37.911073+0000","last_fullsized":"2024-03-24T10:37:37.911073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.898841+0000","last_change":"2024-03-24T10:37:37.898841+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.898841+0000","last_undegraded":"2024-03-24T10:37:37.898841+0000","last_fullsized":"2024-03-24T10:37:37.898841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.904111+0000","last_change":"2024-03-24T10:37:37.899890+0000","last_active":"2024-03-24T10:37:37.904111+0000","last_peered":"2024-03-24T10:37:37.904111+0000","last_clean":"2024-03-24T10:37:37.904111+0000","last_became_active":"2024-03-24T10:37:37.899298+0000","last_became_peered":"2024-03-24T10:37:37.899298+0000","last_unstale":"2024-03-24T10:37:37.904111+0000","last_undegraded":"2024-03-24T10:37:37.904111+0000","last_fullsized":"2024-03-24T10:37:37.904111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891962+0000","last_change":"2024-03-24T10:37:37.891962+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891962+0000","last_undegraded":"2024-03-24T10:37:37.891962+0000","last_fullsized":"2024-03-24T10:37:37.891962+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.905488+0000","last_change":"2024-03-24T10:37:37.904177+0000","last_active":"2024-03-24T10:37:37.905488+0000","last_peered":"2024-03-24T10:37:37.905488+0000","last_clean":"2024-03-24T10:37:37.905488+0000","last_became_active":"2024-03-24T10:37:37.903187+0000","last_became_peered":"2024-03-24T10:37:37.903187+0000","last_unstale":"2024-03-24T10:37:37.905488+0000","last_undegraded":"2024-03-24T10:37:37.905488+0000","last_fullsized":"2024-03-24T10:37:37.905488+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896497+0000","last_change":"2024-03-24T10:37:37.896497+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896497+0000","last_undegraded":"2024-03-24T10:37:37.896497+0000","last_fullsized":"2024-03-24T10:37:37.896497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910132+0000","last_change":"2024-03-24T10:37:37.906772+0000","last_active":"2024-03-24T10:37:37.910132+0000","last_peered":"2024-03-24T10:37:37.910132+0000","last_clean":"2024-03-24T10:37:37.910132+0000","last_became_active":"2024-03-24T10:37:37.906391+0000","last_became_peered":"2024-03-24T10:37:37.906391+0000","last_unstale":"2024-03-24T10:37:37.910132+0000","last_undegraded":"2024-03-24T10:37:37.910132+0000","last_fullsized":"2024-03-24T10:37:37.910132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:18:19.260835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899213+0000","last_change":"2024-03-24T10:37:37.899213+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899213+0000","last_undegraded":"2024-03-24T10:37:37.899213+0000","last_fullsized":"2024-03-24T10:37:37.899213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915213+0000","last_change":"2024-03-24T10:37:37.910782+0000","last_active":"2024-03-24T10:37:37.915213+0000","last_peered":"2024-03-24T10:37:37.915213+0000","last_clean":"2024-03-24T10:37:37.915213+0000","last_became_active":"2024-03-24T10:37:37.910461+0000","last_became_peered":"2024-03-24T10:37:37.910461+0000","last_unstale":"2024-03-24T10:37:37.915213+0000","last_undegraded":"2024-03-24T10:37:37.915213+0000","last_fullsized":"2024-03-24T10:37:37.915213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897164+0000","last_change":"2024-03-24T10:37:37.897164+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897164+0000","last_undegraded":"2024-03-24T10:37:37.897164+0000","last_fullsized":"2024-03-24T10:37:37.897164+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907142+0000","last_change":"2024-03-24T10:37:37.904351+0000","last_active":"2024-03-24T10:37:37.907142+0000","last_peered":"2024-03-24T10:37:37.907142+0000","last_clean":"2024-03-24T10:37:37.907142+0000","last_became_active":"2024-03-24T10:37:37.904065+0000","last_became_peered":"2024-03-24T10:37:37.904065+0000","last_unstale":"2024-03-24T10:37:37.907142+0000","last_undegraded":"2024-03-24T10:37:37.907142+0000","last_fullsized":"2024-03-24T10:37:37.907142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.900328+0000","last_change":"2024-03-24T10:37:37.900328+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.900328+0000","last_undegraded":"2024-03-24T10:37:37.900328+0000","last_fullsized":"2024-03-24T10:37:37.900328+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906590+0000","last_change":"2024-03-24T10:37:37.904620+0000","last_active":"2024-03-24T10:37:37.906590+0000","last_peered":"2024-03-24T10:37:37.906590+0000","last_clean":"2024-03-24T10:37:37.906590+0000","last_became_active":"2024-03-24T10:37:37.904229+0000","last_became_peered":"2024-03-24T10:37:37.904229+0000","last_unstale":"2024-03-24T10:37:37.906590+0000","last_undegraded":"2024-03-24T10:37:37.906590+0000","last_fullsized":"2024-03-24T10:37:37.906590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:07:55.484727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896752+0000","last_change":"2024-03-24T10:37:37.896752+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896752+0000","last_undegraded":"2024-03-24T10:37:37.896752+0000","last_fullsized":"2024-03-24T10:37:37.896752+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.910949+0000","last_change":"2024-03-24T10:37:37.909979+0000","last_active":"2024-03-24T10:37:37.910949+0000","last_peered":"2024-03-24T10:37:37.910949+0000","last_clean":"2024-03-24T10:37:37.910949+0000","last_became_active":"2024-03-24T10:37:37.909723+0000","last_became_peered":"2024-03-24T10:37:37.909723+0000","last_unstale":"2024-03-24T10:37:37.910949+0000","last_undegraded":"2024-03-24T10:37:37.910949+0000","last_fullsized":"2024-03-24T10:37:37.910949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897882+0000","last_change":"2024-03-24T10:37:37.897882+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897882+0000","last_undegraded":"2024-03-24T10:37:37.897882+0000","last_fullsized":"2024-03-24T10:37:37.897882+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907215+0000","last_change":"2024-03-24T10:37:37.903857+0000","last_active":"2024-03-24T10:37:37.907215+0000","last_peered":"2024-03-24T10:37:37.907215+0000","last_clean":"2024-03-24T10:37:37.907215+0000","last_became_active":"2024-03-24T10:37:37.903553+0000","last_became_peered":"2024-03-24T10:37:37.903553+0000","last_unstale":"2024-03-24T10:37:37.907215+0000","last_undegraded":"2024-03-24T10:37:37.907215+0000","last_fullsized":"2024-03-24T10:37:37.907215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:42:38.091015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897863+0000","last_change":"2024-03-24T10:37:37.897863+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897863+0000","last_undegraded":"2024-03-24T10:37:37.897863+0000","last_fullsized":"2024-03-24T10:37:37.897863+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915092+0000","last_change":"2024-03-24T10:37:37.910698+0000","last_active":"2024-03-24T10:37:37.915092+0000","last_peered":"2024-03-24T10:37:37.915092+0000","last_clean":"2024-03-24T10:37:37.915092+0000","last_became_active":"2024-03-24T10:37:37.910415+0000","last_became_peered":"2024-03-24T10:37:37.910415+0000","last_unstale":"2024-03-24T10:37:37.915092+0000","last_undegraded":"2024-03-24T10:37:37.915092+0000","last_fullsized":"2024-03-24T10:37:37.915092+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897156+0000","last_change":"2024-03-24T10:37:37.897156+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897156+0000","last_undegraded":"2024-03-24T10:37:37.897156+0000","last_fullsized":"2024-03-24T10:37:37.897156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915207+0000","last_change":"2024-03-24T10:37:37.910577+0000","last_active":"2024-03-24T10:37:37.915207+0000","last_peered":"2024-03-24T10:37:37.915207+0000","last_clean":"2024-03-24T10:37:37.915207+0000","last_became_active":"2024-03-24T10:37:37.910291+0000","last_became_peered":"2024-03-24T10:37:37.910291+0000","last_unstale":"2024-03-24T10:37:37.915207+0000","last_undegraded":"2024-03-24T10:37:37.915207+0000","last_fullsized":"2024-03-24T10:37:37.915207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:33.141389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897902+0000","last_change":"2024-03-24T10:37:37.897902+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897902+0000","last_undegraded":"2024-03-24T10:37:37.897902+0000","last_fullsized":"2024-03-24T10:37:37.897902+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912319+0000","last_change":"2024-03-24T10:37:37.905571+0000","last_active":"2024-03-24T10:37:37.912319+0000","last_peered":"2024-03-24T10:37:37.912319+0000","last_clean":"2024-03-24T10:37:37.912319+0000","last_became_active":"2024-03-24T10:37:37.905308+0000","last_became_peered":"2024-03-24T10:37:37.905308+0000","last_unstale":"2024-03-24T10:37:37.912319+0000","last_undegraded":"2024-03-24T10:37:37.912319+0000","last_fullsized":"2024-03-24T10:37:37.912319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896234+0000","last_change":"2024-03-24T10:37:37.896234+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896234+0000","last_undegraded":"2024-03-24T10:37:37.896234+0000","last_fullsized":"2024-03-24T10:37:37.896234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907634+0000","last_change":"2024-03-24T10:37:37.905226+0000","last_active":"2024-03-24T10:37:37.907634+0000","last_peered":"2024-03-24T10:37:37.907634+0000","last_clean":"2024-03-24T10:37:37.907634+0000","last_became_active":"2024-03-24T10:37:37.904963+0000","last_became_peered":"2024-03-24T10:37:37.904963+0000","last_unstale":"2024-03-24T10:37:37.907634+0000","last_undegraded":"2024-03-24T10:37:37.907634+0000","last_fullsized":"2024-03-24T10:37:37.907634+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:39:43.379881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.891817+0000","last_change":"2024-03-24T10:37:37.891817+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.891817+0000","last_undegraded":"2024-03-24T10:37:37.891817+0000","last_fullsized":"2024-03-24T10:37:37.891817+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.911417+0000","last_change":"2024-03-24T10:37:37.910765+0000","last_active":"2024-03-24T10:37:37.911417+0000","last_peered":"2024-03-24T10:37:37.911417+0000","last_clean":"2024-03-24T10:37:37.911417+0000","last_became_active":"2024-03-24T10:37:37.910307+0000","last_became_peered":"2024-03-24T10:37:37.910307+0000","last_unstale":"2024-03-24T10:37:37.911417+0000","last_undegraded":"2024-03-24T10:37:37.911417+0000","last_fullsized":"2024-03-24T10:37:37.911417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896929+0000","last_change":"2024-03-24T10:37:37.896929+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896929+0000","last_undegraded":"2024-03-24T10:37:37.896929+0000","last_fullsized":"2024-03-24T10:37:37.896929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907030+0000","last_change":"2024-03-24T10:37:37.901724+0000","last_active":"2024-03-24T10:37:37.907030+0000","last_peered":"2024-03-24T10:37:37.907030+0000","last_clean":"2024-03-24T10:37:37.907030+0000","last_became_active":"2024-03-24T10:37:37.901315+0000","last_became_peered":"2024-03-24T10:37:37.901315+0000","last_unstale":"2024-03-24T10:37:37.907030+0000","last_undegraded":"2024-03-24T10:37:37.907030+0000","last_fullsized":"2024-03-24T10:37:37.907030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:28:51.991898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896823+0000","last_change":"2024-03-24T10:37:37.896823+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896823+0000","last_undegraded":"2024-03-24T10:37:37.896823+0000","last_fullsized":"2024-03-24T10:37:37.896823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907590+0000","last_change":"2024-03-24T10:37:37.903464+0000","last_active":"2024-03-24T10:37:37.907590+0000","last_peered":"2024-03-24T10:37:37.907590+0000","last_clean":"2024-03-24T10:37:37.907590+0000","last_became_active":"2024-03-24T10:37:37.903180+0000","last_became_peered":"2024-03-24T10:37:37.903180+0000","last_unstale":"2024-03-24T10:37:37.907590+0000","last_undegraded":"2024-03-24T10:37:37.907590+0000","last_fullsized":"2024-03-24T10:37:37.907590+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:23:05.492306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.899015+0000","last_change":"2024-03-24T10:37:37.899015+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.899015+0000","last_undegraded":"2024-03-24T10:37:37.899015+0000","last_fullsized":"2024-03-24T10:37:37.899015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909797+0000","last_change":"2024-03-24T10:37:37.905304+0000","last_active":"2024-03-24T10:37:37.909797+0000","last_peered":"2024-03-24T10:37:37.909797+0000","last_clean":"2024-03-24T10:37:37.909797+0000","last_became_active":"2024-03-24T10:37:37.905048+0000","last_became_peered":"2024-03-24T10:37:37.905048+0000","last_unstale":"2024-03-24T10:37:37.909797+0000","last_undegraded":"2024-03-24T10:37:37.909797+0000","last_fullsized":"2024-03-24T10:37:37.909797+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896172+0000","last_change":"2024-03-24T10:37:37.896172+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896172+0000","last_undegraded":"2024-03-24T10:37:37.896172+0000","last_fullsized":"2024-03-24T10:37:37.896172+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.902478+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.901756+0000","last_became_peered":"2024-03-24T10:37:37.901756+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:15:08.271285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896774+0000","last_change":"2024-03-24T10:37:37.896774+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896774+0000","last_undegraded":"2024-03-24T10:37:37.896774+0000","last_fullsized":"2024-03-24T10:37:37.896774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.915249+0000","last_change":"2024-03-24T10:37:37.911271+0000","last_active":"2024-03-24T10:37:37.915249+0000","last_peered":"2024-03-24T10:37:37.915249+0000","last_clean":"2024-03-24T10:37:37.915249+0000","last_became_active":"2024-03-24T10:37:37.910915+0000","last_became_peered":"2024-03-24T10:37:37.910915+0000","last_unstale":"2024-03-24T10:37:37.915249+0000","last_undegraded":"2024-03-24T10:37:37.915249+0000","last_fullsized":"2024-03-24T10:37:37.915249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896081+0000","last_change":"2024-03-24T10:37:37.896081+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896081+0000","last_undegraded":"2024-03-24T10:37:37.896081+0000","last_fullsized":"2024-03-24T10:37:37.896081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907683+0000","last_change":"2024-03-24T10:37:37.905758+0000","last_active":"2024-03-24T10:37:37.907683+0000","last_peered":"2024-03-24T10:37:37.907683+0000","last_clean":"2024-03-24T10:37:37.907683+0000","last_became_active":"2024-03-24T10:37:37.905480+0000","last_became_peered":"2024-03-24T10:37:37.905480+0000","last_unstale":"2024-03-24T10:37:37.907683+0000","last_undegraded":"2024-03-24T10:37:37.907683+0000","last_fullsized":"2024-03-24T10:37:37.907683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T10:43:27.690294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.895489+0000","last_change":"2024-03-24T10:37:37.895489+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.895489+0000","last_undegraded":"2024-03-24T10:37:37.895489+0000","last_fullsized":"2024-03-24T10:37:37.895489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.908373+0000","last_change":"2024-03-24T10:37:37.903374+0000","last_active":"2024-03-24T10:37:37.908373+0000","last_peered":"2024-03-24T10:37:37.908373+0000","last_clean":"2024-03-24T10:37:37.908373+0000","last_became_active":"2024-03-24T10:37:37.903098+0000","last_became_peered":"2024-03-24T10:37:37.903098+0000","last_unstale":"2024-03-24T10:37:37.908373+0000","last_undegraded":"2024-03-24T10:37:37.908373+0000","last_fullsized":"2024-03-24T10:37:37.908373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.897206+0000","last_change":"2024-03-24T10:37:37.897206+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.897206+0000","last_undegraded":"2024-03-24T10:37:37.897206+0000","last_fullsized":"2024-03-24T10:37:37.897206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.909111+0000","last_change":"2024-03-24T10:37:37.905326+0000","last_active":"2024-03-24T10:37:37.909111+0000","last_peered":"2024-03-24T10:37:37.909111+0000","last_clean":"2024-03-24T10:37:37.909111+0000","last_became_active":"2024-03-24T10:37:37.905024+0000","last_became_peered":"2024-03-24T10:37:37.905024+0000","last_unstale":"2024-03-24T10:37:37.909111+0000","last_undegraded":"2024-03-24T10:37:37.909111+0000","last_fullsized":"2024-03-24T10:37:37.909111+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896545+0000","last_change":"2024-03-24T10:37:37.896545+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896545+0000","last_undegraded":"2024-03-24T10:37:37.896545+0000","last_fullsized":"2024-03-24T10:37:37.896545+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.907220+0000","last_change":"2024-03-24T10:37:37.901453+0000","last_active":"2024-03-24T10:37:37.907220+0000","last_peered":"2024-03-24T10:37:37.907220+0000","last_clean":"2024-03-24T10:37:37.907220+0000","last_became_active":"2024-03-24T10:37:37.901055+0000","last_became_peered":"2024-03-24T10:37:37.901055+0000","last_unstale":"2024-03-24T10:37:37.907220+0000","last_undegraded":"2024-03-24T10:37:37.907220+0000","last_fullsized":"2024-03-24T10:37:37.907220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:04:40.738769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896390+0000","last_change":"2024-03-24T10:37:37.896390+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896390+0000","last_undegraded":"2024-03-24T10:37:37.896390+0000","last_fullsized":"2024-03-24T10:37:37.896390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912259+0000","last_change":"2024-03-24T10:37:37.904998+0000","last_active":"2024-03-24T10:37:37.912259+0000","last_peered":"2024-03-24T10:37:37.912259+0000","last_clean":"2024-03-24T10:37:37.912259+0000","last_became_active":"2024-03-24T10:37:37.904745+0000","last_became_peered":"2024-03-24T10:37:37.904745+0000","last_unstale":"2024-03-24T10:37:37.912259+0000","last_undegraded":"2024-03-24T10:37:37.912259+0000","last_fullsized":"2024-03-24T10:37:37.912259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:11:58.871597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.896013+0000","last_change":"2024-03-24T10:37:37.896013+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.896013+0000","last_undegraded":"2024-03-24T10:37:37.896013+0000","last_fullsized":"2024-03-24T10:37:37.896013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.906527+0000","last_change":"2024-03-24T10:37:37.904862+0000","last_active":"2024-03-24T10:37:37.906527+0000","last_peered":"2024-03-24T10:37:37.906527+0000","last_clean":"2024-03-24T10:37:37.906527+0000","last_became_active":"2024-03-24T10:37:37.904560+0000","last_became_peered":"2024-03-24T10:37:37.904560+0000","last_unstale":"2024-03-24T10:37:37.906527+0000","last_undegraded":"2024-03-24T10:37:37.906527+0000","last_fullsized":"2024-03-24T10:37:37.906527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:35.200711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-03-24T10:37:37.901263+0000","last_change":"2024-03-24T10:37:37.901263+0000","last_active":"2024-03-24T10:37:37.886910+0000","last_peered":"2024-03-24T10:37:37.886910+0000","last_clean":"2024-03-24T10:37:37.886910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-24T10:37:37.901263+0000","last_undegraded":"2024-03-24T10:37:37.901263+0000","last_fullsized":"2024-03-24T10:37:37.901263+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.912379+0000","last_change":"2024-03-24T10:37:37.908640+0000","last_active":"2024-03-24T10:37:37.912379+0000","last_peered":"2024-03-24T10:37:37.912379+0000","last_clean":"2024-03-24T10:37:37.912379+0000","last_became_active":"2024-03-24T10:37:37.908411+0000","last_became_peered":"2024-03-24T10:37:37.908411+0000","last_unstale":"2024-03-24T10:37:37.912379+0000","last_undegraded":"2024-03-24T10:37:37.912379+0000","last_fullsized":"2024-03-24T10:37:37.912379+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-24T10:37:37.898830+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:37:37.898830+0000","last_peered":"2024-03-24T10:37:37.898830+0000","last_clean":"2024-03-24T10:37:37.898830+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:37:37.898830+0000","last_undegraded":"2024-03-24T10:37:37.898830+0000","last_fullsized":"2024-03-24T10:37:37.898830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1019904,"data_stored":771208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":180840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":174173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":764541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:37:43.781 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T10:37:43.780+0000 7f4da0983640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-24T10:37:46.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-24T10:37:46.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.384+0000 7f8d21b3a640 1 Processor -- start 2024-03-24T10:37:46.385 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.384+0000 7f8d21b3a640 1 -- start start 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d21b3a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c06e680 0x7f8d1c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d21b3a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d1c071380 0x7f8d1c0ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d21b3a640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d1c0725b0 con 0x7f8d1c15ae80 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d21b3a640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8d1c071800 con 0x7f8d1c071380 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d21b3a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c071a10 con 0x7f8d1c06e680 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d1c071380 0x7f8d1c0ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8d1c071380 0x7f8d1c0ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51796/0 (socket says 172.21.15.72:51796) 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 -- 172.21.15.72:0/1100343486 learned_addr learned my addr 172.21.15.72:0/1100343486 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:46.387 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d12ffd640 1 --2- 172.21.15.72:0/1100343486 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c06e680 0x7f8d1c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 -- 172.21.15.72:0/1100343486 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c06e680 msgr2=0x7f8d1c070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 --2- 172.21.15.72:0/1100343486 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c06e680 0x7f8d1c070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 -- 172.21.15.72:0/1100343486 >> v1:172.21.15.79:6789/0 conn(0x7f8d1c15ae80 legacy=0x7f8d1c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1affd640 1 -- 172.21.15.72:0/1100343486 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536182422 0 0) 0x7f8d1c0725b0 con 0x7f8d1c15ae80 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.385+0000 7f8d1bfff640 1 -- 172.21.15.72:0/1100343486 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d1c15b260 con 0x7f8d1c071380 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.386+0000 7f8d1bfff640 1 --2- 172.21.15.72:0/1100343486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c0ad850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009e50 tx=0x7f8d1402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd40d29420981c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.386+0000 7f8d1affd640 1 -- 172.21.15.72:0/1100343486 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1402cb00 con 0x7f8d1c071380 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.386+0000 7f8d1affd640 1 -- 172.21.15.72:0/1100343486 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1402cc60 con 0x7f8d1c071380 2024-03-24T10:37:46.388 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.386+0000 7f8d1affd640 1 -- 172.21.15.72:0/1100343486 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d140343f0 con 0x7f8d1c071380 2024-03-24T10:37:46.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 -- 172.21.15.72:0/1100343486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 msgr2=0x7f8d1c0ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/1100343486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c0ad850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8d14009e50 tx=0x7f8d1402bf60 comp rx=0 tx=0).stop 2024-03-24T10:37:46.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 -- 172.21.15.72:0/1100343486 shutdown_connections 2024-03-24T10:37:46.391 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/1100343486 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c0ad850 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/1100343486 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c06e680 0x7f8d1c070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 -- 172.21.15.72:0/1100343486 >> 172.21.15.72:0/1100343486 conn(0x7f8d1c0b1920 msgr2=0x7f8d1c0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 -- 172.21.15.72:0/1100343486 shutdown_connections 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.387+0000 7f8d21b3a640 1 -- 172.21.15.72:0/1100343486 wait complete. 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.388+0000 7f8d21b3a640 1 Processor -- start 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.388+0000 7f8d21b3a640 1 -- start start 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d21b3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1c06e680 0x7f8d1c0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d21b3a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c15b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d21b3a640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c15ae80 0x7f8d1c0ce7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d21b3a640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c0ae120 con 0x7f8d1c071380 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d21b3a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8d1c15bee0 con 0x7f8d1c06e680 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d21b3a640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8d1c15c1c0 con 0x7f8d1c15ae80 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c15b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.392 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c15b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51810/0 (socket says 172.21.15.72:51810) 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 -- 172.21.15.72:0/3191610437 learned_addr learned my addr 172.21.15.72:0/3191610437 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d1b7fe640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1c06e680 0x7f8d1c0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d1bfff640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c15ae80 0x7f8d1c0ce7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 -- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c15ae80 msgr2=0x7f8d1c0ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c15ae80 0x7f8d1c0ce7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 -- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1c06e680 msgr2=0x7f8d1c0b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1c06e680 0x7f8d1c0b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.389+0000 7f8d12ffd640 1 -- 172.21.15.72:0/3191610437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d14009b30 con 0x7f8d1c071380 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.390+0000 7f8d12ffd640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c15b420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e980 tx=0x7f8d0400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.390+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d04009670 con 0x7f8d1c071380 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.390+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d0400ca00 con 0x7f8d1c071380 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.390+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d1c15c4a0 con 0x7f8d1c071380 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.390+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400cd90 con 0x7f8d1c071380 2024-03-24T10:37:46.393 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.390+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d1c15ca60 con 0x7f8d1c071380 2024-03-24T10:37:46.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.391+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d1c09e080 con 0x7f8d1c071380 2024-03-24T10:37:46.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.391+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8d04013470 con 0x7f8d1c071380 2024-03-24T10:37:46.394 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.392+0000 7f8d18ff9640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8cfc06b810 0x7f8cfc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.392+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8d0408a550 con 0x7f8d1c071380 2024-03-24T10:37:46.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.392+0000 7f8d1b7fe640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8cfc06b810 0x7f8cfc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.395 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.392+0000 7f8d1b7fe640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8cfc06b810 0x7f8cfc06dcd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c000f60 tx=0x7f8d0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:46.396 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.396+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8d04054e90 con 0x7f8d1c071380 2024-03-24T10:37:46.567 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.566+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 --> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8d1c0b1740 con 0x7f8cfc06b810 2024-03-24T10:37:46.573 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.572+0000 7f8d18ff9640 1 -- 172.21.15.72:0/3191610437 <== mgr.4107 v2:172.21.15.72:6832/4015618511 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f8d1c0b1740 con 0x7f8cfc06b810 2024-03-24T10:37:46.575 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:46.577 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2024-03-24T10:37:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8cfc06b810 msgr2=0x7f8cfc06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8cfc06b810 0x7f8cfc06dcd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c000f60 tx=0x7f8d0c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 msgr2=0x7f8d1c15b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.578 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c15b420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e980 tx=0x7f8d0400ee40 comp rx=0 tx=0).stop 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 shutdown_connections 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8cfc06b810 0x7f8cfc06dcd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8d1c15ae80 0x7f8d1c0ce7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8d1c071380 0x7f8d1c15b420 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 --2- 172.21.15.72:0/3191610437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8d1c06e680 0x7f8d1c0b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 >> 172.21.15.72:0/3191610437 conn(0x7f8d1c0b1920 msgr2=0x7f8d1c157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 shutdown_connections 2024-03-24T10:37:46.579 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.575+0000 7f8d21b3a640 1 -- 172.21.15.72:0/3191610437 wait complete. 2024-03-24T10:37:46.587 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-03-24T10:37:46.155814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220932,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753788,"statfs":{"total":773094113280,"available":772867878912,"internally_reserved":0,"allocated":4857856,"data_stored":2743148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001555"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903447+0000","last_change":"2024-03-24T10:37:38.918744+0000","last_active":"2024-03-24T10:37:39.903447+0000","last_peered":"2024-03-24T10:37:39.903447+0000","last_clean":"2024-03-24T10:37:39.903447+0000","last_became_active":"2024-03-24T10:37:38.918478+0000","last_became_peered":"2024-03-24T10:37:38.918478+0000","last_unstale":"2024-03-24T10:37:39.903447+0000","last_undegraded":"2024-03-24T10:37:39.903447+0000","last_fullsized":"2024-03-24T10:37:39.903447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:29:58.030027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903224+0000","last_change":"2024-03-24T10:37:38.926484+0000","last_active":"2024-03-24T10:37:39.903224+0000","last_peered":"2024-03-24T10:37:39.903224+0000","last_clean":"2024-03-24T10:37:39.903224+0000","last_became_active":"2024-03-24T10:37:38.926229+0000","last_became_peered":"2024-03-24T10:37:38.926229+0000","last_unstale":"2024-03-24T10:37:39.903224+0000","last_undegraded":"2024-03-24T10:37:39.903224+0000","last_fullsized":"2024-03-24T10:37:39.903224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:10:15.732376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030851+0000","last_change":"2024-03-24T10:37:38.931935+0000","last_active":"2024-03-24T10:37:40.030851+0000","last_peered":"2024-03-24T10:37:40.030851+0000","last_clean":"2024-03-24T10:37:40.030851+0000","last_became_active":"2024-03-24T10:37:38.931600+0000","last_became_peered":"2024-03-24T10:37:38.931600+0000","last_unstale":"2024-03-24T10:37:40.030851+0000","last_undegraded":"2024-03-24T10:37:40.030851+0000","last_fullsized":"2024-03-24T10:37:40.030851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:53:32.302129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031063+0000","last_change":"2024-03-24T10:37:38.930682+0000","last_active":"2024-03-24T10:37:40.031063+0000","last_peered":"2024-03-24T10:37:40.031063+0000","last_clean":"2024-03-24T10:37:40.031063+0000","last_became_active":"2024-03-24T10:37:38.930408+0000","last_became_peered":"2024-03-24T10:37:38.930408+0000","last_unstale":"2024-03-24T10:37:40.031063+0000","last_undegraded":"2024-03-24T10:37:40.031063+0000","last_fullsized":"2024-03-24T10:37:40.031063+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:47.734632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030900+0000","last_change":"2024-03-24T10:37:38.931331+0000","last_active":"2024-03-24T10:37:40.030900+0000","last_peered":"2024-03-24T10:37:40.030900+0000","last_clean":"2024-03-24T10:37:40.030900+0000","last_became_active":"2024-03-24T10:37:38.931086+0000","last_became_peered":"2024-03-24T10:37:38.931086+0000","last_unstale":"2024-03-24T10:37:40.030900+0000","last_undegraded":"2024-03-24T10:37:40.030900+0000","last_fullsized":"2024-03-24T10:37:40.030900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:03.144153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030314+0000","last_change":"2024-03-24T10:37:38.913345+0000","last_active":"2024-03-24T10:37:40.030314+0000","last_peered":"2024-03-24T10:37:40.030314+0000","last_clean":"2024-03-24T10:37:40.030314+0000","last_became_active":"2024-03-24T10:37:38.913089+0000","last_became_peered":"2024-03-24T10:37:38.913089+0000","last_unstale":"2024-03-24T10:37:40.030314+0000","last_undegraded":"2024-03-24T10:37:40.030314+0000","last_fullsized":"2024-03-24T10:37:40.030314+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:49:58.401760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908137+0000","last_change":"2024-03-24T10:37:38.931386+0000","last_active":"2024-03-24T10:37:39.908137+0000","last_peered":"2024-03-24T10:37:39.908137+0000","last_clean":"2024-03-24T10:37:39.908137+0000","last_became_active":"2024-03-24T10:37:38.931118+0000","last_became_peered":"2024-03-24T10:37:38.931118+0000","last_unstale":"2024-03-24T10:37:39.908137+0000","last_undegraded":"2024-03-24T10:37:39.908137+0000","last_fullsized":"2024-03-24T10:37:39.908137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:44:07.205444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903013+0000","last_change":"2024-03-24T10:37:38.933149+0000","last_active":"2024-03-24T10:37:39.903013+0000","last_peered":"2024-03-24T10:37:39.903013+0000","last_clean":"2024-03-24T10:37:39.903013+0000","last_became_active":"2024-03-24T10:37:38.932869+0000","last_became_peered":"2024-03-24T10:37:38.932869+0000","last_unstale":"2024-03-24T10:37:39.903013+0000","last_undegraded":"2024-03-24T10:37:39.903013+0000","last_fullsized":"2024-03-24T10:37:39.903013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:59:26.014262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030555+0000","last_change":"2024-03-24T10:37:38.933913+0000","last_active":"2024-03-24T10:37:40.030555+0000","last_peered":"2024-03-24T10:37:40.030555+0000","last_clean":"2024-03-24T10:37:40.030555+0000","last_became_active":"2024-03-24T10:37:38.933642+0000","last_became_peered":"2024-03-24T10:37:38.933642+0000","last_unstale":"2024-03-24T10:37:40.030555+0000","last_undegraded":"2024-03-24T10:37:40.030555+0000","last_fullsized":"2024-03-24T10:37:40.030555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:01:18.095997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908483+0000","last_change":"2024-03-24T10:37:38.932456+0000","last_active":"2024-03-24T10:37:39.908483+0000","last_peered":"2024-03-24T10:37:39.908483+0000","last_clean":"2024-03-24T10:37:39.908483+0000","last_became_active":"2024-03-24T10:37:38.932194+0000","last_became_peered":"2024-03-24T10:37:38.932194+0000","last_unstale":"2024-03-24T10:37:39.908483+0000","last_undegraded":"2024-03-24T10:37:39.908483+0000","last_fullsized":"2024-03-24T10:37:39.908483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:19:40.607138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908678+0000","last_change":"2024-03-24T10:37:38.930953+0000","last_active":"2024-03-24T10:37:39.908678+0000","last_peered":"2024-03-24T10:37:39.908678+0000","last_clean":"2024-03-24T10:37:39.908678+0000","last_became_active":"2024-03-24T10:37:38.930078+0000","last_became_peered":"2024-03-24T10:37:38.930078+0000","last_unstale":"2024-03-24T10:37:39.908678+0000","last_undegraded":"2024-03-24T10:37:39.908678+0000","last_fullsized":"2024-03-24T10:37:39.908678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:05:09.609086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030717+0000","last_change":"2024-03-24T10:37:38.928025+0000","last_active":"2024-03-24T10:37:40.030717+0000","last_peered":"2024-03-24T10:37:40.030717+0000","last_clean":"2024-03-24T10:37:40.030717+0000","last_became_active":"2024-03-24T10:37:38.927748+0000","last_became_peered":"2024-03-24T10:37:38.927748+0000","last_unstale":"2024-03-24T10:37:40.030717+0000","last_undegraded":"2024-03-24T10:37:40.030717+0000","last_fullsized":"2024-03-24T10:37:40.030717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:49:38.237699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908291+0000","last_change":"2024-03-24T10:37:38.927692+0000","last_active":"2024-03-24T10:37:39.908291+0000","last_peered":"2024-03-24T10:37:39.908291+0000","last_clean":"2024-03-24T10:37:39.908291+0000","last_became_active":"2024-03-24T10:37:38.927143+0000","last_became_peered":"2024-03-24T10:37:38.927143+0000","last_unstale":"2024-03-24T10:37:39.908291+0000","last_undegraded":"2024-03-24T10:37:39.908291+0000","last_fullsized":"2024-03-24T10:37:39.908291+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:30:21.769831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030403+0000","last_change":"2024-03-24T10:37:38.920524+0000","last_active":"2024-03-24T10:37:40.030403+0000","last_peered":"2024-03-24T10:37:40.030403+0000","last_clean":"2024-03-24T10:37:40.030403+0000","last_became_active":"2024-03-24T10:37:38.920218+0000","last_became_peered":"2024-03-24T10:37:38.920218+0000","last_unstale":"2024-03-24T10:37:40.030403+0000","last_undegraded":"2024-03-24T10:37:40.030403+0000","last_fullsized":"2024-03-24T10:37:40.030403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:59:11.598596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908186+0000","last_change":"2024-03-24T10:37:38.929531+0000","last_active":"2024-03-24T10:37:39.908186+0000","last_peered":"2024-03-24T10:37:39.908186+0000","last_clean":"2024-03-24T10:37:39.908186+0000","last_became_active":"2024-03-24T10:37:38.929287+0000","last_became_peered":"2024-03-24T10:37:38.929287+0000","last_unstale":"2024-03-24T10:37:39.908186+0000","last_undegraded":"2024-03-24T10:37:39.908186+0000","last_fullsized":"2024-03-24T10:37:39.908186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:59:26.014262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030652+0000","last_change":"2024-03-24T10:37:38.933647+0000","last_active":"2024-03-24T10:37:40.030652+0000","last_peered":"2024-03-24T10:37:40.030652+0000","last_clean":"2024-03-24T10:37:40.030652+0000","last_became_active":"2024-03-24T10:37:38.933141+0000","last_became_peered":"2024-03-24T10:37:38.933141+0000","last_unstale":"2024-03-24T10:37:40.030652+0000","last_undegraded":"2024-03-24T10:37:40.030652+0000","last_fullsized":"2024-03-24T10:37:40.030652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:18:00.331524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030819+0000","last_change":"2024-03-24T10:37:38.933766+0000","last_active":"2024-03-24T10:37:40.030819+0000","last_peered":"2024-03-24T10:37:40.030819+0000","last_clean":"2024-03-24T10:37:40.030819+0000","last_became_active":"2024-03-24T10:37:38.933506+0000","last_became_peered":"2024-03-24T10:37:38.933506+0000","last_unstale":"2024-03-24T10:37:40.030819+0000","last_undegraded":"2024-03-24T10:37:40.030819+0000","last_fullsized":"2024-03-24T10:37:40.030819+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:39:05.996928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909547+0000","last_change":"2024-03-24T10:37:38.913778+0000","last_active":"2024-03-24T10:37:39.909547+0000","last_peered":"2024-03-24T10:37:39.909547+0000","last_clean":"2024-03-24T10:37:39.909547+0000","last_became_active":"2024-03-24T10:37:38.913469+0000","last_became_peered":"2024-03-24T10:37:38.913469+0000","last_unstale":"2024-03-24T10:37:39.909547+0000","last_undegraded":"2024-03-24T10:37:39.909547+0000","last_fullsized":"2024-03-24T10:37:39.909547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:42.883585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031402+0000","last_change":"2024-03-24T10:37:38.927334+0000","last_active":"2024-03-24T10:37:40.031402+0000","last_peered":"2024-03-24T10:37:40.031402+0000","last_clean":"2024-03-24T10:37:40.031402+0000","last_became_active":"2024-03-24T10:37:38.927090+0000","last_became_peered":"2024-03-24T10:37:38.927090+0000","last_unstale":"2024-03-24T10:37:40.031402+0000","last_undegraded":"2024-03-24T10:37:40.031402+0000","last_fullsized":"2024-03-24T10:37:40.031402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:45.454050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909586+0000","last_change":"2024-03-24T10:37:38.913954+0000","last_active":"2024-03-24T10:37:39.909586+0000","last_peered":"2024-03-24T10:37:39.909586+0000","last_clean":"2024-03-24T10:37:39.909586+0000","last_became_active":"2024-03-24T10:37:38.913629+0000","last_became_peered":"2024-03-24T10:37:38.913629+0000","last_unstale":"2024-03-24T10:37:39.909586+0000","last_undegraded":"2024-03-24T10:37:39.909586+0000","last_fullsized":"2024-03-24T10:37:39.909586+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:35.078963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908620+0000","last_change":"2024-03-24T10:37:38.927897+0000","last_active":"2024-03-24T10:37:39.908620+0000","last_peered":"2024-03-24T10:37:39.908620+0000","last_clean":"2024-03-24T10:37:39.908620+0000","last_became_active":"2024-03-24T10:37:38.927454+0000","last_became_peered":"2024-03-24T10:37:38.927454+0000","last_unstale":"2024-03-24T10:37:39.908620+0000","last_undegraded":"2024-03-24T10:37:39.908620+0000","last_fullsized":"2024-03-24T10:37:39.908620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:55:40.989618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030672+0000","last_change":"2024-03-24T10:37:38.926179+0000","last_active":"2024-03-24T10:37:40.030672+0000","last_peered":"2024-03-24T10:37:40.030672+0000","last_clean":"2024-03-24T10:37:40.030672+0000","last_became_active":"2024-03-24T10:37:38.925910+0000","last_became_peered":"2024-03-24T10:37:38.925910+0000","last_unstale":"2024-03-24T10:37:40.030672+0000","last_undegraded":"2024-03-24T10:37:40.030672+0000","last_fullsized":"2024-03-24T10:37:40.030672+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:49:58.401760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030395+0000","last_change":"2024-03-24T10:37:38.928413+0000","last_active":"2024-03-24T10:37:40.030395+0000","last_peered":"2024-03-24T10:37:40.030395+0000","last_clean":"2024-03-24T10:37:40.030395+0000","last_became_active":"2024-03-24T10:37:38.928010+0000","last_became_peered":"2024-03-24T10:37:38.928010+0000","last_unstale":"2024-03-24T10:37:40.030395+0000","last_undegraded":"2024-03-24T10:37:40.030395+0000","last_fullsized":"2024-03-24T10:37:40.030395+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:53:32.302129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030763+0000","last_change":"2024-03-24T10:37:38.925509+0000","last_active":"2024-03-24T10:37:40.030763+0000","last_peered":"2024-03-24T10:37:40.030763+0000","last_clean":"2024-03-24T10:37:40.030763+0000","last_became_active":"2024-03-24T10:37:38.925218+0000","last_became_peered":"2024-03-24T10:37:38.925218+0000","last_unstale":"2024-03-24T10:37:40.030763+0000","last_undegraded":"2024-03-24T10:37:40.030763+0000","last_fullsized":"2024-03-24T10:37:40.030763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:11.288585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909689+0000","last_change":"2024-03-24T10:37:38.920541+0000","last_active":"2024-03-24T10:37:39.909689+0000","last_peered":"2024-03-24T10:37:39.909689+0000","last_clean":"2024-03-24T10:37:39.909689+0000","last_became_active":"2024-03-24T10:37:38.920284+0000","last_became_peered":"2024-03-24T10:37:38.920284+0000","last_unstale":"2024-03-24T10:37:39.909689+0000","last_undegraded":"2024-03-24T10:37:39.909689+0000","last_fullsized":"2024-03-24T10:37:39.909689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:00:16.412748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030292+0000","last_change":"2024-03-24T10:37:38.933361+0000","last_active":"2024-03-24T10:37:40.030292+0000","last_peered":"2024-03-24T10:37:40.030292+0000","last_clean":"2024-03-24T10:37:40.030292+0000","last_became_active":"2024-03-24T10:37:38.933101+0000","last_became_peered":"2024-03-24T10:37:38.933101+0000","last_unstale":"2024-03-24T10:37:40.030292+0000","last_undegraded":"2024-03-24T10:37:40.030292+0000","last_fullsized":"2024-03-24T10:37:40.030292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:01:18.095997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909636+0000","last_change":"2024-03-24T10:37:38.926196+0000","last_active":"2024-03-24T10:37:39.909636+0000","last_peered":"2024-03-24T10:37:39.909636+0000","last_clean":"2024-03-24T10:37:39.909636+0000","last_became_active":"2024-03-24T10:37:38.925911+0000","last_became_peered":"2024-03-24T10:37:38.925911+0000","last_unstale":"2024-03-24T10:37:39.909636+0000","last_undegraded":"2024-03-24T10:37:39.909636+0000","last_fullsized":"2024-03-24T10:37:39.909636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:07:56.489157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908405+0000","last_change":"2024-03-24T10:37:38.926479+0000","last_active":"2024-03-24T10:37:39.908405+0000","last_peered":"2024-03-24T10:37:39.908405+0000","last_clean":"2024-03-24T10:37:39.908405+0000","last_became_active":"2024-03-24T10:37:38.925915+0000","last_became_peered":"2024-03-24T10:37:38.925915+0000","last_unstale":"2024-03-24T10:37:39.908405+0000","last_undegraded":"2024-03-24T10:37:39.908405+0000","last_fullsized":"2024-03-24T10:37:39.908405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:10:15.732376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909619+0000","last_change":"2024-03-24T10:37:38.912495+0000","last_active":"2024-03-24T10:37:39.909619+0000","last_peered":"2024-03-24T10:37:39.909619+0000","last_clean":"2024-03-24T10:37:39.909619+0000","last_became_active":"2024-03-24T10:37:38.912192+0000","last_became_peered":"2024-03-24T10:37:38.912192+0000","last_unstale":"2024-03-24T10:37:39.909619+0000","last_undegraded":"2024-03-24T10:37:39.909619+0000","last_fullsized":"2024-03-24T10:37:39.909619+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:36.205141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909312+0000","last_change":"2024-03-24T10:37:38.908483+0000","last_active":"2024-03-24T10:37:39.909312+0000","last_peered":"2024-03-24T10:37:39.909312+0000","last_clean":"2024-03-24T10:37:39.909312+0000","last_became_active":"2024-03-24T10:37:38.908180+0000","last_became_peered":"2024-03-24T10:37:38.908180+0000","last_unstale":"2024-03-24T10:37:39.909312+0000","last_undegraded":"2024-03-24T10:37:39.909312+0000","last_fullsized":"2024-03-24T10:37:39.909312+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:34.145820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030421+0000","last_change":"2024-03-24T10:37:38.927856+0000","last_active":"2024-03-24T10:37:40.030421+0000","last_peered":"2024-03-24T10:37:40.030421+0000","last_clean":"2024-03-24T10:37:40.030421+0000","last_became_active":"2024-03-24T10:37:38.926522+0000","last_became_peered":"2024-03-24T10:37:38.926522+0000","last_unstale":"2024-03-24T10:37:40.030421+0000","last_undegraded":"2024-03-24T10:37:40.030421+0000","last_fullsized":"2024-03-24T10:37:40.030421+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:00.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030063+0000","last_change":"2024-03-24T10:37:38.926450+0000","last_active":"2024-03-24T10:37:40.030063+0000","last_peered":"2024-03-24T10:37:40.030063+0000","last_clean":"2024-03-24T10:37:40.030063+0000","last_became_active":"2024-03-24T10:37:38.926134+0000","last_became_peered":"2024-03-24T10:37:38.926134+0000","last_unstale":"2024-03-24T10:37:40.030063+0000","last_undegraded":"2024-03-24T10:37:40.030063+0000","last_fullsized":"2024-03-24T10:37:40.030063+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:44:07.593947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030925+0000","last_change":"2024-03-24T10:37:38.929158+0000","last_active":"2024-03-24T10:37:40.030925+0000","last_peered":"2024-03-24T10:37:40.030925+0000","last_clean":"2024-03-24T10:37:40.030925+0000","last_became_active":"2024-03-24T10:37:38.928862+0000","last_became_peered":"2024-03-24T10:37:38.928862+0000","last_unstale":"2024-03-24T10:37:40.030925+0000","last_undegraded":"2024-03-24T10:37:40.030925+0000","last_fullsized":"2024-03-24T10:37:40.030925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:30:21.769831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909703+0000","last_change":"2024-03-24T10:37:37.902780+0000","last_active":"2024-03-24T10:37:39.909703+0000","last_peered":"2024-03-24T10:37:39.909703+0000","last_clean":"2024-03-24T10:37:39.909703+0000","last_became_active":"2024-03-24T10:37:37.902533+0000","last_became_peered":"2024-03-24T10:37:37.902533+0000","last_unstale":"2024-03-24T10:37:39.909703+0000","last_undegraded":"2024-03-24T10:37:39.909703+0000","last_fullsized":"2024-03-24T10:37:39.909703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:11:58.871597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030458+0000","last_change":"2024-03-24T10:37:38.933331+0000","last_active":"2024-03-24T10:37:40.030458+0000","last_peered":"2024-03-24T10:37:40.030458+0000","last_clean":"2024-03-24T10:37:40.030458+0000","last_became_active":"2024-03-24T10:37:38.933045+0000","last_became_peered":"2024-03-24T10:37:38.933045+0000","last_unstale":"2024-03-24T10:37:40.030458+0000","last_undegraded":"2024-03-24T10:37:40.030458+0000","last_fullsized":"2024-03-24T10:37:40.030458+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:49:38.237699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031179+0000","last_change":"2024-03-24T10:37:37.906862+0000","last_active":"2024-03-24T10:37:40.031179+0000","last_peered":"2024-03-24T10:37:40.031179+0000","last_clean":"2024-03-24T10:37:40.031179+0000","last_became_active":"2024-03-24T10:37:37.906602+0000","last_became_peered":"2024-03-24T10:37:37.906602+0000","last_unstale":"2024-03-24T10:37:40.031179+0000","last_undegraded":"2024-03-24T10:37:40.031179+0000","last_fullsized":"2024-03-24T10:37:40.031179+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031147+0000","last_change":"2024-03-24T10:37:38.920529+0000","last_active":"2024-03-24T10:37:40.031147+0000","last_peered":"2024-03-24T10:37:40.031147+0000","last_clean":"2024-03-24T10:37:40.031147+0000","last_became_active":"2024-03-24T10:37:38.920272+0000","last_became_peered":"2024-03-24T10:37:38.920272+0000","last_unstale":"2024-03-24T10:37:40.031147+0000","last_undegraded":"2024-03-24T10:37:40.031147+0000","last_fullsized":"2024-03-24T10:37:40.031147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:49:38.237699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030571+0000","last_change":"2024-03-24T10:37:37.908810+0000","last_active":"2024-03-24T10:37:40.030571+0000","last_peered":"2024-03-24T10:37:40.030571+0000","last_clean":"2024-03-24T10:37:40.030571+0000","last_became_active":"2024-03-24T10:37:37.908519+0000","last_became_peered":"2024-03-24T10:37:37.908519+0000","last_unstale":"2024-03-24T10:37:40.030571+0000","last_undegraded":"2024-03-24T10:37:40.030571+0000","last_fullsized":"2024-03-24T10:37:40.030571+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:33.141389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903407+0000","last_change":"2024-03-24T10:37:38.911653+0000","last_active":"2024-03-24T10:37:39.903407+0000","last_peered":"2024-03-24T10:37:39.903407+0000","last_clean":"2024-03-24T10:37:39.903407+0000","last_became_active":"2024-03-24T10:37:38.910722+0000","last_became_peered":"2024-03-24T10:37:38.910722+0000","last_unstale":"2024-03-24T10:37:39.903407+0000","last_undegraded":"2024-03-24T10:37:39.903407+0000","last_fullsized":"2024-03-24T10:37:39.903407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:48:53.606650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031050+0000","last_change":"2024-03-24T10:37:37.903962+0000","last_active":"2024-03-24T10:37:40.031050+0000","last_peered":"2024-03-24T10:37:40.031050+0000","last_clean":"2024-03-24T10:37:40.031050+0000","last_became_active":"2024-03-24T10:37:37.903706+0000","last_became_peered":"2024-03-24T10:37:37.903706+0000","last_unstale":"2024-03-24T10:37:40.031050+0000","last_undegraded":"2024-03-24T10:37:40.031050+0000","last_fullsized":"2024-03-24T10:37:40.031050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:21:46.730202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030009+0000","last_change":"2024-03-24T10:37:38.917728+0000","last_active":"2024-03-24T10:37:40.030009+0000","last_peered":"2024-03-24T10:37:40.030009+0000","last_clean":"2024-03-24T10:37:40.030009+0000","last_became_active":"2024-03-24T10:37:38.917445+0000","last_became_peered":"2024-03-24T10:37:38.917445+0000","last_unstale":"2024-03-24T10:37:40.030009+0000","last_undegraded":"2024-03-24T10:37:40.030009+0000","last_fullsized":"2024-03-24T10:37:40.030009+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:45:45.022574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908485+0000","last_change":"2024-03-24T10:37:37.901965+0000","last_active":"2024-03-24T10:37:39.908485+0000","last_peered":"2024-03-24T10:37:39.908485+0000","last_clean":"2024-03-24T10:37:39.908485+0000","last_became_active":"2024-03-24T10:37:37.901710+0000","last_became_peered":"2024-03-24T10:37:37.901710+0000","last_unstale":"2024-03-24T10:37:39.908485+0000","last_undegraded":"2024-03-24T10:37:39.908485+0000","last_fullsized":"2024-03-24T10:37:39.908485+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:07:55.484727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908449+0000","last_change":"2024-03-24T10:37:38.929323+0000","last_active":"2024-03-24T10:37:39.908449+0000","last_peered":"2024-03-24T10:37:39.908449+0000","last_clean":"2024-03-24T10:37:39.908449+0000","last_became_active":"2024-03-24T10:37:38.926848+0000","last_became_peered":"2024-03-24T10:37:38.926848+0000","last_unstale":"2024-03-24T10:37:39.908449+0000","last_undegraded":"2024-03-24T10:37:39.908449+0000","last_fullsized":"2024-03-24T10:37:39.908449+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:04:43.758948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030670+0000","last_change":"2024-03-24T10:37:37.912877+0000","last_active":"2024-03-24T10:37:40.030670+0000","last_peered":"2024-03-24T10:37:40.030670+0000","last_clean":"2024-03-24T10:37:40.030670+0000","last_became_active":"2024-03-24T10:37:37.912621+0000","last_became_peered":"2024-03-24T10:37:37.912621+0000","last_unstale":"2024-03-24T10:37:40.030670+0000","last_undegraded":"2024-03-24T10:37:40.030670+0000","last_fullsized":"2024-03-24T10:37:40.030670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:17:33.141389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030540+0000","last_change":"2024-03-24T10:37:38.932874+0000","last_active":"2024-03-24T10:37:40.030540+0000","last_peered":"2024-03-24T10:37:40.030540+0000","last_clean":"2024-03-24T10:37:40.030540+0000","last_became_active":"2024-03-24T10:37:38.932624+0000","last_became_peered":"2024-03-24T10:37:38.932624+0000","last_unstale":"2024-03-24T10:37:40.030540+0000","last_undegraded":"2024-03-24T10:37:40.030540+0000","last_fullsized":"2024-03-24T10:37:40.030540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:45:45.022574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030109+0000","last_change":"2024-03-24T10:37:37.910516+0000","last_active":"2024-03-24T10:37:40.030109+0000","last_peered":"2024-03-24T10:37:40.030109+0000","last_clean":"2024-03-24T10:37:40.030109+0000","last_became_active":"2024-03-24T10:37:37.910186+0000","last_became_peered":"2024-03-24T10:37:37.910186+0000","last_unstale":"2024-03-24T10:37:40.030109+0000","last_undegraded":"2024-03-24T10:37:40.030109+0000","last_fullsized":"2024-03-24T10:37:40.030109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:18:19.260835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903140+0000","last_change":"2024-03-24T10:37:38.913367+0000","last_active":"2024-03-24T10:37:39.903140+0000","last_peered":"2024-03-24T10:37:39.903140+0000","last_clean":"2024-03-24T10:37:39.903140+0000","last_became_active":"2024-03-24T10:37:38.913053+0000","last_became_peered":"2024-03-24T10:37:38.913053+0000","last_unstale":"2024-03-24T10:37:39.903140+0000","last_undegraded":"2024-03-24T10:37:39.903140+0000","last_fullsized":"2024-03-24T10:37:39.903140+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:44:07.205444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030205+0000","last_change":"2024-03-24T10:37:37.899890+0000","last_active":"2024-03-24T10:37:40.030205+0000","last_peered":"2024-03-24T10:37:40.030205+0000","last_clean":"2024-03-24T10:37:40.030205+0000","last_became_active":"2024-03-24T10:37:37.899298+0000","last_became_peered":"2024-03-24T10:37:37.899298+0000","last_unstale":"2024-03-24T10:37:40.030205+0000","last_undegraded":"2024-03-24T10:37:40.030205+0000","last_fullsized":"2024-03-24T10:37:40.030205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031107+0000","last_change":"2024-03-24T10:37:38.930708+0000","last_active":"2024-03-24T10:37:40.031107+0000","last_peered":"2024-03-24T10:37:40.031107+0000","last_clean":"2024-03-24T10:37:40.031107+0000","last_became_active":"2024-03-24T10:37:38.930435+0000","last_became_peered":"2024-03-24T10:37:38.930435+0000","last_unstale":"2024-03-24T10:37:40.031107+0000","last_undegraded":"2024-03-24T10:37:40.031107+0000","last_fullsized":"2024-03-24T10:37:40.031107+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:54.927340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903501+0000","last_change":"2024-03-24T10:37:37.904177+0000","last_active":"2024-03-24T10:37:39.903501+0000","last_peered":"2024-03-24T10:37:39.903501+0000","last_clean":"2024-03-24T10:37:39.903501+0000","last_became_active":"2024-03-24T10:37:37.903187+0000","last_became_peered":"2024-03-24T10:37:37.903187+0000","last_unstale":"2024-03-24T10:37:39.903501+0000","last_undegraded":"2024-03-24T10:37:39.903501+0000","last_fullsized":"2024-03-24T10:37:39.903501+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:45:44.018143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030851+0000","last_change":"2024-03-24T10:37:38.921796+0000","last_active":"2024-03-24T10:37:40.030851+0000","last_peered":"2024-03-24T10:37:40.030851+0000","last_clean":"2024-03-24T10:37:40.030851+0000","last_became_active":"2024-03-24T10:37:38.921384+0000","last_became_peered":"2024-03-24T10:37:38.921384+0000","last_unstale":"2024-03-24T10:37:40.030851+0000","last_undegraded":"2024-03-24T10:37:40.030851+0000","last_fullsized":"2024-03-24T10:37:40.030851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:59:26.014262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908918+0000","last_change":"2024-03-24T10:37:37.906772+0000","last_active":"2024-03-24T10:37:39.908918+0000","last_peered":"2024-03-24T10:37:39.908918+0000","last_clean":"2024-03-24T10:37:39.908918+0000","last_became_active":"2024-03-24T10:37:37.906391+0000","last_became_peered":"2024-03-24T10:37:37.906391+0000","last_unstale":"2024-03-24T10:37:39.908918+0000","last_undegraded":"2024-03-24T10:37:39.908918+0000","last_fullsized":"2024-03-24T10:37:39.908918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:59:10.594165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031098+0000","last_change":"2024-03-24T10:37:38.924458+0000","last_active":"2024-03-24T10:37:40.031098+0000","last_peered":"2024-03-24T10:37:40.031098+0000","last_clean":"2024-03-24T10:37:40.031098+0000","last_became_active":"2024-03-24T10:37:38.924195+0000","last_became_peered":"2024-03-24T10:37:38.924195+0000","last_unstale":"2024-03-24T10:37:40.031098+0000","last_undegraded":"2024-03-24T10:37:40.031098+0000","last_fullsized":"2024-03-24T10:37:40.031098+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:55:00.932055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908795+0000","last_change":"2024-03-24T10:37:37.910782+0000","last_active":"2024-03-24T10:37:39.908795+0000","last_peered":"2024-03-24T10:37:39.908795+0000","last_clean":"2024-03-24T10:37:39.908795+0000","last_became_active":"2024-03-24T10:37:37.910461+0000","last_became_peered":"2024-03-24T10:37:37.910461+0000","last_unstale":"2024-03-24T10:37:39.908795+0000","last_undegraded":"2024-03-24T10:37:39.908795+0000","last_fullsized":"2024-03-24T10:37:39.908795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:06:35.200711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030552+0000","last_change":"2024-03-24T10:37:38.926782+0000","last_active":"2024-03-24T10:37:40.030552+0000","last_peered":"2024-03-24T10:37:40.030552+0000","last_clean":"2024-03-24T10:37:40.030552+0000","last_became_active":"2024-03-24T10:37:38.926537+0000","last_became_peered":"2024-03-24T10:37:38.926537+0000","last_unstale":"2024-03-24T10:37:40.030552+0000","last_undegraded":"2024-03-24T10:37:40.030552+0000","last_fullsized":"2024-03-24T10:37:40.030552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:01:18.095997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903362+0000","last_change":"2024-03-24T10:37:37.904351+0000","last_active":"2024-03-24T10:37:39.903362+0000","last_peered":"2024-03-24T10:37:39.903362+0000","last_clean":"2024-03-24T10:37:39.903362+0000","last_became_active":"2024-03-24T10:37:37.904065+0000","last_became_peered":"2024-03-24T10:37:37.904065+0000","last_unstale":"2024-03-24T10:37:39.903362+0000","last_undegraded":"2024-03-24T10:37:39.903362+0000","last_fullsized":"2024-03-24T10:37:39.903362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:00:15.408318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030625+0000","last_change":"2024-03-24T10:37:38.929078+0000","last_active":"2024-03-24T10:37:40.030625+0000","last_peered":"2024-03-24T10:37:40.030625+0000","last_clean":"2024-03-24T10:37:40.030625+0000","last_became_active":"2024-03-24T10:37:38.928820+0000","last_became_peered":"2024-03-24T10:37:38.928820+0000","last_unstale":"2024-03-24T10:37:40.030625+0000","last_undegraded":"2024-03-24T10:37:40.030625+0000","last_fullsized":"2024-03-24T10:37:40.030625+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:51:22.687778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903343+0000","last_change":"2024-03-24T10:37:37.904620+0000","last_active":"2024-03-24T10:37:39.903343+0000","last_peered":"2024-03-24T10:37:39.903343+0000","last_clean":"2024-03-24T10:37:39.903343+0000","last_became_active":"2024-03-24T10:37:37.904229+0000","last_became_peered":"2024-03-24T10:37:37.904229+0000","last_unstale":"2024-03-24T10:37:39.903343+0000","last_undegraded":"2024-03-24T10:37:39.903343+0000","last_fullsized":"2024-03-24T10:37:39.903343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:44:06.589516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903093+0000","last_change":"2024-03-24T10:37:38.919001+0000","last_active":"2024-03-24T10:37:39.903093+0000","last_peered":"2024-03-24T10:37:39.903093+0000","last_clean":"2024-03-24T10:37:39.903093+0000","last_became_active":"2024-03-24T10:37:38.918756+0000","last_became_peered":"2024-03-24T10:37:38.918756+0000","last_unstale":"2024-03-24T10:37:39.903093+0000","last_undegraded":"2024-03-24T10:37:39.903093+0000","last_fullsized":"2024-03-24T10:37:39.903093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:30:21.769831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030406+0000","last_change":"2024-03-24T10:37:37.909979+0000","last_active":"2024-03-24T10:37:40.030406+0000","last_peered":"2024-03-24T10:37:40.030406+0000","last_clean":"2024-03-24T10:37:40.030406+0000","last_became_active":"2024-03-24T10:37:37.909723+0000","last_became_peered":"2024-03-24T10:37:37.909723+0000","last_unstale":"2024-03-24T10:37:40.030406+0000","last_undegraded":"2024-03-24T10:37:40.030406+0000","last_fullsized":"2024-03-24T10:37:40.030406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:00:44.449619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030558+0000","last_change":"2024-03-24T10:37:38.928461+0000","last_active":"2024-03-24T10:37:40.030558+0000","last_peered":"2024-03-24T10:37:40.030558+0000","last_clean":"2024-03-24T10:37:40.030558+0000","last_became_active":"2024-03-24T10:37:38.928040+0000","last_became_peered":"2024-03-24T10:37:38.928040+0000","last_unstale":"2024-03-24T10:37:40.030558+0000","last_undegraded":"2024-03-24T10:37:40.030558+0000","last_fullsized":"2024-03-24T10:37:40.030558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:32:22.157973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909132+0000","last_change":"2024-03-24T10:37:37.903857+0000","last_active":"2024-03-24T10:37:39.909132+0000","last_peered":"2024-03-24T10:37:39.909132+0000","last_clean":"2024-03-24T10:37:39.909132+0000","last_became_active":"2024-03-24T10:37:37.903553+0000","last_became_peered":"2024-03-24T10:37:37.903553+0000","last_unstale":"2024-03-24T10:37:39.909132+0000","last_undegraded":"2024-03-24T10:37:39.909132+0000","last_fullsized":"2024-03-24T10:37:39.909132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:48:26.600613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903249+0000","last_change":"2024-03-24T10:37:38.918103+0000","last_active":"2024-03-24T10:37:39.903249+0000","last_peered":"2024-03-24T10:37:39.903249+0000","last_clean":"2024-03-24T10:37:39.903249+0000","last_became_active":"2024-03-24T10:37:38.917852+0000","last_became_peered":"2024-03-24T10:37:38.917852+0000","last_unstale":"2024-03-24T10:37:39.903249+0000","last_undegraded":"2024-03-24T10:37:39.903249+0000","last_fullsized":"2024-03-24T10:37:39.903249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:04:43.758948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031106+0000","last_change":"2024-03-24T10:37:37.910698+0000","last_active":"2024-03-24T10:37:40.031106+0000","last_peered":"2024-03-24T10:37:40.031106+0000","last_clean":"2024-03-24T10:37:40.031106+0000","last_became_active":"2024-03-24T10:37:37.910415+0000","last_became_peered":"2024-03-24T10:37:37.910415+0000","last_unstale":"2024-03-24T10:37:40.031106+0000","last_undegraded":"2024-03-24T10:37:40.031106+0000","last_fullsized":"2024-03-24T10:37:40.031106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T17:18:19.260835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903281+0000","last_change":"2024-03-24T10:37:38.911350+0000","last_active":"2024-03-24T10:37:39.903281+0000","last_peered":"2024-03-24T10:37:39.903281+0000","last_clean":"2024-03-24T10:37:39.903281+0000","last_became_active":"2024-03-24T10:37:38.910496+0000","last_became_peered":"2024-03-24T10:37:38.910496+0000","last_unstale":"2024-03-24T10:37:39.903281+0000","last_undegraded":"2024-03-24T10:37:39.903281+0000","last_fullsized":"2024-03-24T10:37:39.903281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:19:40.607138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908836+0000","last_change":"2024-03-24T10:37:37.910577+0000","last_active":"2024-03-24T10:37:39.908836+0000","last_peered":"2024-03-24T10:37:39.908836+0000","last_clean":"2024-03-24T10:37:39.908836+0000","last_became_active":"2024-03-24T10:37:37.910291+0000","last_became_peered":"2024-03-24T10:37:37.910291+0000","last_unstale":"2024-03-24T10:37:39.908836+0000","last_undegraded":"2024-03-24T10:37:39.908836+0000","last_fullsized":"2024-03-24T10:37:39.908836+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:00:15.408318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908810+0000","last_change":"2024-03-24T10:37:38.930178+0000","last_active":"2024-03-24T10:37:39.908810+0000","last_peered":"2024-03-24T10:37:39.908810+0000","last_clean":"2024-03-24T10:37:39.908810+0000","last_became_active":"2024-03-24T10:37:38.928108+0000","last_became_peered":"2024-03-24T10:37:38.928108+0000","last_unstale":"2024-03-24T10:37:39.908810+0000","last_undegraded":"2024-03-24T10:37:39.908810+0000","last_fullsized":"2024-03-24T10:37:39.908810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:12:01.173769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031199+0000","last_change":"2024-03-24T10:37:37.905571+0000","last_active":"2024-03-24T10:37:40.031199+0000","last_peered":"2024-03-24T10:37:40.031199+0000","last_clean":"2024-03-24T10:37:40.031199+0000","last_became_active":"2024-03-24T10:37:37.905308+0000","last_became_peered":"2024-03-24T10:37:37.905308+0000","last_unstale":"2024-03-24T10:37:40.031199+0000","last_undegraded":"2024-03-24T10:37:40.031199+0000","last_fullsized":"2024-03-24T10:37:40.031199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:23:02.139722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031112+0000","last_change":"2024-03-24T10:37:38.915103+0000","last_active":"2024-03-24T10:37:40.031112+0000","last_peered":"2024-03-24T10:37:40.031112+0000","last_clean":"2024-03-24T10:37:40.031112+0000","last_became_active":"2024-03-24T10:37:38.914780+0000","last_became_peered":"2024-03-24T10:37:38.914780+0000","last_unstale":"2024-03-24T10:37:40.031112+0000","last_undegraded":"2024-03-24T10:37:40.031112+0000","last_fullsized":"2024-03-24T10:37:40.031112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:51:22.687778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031376+0000","last_change":"2024-03-24T10:37:37.905226+0000","last_active":"2024-03-24T10:37:40.031376+0000","last_peered":"2024-03-24T10:37:40.031376+0000","last_clean":"2024-03-24T10:37:40.031376+0000","last_became_active":"2024-03-24T10:37:37.904963+0000","last_became_peered":"2024-03-24T10:37:37.904963+0000","last_unstale":"2024-03-24T10:37:40.031376+0000","last_undegraded":"2024-03-24T10:37:40.031376+0000","last_fullsized":"2024-03-24T10:37:40.031376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:25:57.024202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031077+0000","last_change":"2024-03-24T10:37:38.930460+0000","last_active":"2024-03-24T10:37:40.031077+0000","last_peered":"2024-03-24T10:37:40.031077+0000","last_clean":"2024-03-24T10:37:40.031077+0000","last_became_active":"2024-03-24T10:37:38.930202+0000","last_became_peered":"2024-03-24T10:37:38.930202+0000","last_unstale":"2024-03-24T10:37:40.031077+0000","last_undegraded":"2024-03-24T10:37:40.031077+0000","last_fullsized":"2024-03-24T10:37:40.031077+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:06.888878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030310+0000","last_change":"2024-03-24T10:37:37.910765+0000","last_active":"2024-03-24T10:37:40.030310+0000","last_peered":"2024-03-24T10:37:40.030310+0000","last_clean":"2024-03-24T10:37:40.030310+0000","last_became_active":"2024-03-24T10:37:37.910307+0000","last_became_peered":"2024-03-24T10:37:37.910307+0000","last_unstale":"2024-03-24T10:37:40.030310+0000","last_undegraded":"2024-03-24T10:37:40.030310+0000","last_fullsized":"2024-03-24T10:37:40.030310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031198+0000","last_change":"2024-03-24T10:37:38.928780+0000","last_active":"2024-03-24T10:37:40.031198+0000","last_peered":"2024-03-24T10:37:40.031198+0000","last_clean":"2024-03-24T10:37:40.031198+0000","last_became_active":"2024-03-24T10:37:38.928006+0000","last_became_peered":"2024-03-24T10:37:38.928006+0000","last_unstale":"2024-03-24T10:37:40.031198+0000","last_undegraded":"2024-03-24T10:37:40.031198+0000","last_fullsized":"2024-03-24T10:37:40.031198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:04:43.758948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030909+0000","last_change":"2024-03-24T10:37:37.901724+0000","last_active":"2024-03-24T10:37:40.030909+0000","last_peered":"2024-03-24T10:37:40.030909+0000","last_clean":"2024-03-24T10:37:40.030909+0000","last_became_active":"2024-03-24T10:37:37.901315+0000","last_became_peered":"2024-03-24T10:37:37.901315+0000","last_unstale":"2024-03-24T10:37:40.030909+0000","last_undegraded":"2024-03-24T10:37:40.030909+0000","last_fullsized":"2024-03-24T10:37:40.030909+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:42:59.576836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030565+0000","last_change":"2024-03-24T10:37:38.923370+0000","last_active":"2024-03-24T10:37:40.030565+0000","last_peered":"2024-03-24T10:37:40.030565+0000","last_clean":"2024-03-24T10:37:40.030565+0000","last_became_active":"2024-03-24T10:37:38.923111+0000","last_became_peered":"2024-03-24T10:37:38.923111+0000","last_unstale":"2024-03-24T10:37:40.030565+0000","last_undegraded":"2024-03-24T10:37:40.030565+0000","last_fullsized":"2024-03-24T10:37:40.030565+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:49:58.401760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030818+0000","last_change":"2024-03-24T10:37:37.903464+0000","last_active":"2024-03-24T10:37:40.030818+0000","last_peered":"2024-03-24T10:37:40.030818+0000","last_clean":"2024-03-24T10:37:40.030818+0000","last_became_active":"2024-03-24T10:37:37.903180+0000","last_became_peered":"2024-03-24T10:37:37.903180+0000","last_unstale":"2024-03-24T10:37:40.030818+0000","last_undegraded":"2024-03-24T10:37:40.030818+0000","last_fullsized":"2024-03-24T10:37:40.030818+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:43:14.547704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908681+0000","last_change":"2024-03-24T10:37:38.929919+0000","last_active":"2024-03-24T10:37:39.908681+0000","last_peered":"2024-03-24T10:37:39.908681+0000","last_clean":"2024-03-24T10:37:39.908681+0000","last_became_active":"2024-03-24T10:37:38.926363+0000","last_became_peered":"2024-03-24T10:37:38.926363+0000","last_unstale":"2024-03-24T10:37:39.908681+0000","last_undegraded":"2024-03-24T10:37:39.908681+0000","last_fullsized":"2024-03-24T10:37:39.908681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T11:48:53.606650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030493+0000","last_change":"2024-03-24T10:37:37.905304+0000","last_active":"2024-03-24T10:37:40.030493+0000","last_peered":"2024-03-24T10:37:40.030493+0000","last_clean":"2024-03-24T10:37:40.030493+0000","last_became_active":"2024-03-24T10:37:37.905048+0000","last_became_peered":"2024-03-24T10:37:37.905048+0000","last_unstale":"2024-03-24T10:37:40.030493+0000","last_undegraded":"2024-03-24T10:37:40.030493+0000","last_fullsized":"2024-03-24T10:37:40.030493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:01:34.074533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903299+0000","last_change":"2024-03-24T10:37:38.913474+0000","last_active":"2024-03-24T10:37:39.903299+0000","last_peered":"2024-03-24T10:37:39.903299+0000","last_clean":"2024-03-24T10:37:39.903299+0000","last_became_active":"2024-03-24T10:37:38.913160+0000","last_became_peered":"2024-03-24T10:37:38.913160+0000","last_unstale":"2024-03-24T10:37:39.903299+0000","last_undegraded":"2024-03-24T10:37:39.903299+0000","last_fullsized":"2024-03-24T10:37:39.903299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T21:55:40.989618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031013+0000","last_change":"2024-03-24T10:37:37.902478+0000","last_active":"2024-03-24T10:37:40.031013+0000","last_peered":"2024-03-24T10:37:40.031013+0000","last_clean":"2024-03-24T10:37:40.031013+0000","last_became_active":"2024-03-24T10:37:37.901756+0000","last_became_peered":"2024-03-24T10:37:37.901756+0000","last_unstale":"2024-03-24T10:37:40.031013+0000","last_undegraded":"2024-03-24T10:37:40.031013+0000","last_fullsized":"2024-03-24T10:37:40.031013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:11:47.210016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030214+0000","last_change":"2024-03-24T10:37:38.929104+0000","last_active":"2024-03-24T10:37:40.030214+0000","last_peered":"2024-03-24T10:37:40.030214+0000","last_clean":"2024-03-24T10:37:40.030214+0000","last_became_active":"2024-03-24T10:37:38.928828+0000","last_became_peered":"2024-03-24T10:37:38.928828+0000","last_unstale":"2024-03-24T10:37:40.030214+0000","last_undegraded":"2024-03-24T10:37:40.030214+0000","last_fullsized":"2024-03-24T10:37:40.030214+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:45:45.022574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909020+0000","last_change":"2024-03-24T10:37:37.911271+0000","last_active":"2024-03-24T10:37:39.909020+0000","last_peered":"2024-03-24T10:37:39.909020+0000","last_clean":"2024-03-24T10:37:39.909020+0000","last_became_active":"2024-03-24T10:37:37.910915+0000","last_became_peered":"2024-03-24T10:37:37.910915+0000","last_unstale":"2024-03-24T10:37:39.909020+0000","last_undegraded":"2024-03-24T10:37:39.909020+0000","last_fullsized":"2024-03-24T10:37:39.909020+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:44:06.589516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030994+0000","last_change":"2024-03-24T10:37:38.924703+0000","last_active":"2024-03-24T10:37:40.030994+0000","last_peered":"2024-03-24T10:37:40.030994+0000","last_clean":"2024-03-24T10:37:40.030994+0000","last_became_active":"2024-03-24T10:37:38.924441+0000","last_became_peered":"2024-03-24T10:37:38.924441+0000","last_unstale":"2024-03-24T10:37:40.030994+0000","last_undegraded":"2024-03-24T10:37:40.030994+0000","last_fullsized":"2024-03-24T10:37:40.030994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:10:15.732376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030858+0000","last_change":"2024-03-24T10:37:37.905758+0000","last_active":"2024-03-24T10:37:40.030858+0000","last_peered":"2024-03-24T10:37:40.030858+0000","last_clean":"2024-03-24T10:37:40.030858+0000","last_became_active":"2024-03-24T10:37:37.905480+0000","last_became_peered":"2024-03-24T10:37:37.905480+0000","last_unstale":"2024-03-24T10:37:40.030858+0000","last_undegraded":"2024-03-24T10:37:40.030858+0000","last_fullsized":"2024-03-24T10:37:40.030858+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:39:46.496851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903429+0000","last_change":"2024-03-24T10:37:38.914117+0000","last_active":"2024-03-24T10:37:39.903429+0000","last_peered":"2024-03-24T10:37:39.903429+0000","last_clean":"2024-03-24T10:37:39.903429+0000","last_became_active":"2024-03-24T10:37:38.913614+0000","last_became_peered":"2024-03-24T10:37:38.913614+0000","last_unstale":"2024-03-24T10:37:39.903429+0000","last_undegraded":"2024-03-24T10:37:39.903429+0000","last_fullsized":"2024-03-24T10:37:39.903429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T15:05:09.609086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030926+0000","last_change":"2024-03-24T10:37:37.903374+0000","last_active":"2024-03-24T10:37:40.030926+0000","last_peered":"2024-03-24T10:37:40.030926+0000","last_clean":"2024-03-24T10:37:40.030926+0000","last_became_active":"2024-03-24T10:37:37.903098+0000","last_became_peered":"2024-03-24T10:37:37.903098+0000","last_unstale":"2024-03-24T10:37:40.030926+0000","last_undegraded":"2024-03-24T10:37:40.030926+0000","last_fullsized":"2024-03-24T10:37:40.030926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030743+0000","last_change":"2024-03-24T10:37:38.921423+0000","last_active":"2024-03-24T10:37:40.030743+0000","last_peered":"2024-03-24T10:37:40.030743+0000","last_clean":"2024-03-24T10:37:40.030743+0000","last_became_active":"2024-03-24T10:37:38.921177+0000","last_became_peered":"2024-03-24T10:37:38.921177+0000","last_unstale":"2024-03-24T10:37:40.030743+0000","last_undegraded":"2024-03-24T10:37:40.030743+0000","last_fullsized":"2024-03-24T10:37:40.030743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:24:08.729276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031318+0000","last_change":"2024-03-24T10:37:37.905326+0000","last_active":"2024-03-24T10:37:40.031318+0000","last_peered":"2024-03-24T10:37:40.031318+0000","last_clean":"2024-03-24T10:37:40.031318+0000","last_became_active":"2024-03-24T10:37:37.905024+0000","last_became_peered":"2024-03-24T10:37:37.905024+0000","last_unstale":"2024-03-24T10:37:40.031318+0000","last_undegraded":"2024-03-24T10:37:40.031318+0000","last_fullsized":"2024-03-24T10:37:40.031318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T22:23:05.884448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030411+0000","last_change":"2024-03-24T10:37:38.923788+0000","last_active":"2024-03-24T10:37:40.030411+0000","last_peered":"2024-03-24T10:37:40.030411+0000","last_clean":"2024-03-24T10:37:40.030411+0000","last_became_active":"2024-03-24T10:37:38.923117+0000","last_became_peered":"2024-03-24T10:37:38.923117+0000","last_unstale":"2024-03-24T10:37:40.030411+0000","last_undegraded":"2024-03-24T10:37:40.030411+0000","last_fullsized":"2024-03-24T10:37:40.030411+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T16:51:22.687778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.909287+0000","last_change":"2024-03-24T10:37:37.901453+0000","last_active":"2024-03-24T10:37:39.909287+0000","last_peered":"2024-03-24T10:37:39.909287+0000","last_clean":"2024-03-24T10:37:39.909287+0000","last_became_active":"2024-03-24T10:37:37.901055+0000","last_became_peered":"2024-03-24T10:37:37.901055+0000","last_unstale":"2024-03-24T10:37:39.909287+0000","last_undegraded":"2024-03-24T10:37:39.909287+0000","last_fullsized":"2024-03-24T10:37:39.909287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:13:10.284154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030434+0000","last_change":"2024-03-24T10:37:38.919934+0000","last_active":"2024-03-24T10:37:40.030434+0000","last_peered":"2024-03-24T10:37:40.030434+0000","last_clean":"2024-03-24T10:37:40.030434+0000","last_became_active":"2024-03-24T10:37:38.919667+0000","last_became_peered":"2024-03-24T10:37:38.919667+0000","last_unstale":"2024-03-24T10:37:40.030434+0000","last_undegraded":"2024-03-24T10:37:40.030434+0000","last_fullsized":"2024-03-24T10:37:40.030434+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:44:07.593947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030230+0000","last_change":"2024-03-24T10:37:37.904998+0000","last_active":"2024-03-24T10:37:40.030230+0000","last_peered":"2024-03-24T10:37:40.030230+0000","last_clean":"2024-03-24T10:37:40.030230+0000","last_became_active":"2024-03-24T10:37:37.904745+0000","last_became_peered":"2024-03-24T10:37:37.904745+0000","last_unstale":"2024-03-24T10:37:40.030230+0000","last_undegraded":"2024-03-24T10:37:40.030230+0000","last_fullsized":"2024-03-24T10:37:40.030230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T19:11:53.922909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030971+0000","last_change":"2024-03-24T10:37:38.923352+0000","last_active":"2024-03-24T10:37:40.030971+0000","last_peered":"2024-03-24T10:37:40.030971+0000","last_clean":"2024-03-24T10:37:40.030971+0000","last_became_active":"2024-03-24T10:37:38.923093+0000","last_became_peered":"2024-03-24T10:37:38.923093+0000","last_unstale":"2024-03-24T10:37:40.030971+0000","last_undegraded":"2024-03-24T10:37:40.030971+0000","last_fullsized":"2024-03-24T10:37:40.030971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T13:44:07.205444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.903025+0000","last_change":"2024-03-24T10:37:37.904862+0000","last_active":"2024-03-24T10:37:39.903025+0000","last_peered":"2024-03-24T10:37:39.903025+0000","last_clean":"2024-03-24T10:37:39.903025+0000","last_became_active":"2024-03-24T10:37:37.904560+0000","last_became_peered":"2024-03-24T10:37:37.904560+0000","last_unstale":"2024-03-24T10:37:39.903025+0000","last_undegraded":"2024-03-24T10:37:39.903025+0000","last_fullsized":"2024-03-24T10:37:39.903025+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T14:59:10.594165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:39.908635+0000","last_change":"2024-03-24T10:37:38.932834+0000","last_active":"2024-03-24T10:37:39.908635+0000","last_peered":"2024-03-24T10:37:39.908635+0000","last_clean":"2024-03-24T10:37:39.908635+0000","last_became_active":"2024-03-24T10:37:38.932507+0000","last_became_peered":"2024-03-24T10:37:38.932507+0000","last_unstale":"2024-03-24T10:37:39.908635+0000","last_undegraded":"2024-03-24T10:37:39.908635+0000","last_fullsized":"2024-03-24T10:37:39.908635+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:37.886910+0000","last_clean_scrub_stamp":"2024-03-24T10:37:37.886910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T18:29:58.030027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.030869+0000","last_change":"2024-03-24T10:37:37.908640+0000","last_active":"2024-03-24T10:37:40.030869+0000","last_peered":"2024-03-24T10:37:40.030869+0000","last_clean":"2024-03-24T10:37:40.030869+0000","last_became_active":"2024-03-24T10:37:37.908411+0000","last_became_peered":"2024-03-24T10:37:37.908411+0000","last_unstale":"2024-03-24T10:37:40.030869+0000","last_undegraded":"2024-03-24T10:37:40.030869+0000","last_fullsized":"2024-03-24T10:37:40.030869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:37:36.882480+0000","last_clean_scrub_stamp":"2024-03-24T10:37:36.882480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T20:15:41.879155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-03-24T10:37:40.031180+0000","last_change":"2024-03-24T10:36:16.427094+0000","last_active":"2024-03-24T10:37:40.031180+0000","last_peered":"2024-03-24T10:37:40.031180+0000","last_clean":"2024-03-24T10:37:40.031180+0000","last_became_active":"2024-03-24T10:36:16.426217+0000","last_became_peered":"2024-03-24T10:36:16.426217+0000","last_unstale":"2024-03-24T10:37:40.031180+0000","last_undegraded":"2024-03-24T10:37:40.031180+0000","last_fullsized":"2024-03-24T10:37:40.031180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-24T10:36:15.075817+0000","last_clean_scrub_stamp":"2024-03-24T10:36:15.075817+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-25T12:45:51.125315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":786749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":466944,"data_stored":196345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-24T10:37:46.590 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-24T10:37:46.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-24T10:37:46.735 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.735+0000 7f0d88725640 1 Processor -- start 2024-03-24T10:37:46.736 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.735+0000 7f0d88725640 1 -- start start 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d88725640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d8006e6d0 0x7f0d8006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d88725640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d800cd530 0x7f0d800cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d88725640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d800cd050 con 0x7f0d801445d0 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d88725640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f0d8006d440 con 0x7f0d800cd530 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d88725640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8006f090 con 0x7f0d8006e6d0 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d86cc2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d800cd530 0x7f0d800cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d864c1640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7f0d801445d0 0x7f0d8006cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:53528/0 (socket says 172.21.15.72:53528) 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d86cc2640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0d800cd530 0x7f0d800cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51820/0 (socket says 172.21.15.72:51820) 2024-03-24T10:37:46.737 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d864c1640 1 -- 172.21.15.72:0/2858596542 learned_addr learned my addr 172.21.15.72:0/2858596542 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d85cc0640 1 --2- 172.21.15.72:0/2858596542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d8006e6d0 0x7f0d8006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d86cc2640 1 -- 172.21.15.72:0/2858596542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d8006e6d0 msgr2=0x7f0d8006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d86cc2640 1 --2- 172.21.15.72:0/2858596542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d8006e6d0 0x7f0d8006eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d86cc2640 1 -- 172.21.15.72:0/2858596542 >> v1:172.21.15.79:6789/0 conn(0x7f0d801445d0 legacy=0x7f0d8006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d86cc2640 1 -- 172.21.15.72:0/2858596542 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d800b3fe0 con 0x7f0d800cd530 2024-03-24T10:37:46.738 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.736+0000 7f0d854bf640 1 -- 172.21.15.72:0/2858596542 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067544472 0 0) 0x7f0d800cd050 con 0x7f0d801445d0 2024-03-24T10:37:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.737+0000 7f0d86cc2640 1 --2- 172.21.15.72:0/2858596542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d800cd530 0x7f0d800cd9a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009dc0 tx=0x7f0d7002be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6cb4d775f75126 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.737+0000 7f0d854bf640 1 -- 172.21.15.72:0/2858596542 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7002cbb0 con 0x7f0d800cd530 2024-03-24T10:37:46.739 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.737+0000 7f0d854bf640 1 -- 172.21.15.72:0/2858596542 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d7002cd10 con 0x7f0d800cd530 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.737+0000 7f0d854bf640 1 -- 172.21.15.72:0/2858596542 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70034660 con 0x7f0d800cd530 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 -- 172.21.15.72:0/2858596542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d800cd530 msgr2=0x7f0d800cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 --2- 172.21.15.72:0/2858596542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d800cd530 0x7f0d800cd9a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f0d70009dc0 tx=0x7f0d7002be00 comp rx=0 tx=0).stop 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 -- 172.21.15.72:0/2858596542 shutdown_connections 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 --2- 172.21.15.72:0/2858596542 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d800cd530 0x7f0d800cd9a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 --2- 172.21.15.72:0/2858596542 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d8006e6d0 0x7f0d8006eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 -- 172.21.15.72:0/2858596542 >> 172.21.15.72:0/2858596542 conn(0x7f0d800b1880 msgr2=0x7f0d800b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 -- 172.21.15.72:0/2858596542 shutdown_connections 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.738+0000 7f0d88725640 1 -- 172.21.15.72:0/2858596542 wait complete. 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.739+0000 7f0d88725640 1 Processor -- start 2024-03-24T10:37:46.740 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.739+0000 7f0d88725640 1 -- start start 2024-03-24T10:37:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d8006e6d0 0x7f0d8013ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d800cd530 0x7f0d801505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.742 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 0x7f0d8013d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f0d80150ae0 con 0x7f0d801445d0 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8013db90 con 0x7f0d8006e6d0 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f0d8013de70 con 0x7f0d800cd530 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 0x7f0d8013d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 0x7f0d8013d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51828/0 (socket says 172.21.15.72:51828) 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 -- 172.21.15.72:0/3505353002 learned_addr learned my addr 172.21.15.72:0/3505353002 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d864c1640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d8006e6d0 0x7f0d8013ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d85cc0640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d800cd530 0x7f0d801505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 -- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d800cd530 msgr2=0x7f0d801505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d800cd530 0x7f0d801505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 -- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d8006e6d0 msgr2=0x7f0d8013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d8006e6d0 0x7f0d8013ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 -- 172.21.15.72:0/3505353002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d70009a70 con 0x7f0d801445d0 2024-03-24T10:37:46.743 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d86cc2640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 0x7f0d8013d0f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0d70037040 tx=0x7f0d70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70003b90 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d70003cf0 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8013e150 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70003ea0 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.740+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d8013e710 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.741+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d80071b90 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.742+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f0d70004250 con 0x7f0d801445d0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.742+0000 7f0d7effd640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f0d6c06b810 0x7f0d6c06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.742+0000 7f0d864c1640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f0d6c06b810 0x7f0d6c06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:46.744 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.742+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0d700acad0 con 0x7f0d801445d0 2024-03-24T10:37:46.745 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.743+0000 7f0d864c1640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f0d6c06b810 0x7f0d6c06dcd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007fd0 tx=0x7f0d78007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:46.747 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.746+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f0d70077410 con 0x7f0d801445d0 2024-03-24T10:37:46.987 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.986+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f0d80071500 con 0x7f0d801445d0 2024-03-24T10:37:46.990 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.990+0000 7f0d7effd640 1 -- 172.21.15.72:0/3505353002 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f0d70009450 con 0x7f0d801445d0 2024-03-24T10:37:46.991 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2024-03-24T10:37:46.991 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDwAQBmpt8/IRAAYiR002bSEWemiqCVbKgVlw== 2024-03-24T10:37:46.991 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2024-03-24T10:37:46.991 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2024-03-24T10:37:46.991 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-24T10:37:46.991 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f0d6c06b810 msgr2=0x7f0d6c06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f0d6c06b810 0x7f0d6c06dcd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0d78007fd0 tx=0x7f0d78007de0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 msgr2=0x7f0d8013d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 0x7f0d8013d0f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0d70037040 tx=0x7f0d70004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 shutdown_connections 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f0d6c06b810 0x7f0d6c06dcd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0d801445d0 0x7f0d8013d0f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f0d800cd530 0x7f0d801505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.993 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 --2- 172.21.15.72:0/3505353002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d8006e6d0 0x7f0d8013ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:46.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 >> 172.21.15.72:0/3505353002 conn(0x7f0d800b1880 msgr2=0x7f0d80143420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:46.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 shutdown_connections 2024-03-24T10:37:46.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:46.992+0000 7f0d88725640 1 -- 172.21.15.72:0/3505353002 wait complete. 2024-03-24T10:37:47.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-24T10:37:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.103+0000 7fc97cff6640 1 Processor -- start 2024-03-24T10:37:47.104 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.103+0000 7fc97cff6640 1 -- start start 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97cff6640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc97806d570 0x7fc978071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97cff6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9780acf90 0x7fc9780ad420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97cff6640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9780715f0 con 0x7fc978071050 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97cff6640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7fc978071d90 con 0x7fc97806d570 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97cff6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc9780b4d80 con 0x7fc9780acf90 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc97806d570 0x7fc978071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc97806d570 0x7fc978071850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51830/0 (socket says 172.21.15.72:51830) 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 -- 172.21.15.72:0/13578790 learned_addr learned my addr 172.21.15.72:0/13578790 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc976d9d640 1 --2- 172.21.15.72:0/13578790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9780acf90 0x7fc9780ad420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.106 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 -- 172.21.15.72:0/13578790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9780acf90 msgr2=0x7fc9780ad420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 --2- 172.21.15.72:0/13578790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9780acf90 0x7fc9780ad420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 -- 172.21.15.72:0/13578790 >> v1:172.21.15.79:6789/0 conn(0x7fc978071050 legacy=0x7fc97806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.104+0000 7fc97659c640 1 -- 172.21.15.72:0/13578790 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9780b3d60 con 0x7fc97806d570 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.105+0000 7fc97659c640 1 --2- 172.21.15.72:0/13578790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97806d570 0x7fc978071850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc968009870 tx=0x7fc96802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a43922d0b569ac8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.105+0000 7fc97559a640 1 -- 172.21.15.72:0/13578790 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968030840 con 0x7fc97806d570 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.105+0000 7fc97559a640 1 -- 172.21.15.72:0/13578790 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9680309a0 con 0x7fc97806d570 2024-03-24T10:37:47.107 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.105+0000 7fc97559a640 1 -- 172.21.15.72:0/13578790 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc968030d30 con 0x7fc97806d570 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 -- 172.21.15.72:0/13578790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97806d570 msgr2=0x7fc978071850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 --2- 172.21.15.72:0/13578790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97806d570 0x7fc978071850 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc968009870 tx=0x7fc96802b980 comp rx=0 tx=0).stop 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 -- 172.21.15.72:0/13578790 shutdown_connections 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 --2- 172.21.15.72:0/13578790 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc9780acf90 0x7fc9780ad420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 --2- 172.21.15.72:0/13578790 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc97806d570 0x7fc978071850 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 -- 172.21.15.72:0/13578790 >> 172.21.15.72:0/13578790 conn(0x7fc9780b1920 msgr2=0x7fc9780b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 -- 172.21.15.72:0/13578790 shutdown_connections 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.106+0000 7fc97cff6640 1 -- 172.21.15.72:0/13578790 wait complete. 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.107+0000 7fc97cff6640 1 Processor -- start 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.107+0000 7fc97cff6640 1 -- start start 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97cff6640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc97806d570 0x7fc97814a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.110 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97cff6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978071050 0x7fc97809cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97cff6640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 0x7fc9781e32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97cff6640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fc97809c740 con 0x7fc9780acf90 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97cff6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc97809bac0 con 0x7fc978071050 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97cff6640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fc97809bda0 con 0x7fc97806d570 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 0x7fc9781e32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 0x7fc9781e32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51836/0 (socket says 172.21.15.72:51836) 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 -- 172.21.15.72:0/938268835 learned_addr learned my addr 172.21.15.72:0/938268835 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc97659c640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc97806d570 0x7fc97814a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc975d9b640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978071050 0x7fc97809cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 -- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc97806d570 msgr2=0x7fc97814a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc97806d570 0x7fc97814a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 -- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978071050 msgr2=0x7fc97809cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978071050 0x7fc97809cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.111 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.108+0000 7fc976d9d640 1 -- 172.21.15.72:0/938268835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680094d0 con 0x7fc9780acf90 2024-03-24T10:37:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.109+0000 7fc976d9d640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 0x7fc9781e32d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc970009e00 tx=0x7fc9700075e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.109+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97000add0 con 0x7fc9780acf90 2024-03-24T10:37:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.109+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc970010040 con 0x7fc9780acf90 2024-03-24T10:37:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.109+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97809c080 con 0x7fc9780acf90 2024-03-24T10:37:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.109+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc970003dd0 con 0x7fc9780acf90 2024-03-24T10:37:47.112 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.109+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97814aa40 con 0x7fc9780acf90 2024-03-24T10:37:47.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.110+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97809e080 con 0x7fc9780acf90 2024-03-24T10:37:47.113 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.110+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fc970004030 con 0x7fc9780acf90 2024-03-24T10:37:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.110+0000 7fc966ffd640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc95806b810 0x7fc95806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.111+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc97008a3c0 con 0x7fc9780acf90 2024-03-24T10:37:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.111+0000 7fc97659c640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc95806b810 0x7fc95806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.114 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.111+0000 7fc97659c640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc95806b810 0x7fc95806dcd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc968036000 tx=0x7fc968008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.115 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.115+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fc970054d90 con 0x7fc9780acf90 2024-03-24T10:37:47.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.320+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc97804f550 con 0x7fc9780acf90 2024-03-24T10:37:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.320+0000 7fc966ffd640 1 -- 172.21.15.72:0/938268835 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5181 (secure 0 0 0) 0x7fc970058450 con 0x7fc9780acf90 2024-03-24T10:37:47.321 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:47.321 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4994,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1580270591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6833","nonce":1580270591},{"type":"v1","addr":"172.21.15.79:6835","nonce":1580270591}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5313,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6835/3906196145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":3906196145},{"type":"v1","addr":"172.21.15.72:6835","nonce":3906196145}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5316,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/1450114813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6836","nonce":1450114813},{"type":"v1","addr":"172.21.15.72:6837","nonce":1450114813}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-24T10:37:38.250603+0000","modified":"2024-03-24T10:37:40.253296+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5335},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5335":{"gid":5335,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.79:6834/1435184674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1435184674},{"type":"v1","addr":"172.21.15.79:6834","nonce":1435184674}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5335,"qdb_cluster":[5335]},"id":2}]} 2024-03-24T10:37:47.321 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 15 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc95806b810 msgr2=0x7fc95806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc95806b810 0x7fc95806dcd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc968036000 tx=0x7fc968008030 comp rx=0 tx=0).stop 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 msgr2=0x7fc9781e32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 0x7fc9781e32d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc970009e00 tx=0x7fc9700075e0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 shutdown_connections 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fc95806b810 0x7fc95806dcd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9780acf90 0x7fc9781e32d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc978071050 0x7fc97809cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 --2- 172.21.15.72:0/938268835 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fc97806d570 0x7fc97814a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.323 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 >> 172.21.15.72:0/938268835 conn(0x7fc9780b1920 msgr2=0x7fc97815cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 shutdown_connections 2024-03-24T10:37:47.324 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.322+0000 7fc97cff6640 1 -- 172.21.15.72:0/938268835 wait complete. 2024-03-24T10:37:47.736 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-24T10:37:38.250603+0000', 'modified': '2024-03-24T10:37:40.253296+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5335}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5335': {'gid': 5335, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.79:6834/1435184674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6832', 'nonce': 1435184674}, {'type': 'v1', 'addr': '172.21.15.79:6834', 'nonce': 1435184674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5335, 'qdb_cluster': [5335]} 2024-03-24T10:37:47.737 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-24T10:37:47.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-24T10:37:47.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.838+0000 7f699211e640 1 Processor -- start 2024-03-24T10:37:47.839 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.838+0000 7f699211e640 1 -- start start 2024-03-24T10:37:47.840 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.839+0000 7f699211e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c0716f0 0x7f698c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.839+0000 7f699211e640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c071d00 con 0x7f698c06d860 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.839+0000 7f699211e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698c0b31e0 con 0x7f698c158170 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.839+0000 7f699211e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f698c0b34c0 con 0x7f698c0716f0 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.839+0000 7f698bfff640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f698c06d860 0x7f698c0b3cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42536/0 (socket says 172.21.15.72:42536) 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.839+0000 7f698bfff640 1 -- 172.21.15.72:0/3955989048 learned_addr learned my addr 172.21.15.72:0/3955989048 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.840+0000 7f698affd640 1 --2- 172.21.15.72:0/3955989048 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c0716f0 0x7f698c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.840+0000 7f698a7fc640 1 -- 172.21.15.72:0/3955989048 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644641709 0 0) 0x7f698c071d00 con 0x7f698c06d860 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.840+0000 7f698affd640 1 -- 172.21.15.72:0/3955989048 >> v1:172.21.15.79:6789/0 conn(0x7f698c158170 legacy=0x7f698c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.840+0000 7f698affd640 1 -- 172.21.15.72:0/3955989048 >> v1:172.21.15.72:6789/0 conn(0x7f698c06d860 legacy=0x7f698c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.841 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.840+0000 7f698affd640 1 -- 172.21.15.72:0/3955989048 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f698c0b37a0 con 0x7f698c0716f0 2024-03-24T10:37:47.842 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f698affd640 1 --2- 172.21.15.72:0/3955989048 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c0716f0 0x7f698c06d320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6980009750 tx=0x7f698002b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1b35d41a695437e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f698a7fc640 1 -- 172.21.15.72:0/3955989048 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980030710 con 0x7f698c0716f0 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f698a7fc640 1 -- 172.21.15.72:0/3955989048 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698002e050 con 0x7f698c0716f0 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f698a7fc640 1 -- 172.21.15.72:0/3955989048 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980030a90 con 0x7f698c0716f0 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 -- 172.21.15.72:0/3955989048 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c0716f0 msgr2=0x7f698c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 --2- 172.21.15.72:0/3955989048 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c0716f0 0x7f698c06d320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6980009750 tx=0x7f698002b680 comp rx=0 tx=0).stop 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 -- 172.21.15.72:0/3955989048 shutdown_connections 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 --2- 172.21.15.72:0/3955989048 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c0716f0 0x7f698c06d320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 -- 172.21.15.72:0/3955989048 >> 172.21.15.72:0/3955989048 conn(0x7f698c0b1810 msgr2=0x7f698c0b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 -- 172.21.15.72:0/3955989048 shutdown_connections 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.841+0000 7f699211e640 1 -- 172.21.15.72:0/3955989048 wait complete. 2024-03-24T10:37:47.843 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.842+0000 7f699211e640 1 Processor -- start 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 -- start start 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c06d860 0x7f698c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 0x7f698c0af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c158170 0x7f698c0afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0b00e0 con 0x7f698c0716f0 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f698c0b0300 con 0x7f698c06d860 2024-03-24T10:37:47.845 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f699211e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f698c0b05e0 con 0x7f698c158170 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.843+0000 7f698affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 0x7f698c0af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 0x7f698c0af660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51844/0 (socket says 172.21.15.72:51844) 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 -- 172.21.15.72:0/1937898322 learned_addr learned my addr 172.21.15.72:0/1937898322 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698bfff640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c158170 0x7f698c0afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698b7fe640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c06d860 0x7f698c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 -- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c158170 msgr2=0x7f698c0afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c158170 0x7f698c0afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 -- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c06d860 msgr2=0x7f698c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c06d860 0x7f698c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 -- 172.21.15.72:0/1937898322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6980009400 con 0x7f698c0716f0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f698affd640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 0x7f698c0af660 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6980009870 tx=0x7f69800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f6973fff640 1 -- 172.21.15.72:0/1937898322 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980032950 con 0x7f698c0716f0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f6973fff640 1 -- 172.21.15.72:0/1937898322 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6980032ab0 con 0x7f698c0716f0 2024-03-24T10:37:47.846 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f6973fff640 1 -- 172.21.15.72:0/1937898322 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980032e60 con 0x7f698c0716f0 2024-03-24T10:37:47.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f698c0b08c0 con 0x7f698c0716f0 2024-03-24T10:37:47.847 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.844+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c0b0e80 con 0x7f698c0716f0 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.846+0000 7f6973fff640 1 -- 172.21.15.72:0/1937898322 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f6980039040 con 0x7f698c0716f0 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.846+0000 7f6973fff640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f697806b810 0x7f697806dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.846+0000 7f6973fff640 1 -- 172.21.15.72:0/1937898322 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f69800ac070 con 0x7f698c0716f0 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.846+0000 7f698b7fe640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f697806b810 0x7f697806dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.846+0000 7f698b7fe640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f697806b810 0x7f697806dcd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f697c000f60 tx=0x7f697c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.847+0000 7f6994ddb740 1 Processor -- start 2024-03-24T10:37:47.848 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.847+0000 7f6994ddb740 1 -- start start 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa655d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa60f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 0x5642fa60fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f6994ddb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5642fa57e180 con 0x5642fa6379d0 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5642fa57b6b0 con 0x5642fa658090 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x5642fa576e90 con 0x5642fa658470 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 0x5642fa60fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 0x5642fa60fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51846/0 (socket says 172.21.15.72:51846) 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 -- 172.21.15.72:0/3588551626 learned_addr learned my addr 172.21.15.72:0/3588551626 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698b7fe640 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa655d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.855 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698affd640 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa60f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 -- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 msgr2=0x5642fa60f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa60f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 -- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 msgr2=0x5642fa655d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa655d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 -- 172.21.15.72:0/3588551626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642fa533d80 con 0x5642fa6379d0 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.848+0000 7f698bfff640 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 0x5642fa60fc00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6984001ad0 tx=0x7f6984001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722d02588937b471 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f69717fa640 1 -- 172.21.15.72:0/3588551626 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984017070 con 0x5642fa6379d0 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f69717fa640 1 -- 172.21.15.72:0/3588551626 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69840077f0 con 0x5642fa6379d0 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f69717fa640 1 -- 172.21.15.72:0/3588551626 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69840079a0 con 0x5642fa6379d0 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 -- 172.21.15.72:0/3588551626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 msgr2=0x5642fa60fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 0x5642fa60fc00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6984001ad0 tx=0x7f6984001f90 comp rx=0 tx=0).stop 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 -- 172.21.15.72:0/3588551626 shutdown_connections 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa6379d0 0x5642fa60fc00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.856 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa60f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3588551626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa655d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 -- 172.21.15.72:0/3588551626 >> 172.21.15.72:0/3588551626 conn(0x5642fa60c820 msgr2=0x5642fa6553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 -- 172.21.15.72:0/3588551626 shutdown_connections 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.849+0000 7f6994ddb740 1 -- 172.21.15.72:0/3588551626 wait complete. 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.850+0000 7f6994ddb740 1 -- start start 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.850+0000 7f6994ddb740 1 Processor -- start 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa631220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa635190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa62e820 0x5642fa62c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5642fa51bd50 con 0x5642fa658090 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5642fa24a310 con 0x5642fa62e820 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x5642fa4fc8f0 con 0x5642fa658470 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 10 client.0 _ll_register_callbacks cb 0x5642fa287ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa631220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.857 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa631220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51850/0 (socket says 172.21.15.72:51850) 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 -- 172.21.15.72:0/522183296 learned_addr learned my addr 172.21.15.72:0/522183296 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698affd640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa635190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698bfff640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa62e820 0x5642fa62c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 -- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 msgr2=0x5642fa635190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa635190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 -- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa62e820 msgr2=0x5642fa62c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa62e820 0x5642fa62c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 -- 172.21.15.72:0/522183296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6984004e20 con 0x5642fa658090 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f698b7fe640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa631220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f697c0146e0 tx=0x7f697c001210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe8f38325f5ce9 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f696a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f696a7fc640 1 -- 172.21.15.72:0/522183296 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f697c0138c0 con 0x5642fa658090 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f696a7fc640 1 -- 172.21.15.72:0/522183296 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f697c01c040 con 0x5642fa658090 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.851+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642fa2766c0 con 0x5642fa658090 2024-03-24T10:37:47.858 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f696a7fc640 1 -- 172.21.15.72:0/522183296 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f697c013a20 con 0x5642fa658090 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 10 client.5520 fetch_fsmap learned FSMap version 15 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5642fa575510 con 0x5642fa658090 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f696a7fc640 1 -- 172.21.15.72:0/522183296 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5642fa2766c0 con 0x5642fa658090 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f696a7fc640 1 -- 172.21.15.72:0/522183296 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f697c012070 con 0x5642fa658090 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 10 client.5520 fetch_fsmap finished waiting for FSMap version 15 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 10 client.5520 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 20 client.5520 populate_metadata read hostname 'smithi072' 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa62f510 0x5642fa62f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 4 client.5520 mds_command: new command op to 5335 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 --> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642fa2c7270 con 0x5642fa62f510 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f698affd640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa62f510 0x5642fa62f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f696a7fc640 10 client.5520 ms_handle_connect on v2:172.21.15.79:6832/1435184674 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.852+0000 7f698affd640 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa62f510 0x5642fa62f8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39fdbd911b5aff58 server_cookie=8f0e67f6b95f8f09 in_seq=0 out_seq=0 2024-03-24T10:37:47.859 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.853+0000 7f696a7fc640 1 -- 172.21.15.72:0/522183296 <== mds.0 v2:172.21.15.79:6832/1435184674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5642fa2c7270 con 0x5642fa62f510 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.853+0000 7f696a7fc640 10 client.5520 handle_command_reply: tid=0 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.853+0000 7f6994ddb740 1 client.5520 shutdown 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 msgr2=0x5642fa631220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa631220 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f697c0146e0 tx=0x7f697c001210 comp rx=0 tx=0).stop 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 shutdown_connections 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa62f510 0x5642fa62f8f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa62e820 0x5642fa62c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa658470 0x5642fa635190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f696a7fc640 0 client.5520 ms_handle_reset on v2:172.21.15.79:6832/1435184674 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 --2- 172.21.15.72:0/522183296 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa631220 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 >> 172.21.15.72:0/522183296 conn(0x5642fa6379d0 msgr2=0x5642fa609450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 shutdown_connections 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 1 -- 172.21.15.72:0/522183296 wait complete. 2024-03-24T10:37:47.860 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.854+0000 7f6994ddb740 20 client.5520 trim_cache size 0 max 16384 2024-03-24T10:37:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.871+0000 7f6994ddb740 1 Processor -- start 2024-03-24T10:37:47.872 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 -- start start 2024-03-24T10:37:47.874 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa60e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658470 0x5642fa630580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5642fa60ba20 con 0x5642fa658090 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5642fa634990 con 0x5642fa658470 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.872+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x5642fa60c5b0 con 0x5642fa62e820 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa60e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa60e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51856/0 (socket says 172.21.15.72:51856) 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 -- 172.21.15.72:0/3953340871 learned_addr learned my addr 172.21.15.72:0/3953340871 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698bfff640 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658470 0x5642fa630580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698b7fe640 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 -- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 msgr2=0x5642fa6575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.875 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 -- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658470 msgr2=0x5642fa630580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658470 0x5642fa630580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 -- 172.21.15.72:0/3953340871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642fa511a80 con 0x5642fa658090 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f698affd640 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa60e110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f698007a7c0 tx=0x7f698007d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d684595dbdc32e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f6970ff9640 1 -- 172.21.15.72:0/3953340871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6980082e90 con 0x5642fa658090 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f6970ff9640 1 -- 172.21.15.72:0/3953340871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69800788d0 con 0x5642fa658090 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.873+0000 7f6970ff9640 1 -- 172.21.15.72:0/3953340871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69800921c0 con 0x5642fa658090 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 -- 172.21.15.72:0/3953340871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 msgr2=0x5642fa60e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa60e110 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f698007a7c0 tx=0x7f698007d040 comp rx=0 tx=0).stop 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 -- 172.21.15.72:0/3953340871 shutdown_connections 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658470 0x5642fa630580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658090 0x5642fa60e110 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 --2- 172.21.15.72:0/3953340871 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 -- 172.21.15.72:0/3953340871 >> 172.21.15.72:0/3953340871 conn(0x5642fa6379d0 msgr2=0x5642fa64f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 -- 172.21.15.72:0/3953340871 shutdown_connections 2024-03-24T10:37:47.876 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 -- 172.21.15.72:0/3953340871 wait complete. 2024-03-24T10:37:47.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 -- start start 2024-03-24T10:37:47.877 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.874+0000 7f6994ddb740 1 Processor -- start 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6304b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa6309f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 0x5642fa6098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x5642fa609450 con 0x5642fa658470 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5642fa60f360 con 0x5642fa658090 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x5642fa610750 con 0x5642fa62e820 2024-03-24T10:37:47.880 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f6994ddb740 10 client.0 _ll_register_callbacks cb 0x7f697c0015b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 0x5642fa6098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 0x5642fa6098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51872/0 (socket says 172.21.15.72:51872) 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 -- 172.21.15.72:0/1098404450 learned_addr learned my addr 172.21.15.72:0/1098404450 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698affd640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa6309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698b7fe640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6304b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 -- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 msgr2=0x5642fa6304b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6304b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 -- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 msgr2=0x5642fa6309f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa6309f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.875+0000 7f698bfff640 1 -- 172.21.15.72:0/1098404450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f698c0b0e80 con 0x5642fa658470 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f698bfff640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 0x5642fa6098a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6984006ff0 tx=0x7f6984007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae122d6d9e96a8e server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f696a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f696a7fc640 1 -- 172.21.15.72:0/1098404450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6984022070 con 0x5642fa658470 2024-03-24T10:37:47.881 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f696a7fc640 1 -- 172.21.15.72:0/1098404450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f698401dce0 con 0x5642fa658470 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642fa60b0c0 con 0x5642fa658470 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f696a7fc640 1 -- 172.21.15.72:0/1098404450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f6984017040 con 0x5642fa658470 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 10 client.5526 fetch_fsmap learned FSMap version 15 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5642fa5377e0 con 0x5642fa658470 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f696a7fc640 1 -- 172.21.15.72:0/1098404450 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5642fa60b0c0 con 0x5642fa658470 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f696a7fc640 1 -- 172.21.15.72:0/1098404450 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7f6984012070 con 0x5642fa658470 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 10 client.5526 fetch_fsmap finished waiting for FSMap version 15 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 10 client.5526 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 20 client.5526 populate_metadata read hostname 'smithi072' 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa609de0 0x5642fa635830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 4 client.5526 mds_command: new command op to 5335 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 --> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] -- command(tid 0: {"prefix": "status"}) -- 0x7f69840077f0 con 0x5642fa609de0 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.876+0000 7f698b7fe640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa609de0 0x5642fa635830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.882 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f696a7fc640 10 client.5526 ms_handle_connect on v2:172.21.15.79:6832/1435184674 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f698b7fe640 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa609de0 0x5642fa635830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a6cc84ccdf3b734 server_cookie=70e030a959b68986 in_seq=0 out_seq=0 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f696a7fc640 1 -- 172.21.15.72:0/1098404450 <== mds.0 v2:172.21.15.79:6832/1435184674 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x7f69840077f0 con 0x5642fa609de0 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f696a7fc640 10 client.5526 handle_command_reply: tid=0 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 client.5526 shutdown 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 msgr2=0x5642fa6098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 0x5642fa6098a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6984006ff0 tx=0x7f6984007f60 comp rx=0 tx=0).stop 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 shutdown_connections 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:6832/1435184674,v1:172.21.15.79:6834/1435184674] conn(0x5642fa609de0 0x5642fa635830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5642fa658470 0x5642fa6098a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5642fa658090 0x5642fa6309f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f696a7fc640 0 client.5526 ms_handle_reset on v2:172.21.15.79:6832/1435184674 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 --2- 172.21.15.72:0/1098404450 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5642fa62e820 0x5642fa6304b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 >> 172.21.15.72:0/1098404450 conn(0x5642fa6379d0 msgr2=0x5642fa60e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 shutdown_connections 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 1 -- 172.21.15.72:0/1098404450 wait complete. 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.877+0000 7f6994ddb740 20 client.5526 trim_cache size 0 max 16384 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "0cd6a1e7-49c4-4ce2-8320-31fe22775d9b", 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5335, 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 8.9773538370000008, 2024-03-24T10:37:47.884 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 15, 2024-03-24T10:37:47.885 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 39, 2024-03-24T10:37:47.885 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 39, 2024-03-24T10:37:47.885 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 15.949446463999999 2024-03-24T10:37:47.885 INFO:teuthology.orchestra.run.smithi072.stdout:} 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f697806b810 msgr2=0x7f697806dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f697806b810 0x7f697806dcd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f697c000f60 tx=0x7f697c009040 comp rx=0 tx=0).stop 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 msgr2=0x7f698c0af660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 0x7f698c0af660 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6980009870 tx=0x7f69800046c0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 shutdown_connections 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f697806b810 0x7f697806dcd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f698c158170 0x7f698c0afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f698c0716f0 0x7f698c0af660 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 --2- 172.21.15.72:0/1937898322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f698c06d860 0x7f698c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 >> 172.21.15.72:0/1937898322 conn(0x7f698c0b1810 msgr2=0x7f698c158f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 shutdown_connections 2024-03-24T10:37:47.886 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.878+0000 7f699211e640 1 -- 172.21.15.72:0/1937898322 wait complete. 2024-03-24T10:37:47.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-24T10:37:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.993+0000 7f56937a7640 1 Processor -- start 2024-03-24T10:37:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.994+0000 7f56937a7640 1 -- start start 2024-03-24T10:37:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.994+0000 7f56937a7640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f568c15e170 0x7f568c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.994+0000 7f56937a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c0d4930 0x7f568c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.994+0000 7f56937a7640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568c0d4e50 con 0x7f568c0d2280 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.994+0000 7f56937a7640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f568c0cf790 con 0x7f568c15e170 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.994+0000 7f56937a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f568c0cfa70 con 0x7f568c0d4930 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691543640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f568c15e170 0x7f568c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691d44640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f568c0d2280 0x7f568c0d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:42544/0 (socket says 172.21.15.72:42544) 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691d44640 1 -- 172.21.15.72:0/862708222 learned_addr learned my addr 172.21.15.72:0/862708222 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5690d42640 1 --2- 172.21.15.72:0/862708222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c0d4930 0x7f568c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691543640 1 -- 172.21.15.72:0/862708222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c0d4930 msgr2=0x7f568c0d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691543640 1 --2- 172.21.15.72:0/862708222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c0d4930 0x7f568c0d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691543640 1 -- 172.21.15.72:0/862708222 >> v1:172.21.15.72:6789/0 conn(0x7f568c0d2280 legacy=0x7f568c0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5691543640 1 -- 172.21.15.72:0/862708222 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f568c0cfd50 con 0x7f568c15e170 2024-03-24T10:37:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.995+0000 7f5683fff640 1 -- 172.21.15.72:0/862708222 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442520829 0 0) 0x7f568c0d4e50 con 0x7f568c0d2280 2024-03-24T10:37:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f5691543640 1 --2- 172.21.15.72:0/862708222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c15e170 0x7f568c15e550 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5684009d90 tx=0x7f568402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac55f327cc62246 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f5683fff640 1 -- 172.21.15.72:0/862708222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568402cbc0 con 0x7f568c15e170 2024-03-24T10:37:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f5683fff640 1 -- 172.21.15.72:0/862708222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568402cd20 con 0x7f568c15e170 2024-03-24T10:37:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f5683fff640 1 -- 172.21.15.72:0/862708222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5684034660 con 0x7f568c15e170 2024-03-24T10:37:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 -- 172.21.15.72:0/862708222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c15e170 msgr2=0x7f568c15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 --2- 172.21.15.72:0/862708222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c15e170 0x7f568c15e550 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5684009d90 tx=0x7f568402be10 comp rx=0 tx=0).stop 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 -- 172.21.15.72:0/862708222 shutdown_connections 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 --2- 172.21.15.72:0/862708222 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c0d4930 0x7f568c0d1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 --2- 172.21.15.72:0/862708222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c15e170 0x7f568c15e550 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 -- 172.21.15.72:0/862708222 >> 172.21.15.72:0/862708222 conn(0x7f568c09d310 msgr2=0x7f568c0d3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 -- 172.21.15.72:0/862708222 shutdown_connections 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.996+0000 7f56937a7640 1 -- 172.21.15.72:0/862708222 wait complete. 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 Processor -- start 2024-03-24T10:37:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 -- start start 2024-03-24T10:37:48.001 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 0x7f568c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:48.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568c0d4930 0x7f568c0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:48.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c15e170 0x7f568c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:48.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f568c15a130 con 0x7f568c0d2280 2024-03-24T10:37:48.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f568c159520 con 0x7f568c0d4930 2024-03-24T10:37:48.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f56937a7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f568c159800 con 0x7f568c15e170 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f5691543640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 0x7f568c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f5691543640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 0x7f568c158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:51890/0 (socket says 172.21.15.72:51890) 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f5691543640 1 -- 172.21.15.72:0/1049176830 learned_addr learned my addr 172.21.15.72:0/1049176830 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691d44640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c15e170 0x7f568c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.998+0000 7f5690d42640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568c0d4930 0x7f568c0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691543640 1 -- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c15e170 msgr2=0x7f568c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691543640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c15e170 0x7f568c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691543640 1 -- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568c0d4930 msgr2=0x7f568c0cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691543640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568c0d4930 0x7f568c0cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691543640 1 -- 172.21.15.72:0/1049176830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5684009a70 con 0x7f568c0d2280 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5691543640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 0x7f568c158860 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5684009d90 tx=0x7f5684004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568403e610 con 0x7f568c0d2280 2024-03-24T10:37:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f568402ce90 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568403e9f0 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f568c159ae0 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:47.999+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f568c0cd700 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.000+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f568c0a1ef0 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.001+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f568403b050 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.001+0000 7f5681ffb640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f567006b840 0x7f567006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.001+0000 7f5690d42640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f567006b840 0x7f567006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.001+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f56840ac690 con 0x7f568c0d2280 2024-03-24T10:37:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.002+0000 7f5690d42640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f567006b840 0x7f567006dd00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f568c158f60 tx=0x7f567c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:37:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.006+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5684077060 con 0x7f568c0d2280 2024-03-24T10:37:48.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.214+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f568c0b9ce0 con 0x7f568c0d2280 2024-03-24T10:37:48.215 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.214+0000 7f5681ffb640 1 -- 172.21.15.72:0/1049176830 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7f568407a720 con 0x7f568c0d2280 2024-03-24T10:37:48.215 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-24T10:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f567006b840 msgr2=0x7f567006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f567006b840 0x7f567006dd00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f568c158f60 tx=0x7f567c009190 comp rx=0 tx=0).stop 2024-03-24T10:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 msgr2=0x7f568c158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 0x7f568c158860 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5684009d90 tx=0x7f5684004a40 comp rx=0 tx=0).stop 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 shutdown_connections 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f567006b840 0x7f567006dd00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f568c15e170 0x7f568c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f568c0d4930 0x7f568c0cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 --2- 172.21.15.72:0/1049176830 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f568c0d2280 0x7f568c158860 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 >> 172.21.15.72:0/1049176830 conn(0x7f568c09d310 msgr2=0x7f568c0d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 shutdown_connections 2024-03-24T10:37:48.218 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48.216+0000 7f56937a7640 1 -- 172.21.15.72:0/1049176830 wait complete. 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-24T10:37:48.228 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:37:48.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.228 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.244 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f0 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: altname enp7s0f1 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ec4:7aff:fe8f:b765/64 scope link 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.245 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether ae:38:a6:4f:5d:73 brd ff:ff:ff:ff:ff:ff 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::cc84:caff:fe04:6e/64 scope link 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether ae:38:a6:4f:5d:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::ac38:a6ff:fe4f:5d73/64 scope link 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether fa:ae:ec:42:d1:a1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::f8ae:ecff:fe42:d1a1/64 scope link 2024-03-24T10:37:48.246 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2024-03-24T10:37:48.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.247 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-24T10:37:48.310 INFO:teuthology.orchestra.run.smithi072.stdout:1 2024-03-24T10:37:48.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.311 DEBUG:teuthology.orchestra.run.smithi072:> route 2024-03-24T10:37:48.367 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2024-03-24T10:37:48.367 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-24T10:37:48.367 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-24T10:37:48.367 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-24T10:37:48.367 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-24T10:37:48.368 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-24T10:37:48.368 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2024-03-24T10:37:48.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-24T10:37:48.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-24T10:37:48.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-24T10:37:48.368 DEBUG:teuthology.orchestra.run.smithi072:> ') 2024-03-24T10:37:48.455 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-24T10:37:48.496 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:48.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.502 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2024-03-24T10:37:48.517 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-24T10:37:48.517 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-24T10:37:48.517 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:37:48.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2024-03-24T10:37:48.585 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:48.585 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:48.640 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-24T10:37:48.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-24T10:37:48.641 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:48.695 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-24T10:37:48.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:48.779 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:48.780 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:48.786 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-24T10:37:48.786 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-24T10:37:48.786 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.79:3300,172.21.15.79:3301" 2024-03-24T10:37:48.787 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with new device syntax: 0@0cd6a1e7-49c4-4ce2-8320-31fe22775d9b.cephfs=/ 2024-03-24T10:37:48.787 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.72:3300/172.21.15.79:3300/172.21.15.79:3301" will pass to kernel 2024-03-24T10:37:48.787 INFO:teuthology.orchestra.run.smithi072.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-24T10:37:48.787 INFO:teuthology.orchestra.run.smithi072.stdout: You just mounted a file system that supports labels which does not 2024-03-24T10:37:48.787 INFO:teuthology.orchestra.run.smithi072.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-24T10:37:48.787 INFO:teuthology.orchestra.run.smithi072.stdout: applications will generate AVC messages and not be allowed access to 2024-03-24T10:37:48.788 INFO:teuthology.orchestra.run.smithi072.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-24T10:37:48.789 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-24T10:37:48.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-24T10:37:48.815 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-24T10:37:48.906 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-24T10:37:48.911 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:37:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-24T10:37:48.917 INFO:teuthology.orchestra.run.smithi072.stdout:client5538 2024-03-24T10:37:48.917 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:37:48.917 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T10:37:48.933 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=xfstests-dev 2024-03-24T10:37:48.989 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.jRAetzsE4Sxfstests-dev 2024-03-24T10:37:48.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:48.989 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.jRAetzsE4Sxfstests-dev) 2024-03-24T10:37:49.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:49.058 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.jRAetzsE4Sxfstests-dev) 2024-03-24T10:37:49.117 INFO:teuthology.orchestra.run.smithi072.stderr:Cloning into '/tmp/tmp.jRAetzsE4Sxfstests-dev'... 2024-03-24T10:37:49.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:49.862 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-24T10:37:49.922 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=test 2024-03-24T10:37:49.977 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.yyEMJv2iLxtest 2024-03-24T10:37:49.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:37:49.977 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-24T10:37:50.034 DEBUG:teuthology.orchestra.run.smithi072:> mktemp -d --suffix=scratch 2024-03-24T10:37:50.089 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:37:50.090 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-24T10:37:50.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-24T10:37:50.696 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:04:19 ago on Sun 24 Mar 2024 10:33:31 AM UTC. 2024-03-24T10:37:50.794 INFO:teuthology.orchestra.run.smithi072.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-24T10:37:50.794 INFO:teuthology.orchestra.run.smithi072.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-24T10:37:50.796 INFO:teuthology.orchestra.run.smithi072.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-24T10:37:50.797 INFO:teuthology.orchestra.run.smithi072.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-24T10:37:50.798 INFO:teuthology.orchestra.run.smithi072.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-24T10:37:50.800 INFO:teuthology.orchestra.run.smithi072.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-24T10:37:50.802 INFO:teuthology.orchestra.run.smithi072.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-24T10:37:50.803 INFO:teuthology.orchestra.run.smithi072.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-24T10:37:50.805 INFO:teuthology.orchestra.run.smithi072.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-24T10:37:50.808 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-24T10:37:50.809 INFO:teuthology.orchestra.run.smithi072.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-24T10:37:50.811 INFO:teuthology.orchestra.run.smithi072.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-24T10:37:50.812 INFO:teuthology.orchestra.run.smithi072.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-24T10:37:50.813 INFO:teuthology.orchestra.run.smithi072.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-24T10:37:50.814 INFO:teuthology.orchestra.run.smithi072.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-24T10:37:50.815 INFO:teuthology.orchestra.run.smithi072.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-24T10:37:50.816 INFO:teuthology.orchestra.run.smithi072.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-24T10:37:50.817 INFO:teuthology.orchestra.run.smithi072.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-24T10:37:50.818 INFO:teuthology.orchestra.run.smithi072.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-24T10:37:50.821 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-24T10:37:50.886 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-24T10:37:50.890 INFO:teuthology.orchestra.run.smithi072.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: kernel-devel x86_64 5.14.0-430.el9 appstream 16 M 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-24T10:37:50.891 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-24T10:37:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout:Installing weak dependencies: 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-24T10:37:50.893 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout:================================================================================ 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout:Install 17 Packages 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 28 Packages 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:37:50.894 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 103 M 2024-03-24T10:37:50.895 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2024-03-24T10:37:51.361 INFO:teuthology.orchestra.run.smithi072.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 120 kB/s | 17 kB 00:00 2024-03-24T10:37:51.385 INFO:teuthology.orchestra.run.smithi072.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 87 kB/s | 14 kB 00:00 2024-03-24T10:37:51.502 INFO:teuthology.orchestra.run.smithi072.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 95 kB/s | 13 kB 00:00 2024-03-24T10:37:51.527 INFO:teuthology.orchestra.run.smithi072.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 103 kB/s | 15 kB 00:00 2024-03-24T10:37:51.695 INFO:teuthology.orchestra.run.smithi072.stdout:(5/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 78 kB/s | 15 kB 00:00 2024-03-24T10:37:51.712 INFO:teuthology.orchestra.run.smithi072.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 106 kB/s | 20 kB 00:00 2024-03-24T10:37:51.829 INFO:teuthology.orchestra.run.smithi072.stdout:(7/45): fio-3.35-1.el9.x86_64.rpm 10 MB/s | 6.2 MB 00:00 2024-03-24T10:37:51.855 INFO:teuthology.orchestra.run.smithi072.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 232 kB/s | 33 kB 00:00 2024-03-24T10:37:51.889 INFO:teuthology.orchestra.run.smithi072.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 4.2 MB/s | 747 kB 00:00 2024-03-24T10:37:51.914 INFO:teuthology.orchestra.run.smithi072.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-03-24T10:37:51.940 INFO:teuthology.orchestra.run.smithi072.stdout:(11/45): rmt-1.6-6.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-03-24T10:37:52.049 INFO:teuthology.orchestra.run.smithi072.stdout:(12/45): libnbd-1.18.1-3.el9.x86_64.rpm 1.2 MB/s | 166 kB 00:00 2024-03-24T10:37:52.158 INFO:teuthology.orchestra.run.smithi072.stdout:(13/45): gdbm-1.19-4.el9.x86_64.rpm 608 kB/s | 132 kB 00:00 2024-03-24T10:37:52.225 INFO:teuthology.orchestra.run.smithi072.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 333 kB/s | 59 kB 00:00 2024-03-24T10:37:52.560 INFO:teuthology.orchestra.run.smithi072.stdout:(15/45): kernel-devel-5.14.0-430.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-03-24T10:37:52.594 INFO:teuthology.orchestra.run.smithi072.stdout:(16/45): python-unversioned-command-3.9.18-3.el 248 kB/s | 8.3 kB 00:00 2024-03-24T10:37:52.645 INFO:teuthology.orchestra.run.smithi072.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 4.0 MB/s | 204 kB 00:00 2024-03-24T10:37:52.670 INFO:teuthology.orchestra.run.smithi072.stdout:(18/45): dump-0.4-0.51.b47.el9.x86_64.rpm 171 kB/s | 88 kB 00:00 2024-03-24T10:37:52.696 INFO:teuthology.orchestra.run.smithi072.stdout:(19/45): python3-3.9.18-3.el9.x86_64.rpm 496 kB/s | 25 kB 00:00 2024-03-24T10:37:52.796 INFO:teuthology.orchestra.run.smithi072.stdout:(20/45): indent-2.2.13-5.el9.x86_64.rpm 314 kB/s | 179 kB 00:00 2024-03-24T10:37:52.864 INFO:teuthology.orchestra.run.smithi072.stdout:(21/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 3.6 MB/s | 619 kB 00:00 2024-03-24T10:37:53.006 INFO:teuthology.orchestra.run.smithi072.stdout:(22/45): python3-libs-3.9.18-3.el9.x86_64.rpm 22 MB/s | 7.3 MB 00:00 2024-03-24T10:37:53.098 INFO:teuthology.orchestra.run.smithi072.stdout:(23/45): device-mapper-1.02.197-2.el9.x86_64.rp 472 kB/s | 141 kB 00:00 2024-03-24T10:37:53.132 INFO:teuthology.orchestra.run.smithi072.stdout:(24/45): device-mapper-event-1.02.197-2.el9.x86 128 kB/s | 34 kB 00:00 2024-03-24T10:37:53.166 INFO:teuthology.orchestra.run.smithi072.stdout:(25/45): device-mapper-event-libs-1.02.197-2.el 202 kB/s | 32 kB 00:00 2024-03-24T10:37:53.375 INFO:teuthology.orchestra.run.smithi072.stdout:(26/45): device-mapper-libs-1.02.197-2.el9.x86_ 647 kB/s | 179 kB 00:00 2024-03-24T10:37:53.426 INFO:teuthology.orchestra.run.smithi072.stdout:(27/45): libcom_err-1.46.5-5.el9.x86_64.rpm 524 kB/s | 26 kB 00:00 2024-03-24T10:37:53.485 INFO:teuthology.orchestra.run.smithi072.stdout:(28/45): libgcc-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2024-03-24T10:37:53.520 INFO:teuthology.orchestra.run.smithi072.stdout:(29/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 627 kB/s | 222 kB 00:00 2024-03-24T10:37:53.562 INFO:teuthology.orchestra.run.smithi072.stdout:(30/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 2.3 MB/s | 1.0 MB 00:00 2024-03-24T10:37:53.588 INFO:teuthology.orchestra.run.smithi072.stdout:(31/45): libss-1.46.5-5.el9.x86_64.rpm 473 kB/s | 32 kB 00:00 2024-03-24T10:37:53.622 INFO:teuthology.orchestra.run.smithi072.stdout:(32/45): libgomp-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 268 kB 00:00 2024-03-24T10:37:53.664 INFO:teuthology.orchestra.run.smithi072.stdout:(33/45): libstdc++-11.4.1-3.el9.x86_64.rpm 7.2 MB/s | 743 kB 00:00 2024-03-24T10:37:53.765 INFO:teuthology.orchestra.run.smithi072.stdout:(34/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 7.0 MB/s | 1.0 MB 00:00 2024-03-24T10:37:53.807 INFO:teuthology.orchestra.run.smithi072.stdout:(35/45): lvm2-2.03.23-2.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2024-03-24T10:37:54.108 INFO:teuthology.orchestra.run.smithi072.stdout:(36/45): cpp-11.4.1-3.el9.x86_64.rpm 31 MB/s | 11 MB 00:00 2024-03-24T10:37:54.141 INFO:teuthology.orchestra.run.smithi072.stdout:(37/45): make-4.3-8.el9.x86_64.rpm 1.1 MB/s | 536 kB 00:00 2024-03-24T10:37:54.367 INFO:teuthology.orchestra.run.smithi072.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 209 kB/s | 47 kB 00:00 2024-03-24T10:37:54.576 INFO:teuthology.orchestra.run.smithi072.stdout:(39/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 27 MB/s | 13 MB 00:00 2024-03-24T10:37:54.601 INFO:teuthology.orchestra.run.smithi072.stdout:(40/45): git-2.43.0-1.el9.x86_64.rpm 217 kB/s | 51 kB 00:00 2024-03-24T10:37:54.727 INFO:teuthology.orchestra.run.smithi072.stdout:(41/45): git-core-doc-2.43.0-1.el9.noarch.rpm 23 MB/s | 2.9 MB 00:00 2024-03-24T10:37:54.852 INFO:teuthology.orchestra.run.smithi072.stdout:(42/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 19 MB/s | 2.4 MB 00:00 2024-03-24T10:37:54.896 INFO:teuthology.orchestra.run.smithi072.stdout:(43/45): perl-Git-2.43.0-1.el9.noarch.rpm 869 kB/s | 38 kB 00:00 2024-03-24T10:37:55.005 INFO:teuthology.orchestra.run.smithi072.stdout:(44/45): git-core-2.43.0-1.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-03-24T10:37:55.539 INFO:teuthology.orchestra.run.smithi072.stdout:(45/45): gcc-11.4.1-3.el9.x86_64.rpm 19 MB/s | 32 MB 00:01 2024-03-24T10:37:55.540 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2024-03-24T10:37:55.540 INFO:teuthology.orchestra.run.smithi072.stdout:Total 22 MB/s | 103 MB 00:04 2024-03-24T10:37:55.714 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:37:55.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:37:56.498 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2024-03-24T10:37:56.797 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2024-03-24T10:37:56.797 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2024-03-24T10:37:58.165 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2024-03-24T10:37:58.165 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2024-03-24T10:38:01.107 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2024-03-24T10:38:01.167 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-24T10:38:01.244 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-24T10:38:01.314 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-24T10:38:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-24T10:38:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-24T10:38:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-24T10:38:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-24T10:38:01.914 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-24T10:38:02.109 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-24T10:38:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-24T10:38:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-24T10:38:03.492 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-24T10:38:03.523 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-24T10:38:04.248 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-24T10:38:04.323 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-24T10:38:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-24T10:38:04.395 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-24T10:38:04.444 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-24T10:38:04.675 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-24T10:38:05.194 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-24T10:38:05.326 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-24T10:38:05.850 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-24T10:38:05.952 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-24T10:38:07.366 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-24T10:38:07.613 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-24T10:38:07.657 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-24T10:38:07.707 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-24T10:38:07.745 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-24T10:38:07.778 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-24T10:38:07.804 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-24T10:38:07.830 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-24T10:38:07.856 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-24T10:38:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-24T10:38:08.037 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-24T10:38:08.088 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-24T10:38:08.125 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-24T10:38:08.157 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-24T10:38:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-24T10:38:17.738 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : kernel-devel-5.14.0-430.el9.x86_64 36/73 2024-03-24T10:38:25.845 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:38:25.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:38:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: kernel-devel-5.14.0-430.el9.x86_64 36/73 2024-03-24T10:38:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-24T10:38:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-24T10:38:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-24T10:38:31.046 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-24T10:38:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-24T10:38:31.047 INFO:teuthology.orchestra.run.smithi072.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-24T10:38:31.047 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:38:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-24T10:38:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-24T10:38:32.468 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-24T10:38:32.511 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-24T10:38:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-24T10:38:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-24T10:38:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-24T10:38:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-24T10:38:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-24T10:38:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-24T10:38:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-24T10:38:32.762 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-24T10:38:32.763 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-24T10:38:32.810 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-24T10:38:32.850 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-24T10:38:32.866 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-24T10:38:32.867 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-24T10:38:32.921 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-24T10:38:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-24T10:38:33.010 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-24T10:38:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-24T10:38:33.070 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-24T10:38:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-24T10:38:33.105 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-24T10:38:33.130 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-24T10:38:33.156 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-24T10:38:33.181 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-24T10:38:33.207 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-24T10:38:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-24T10:38:33.296 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-24T10:38:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-24T10:38:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-24T10:38:33.425 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-24T10:38:33.425 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-24T10:38:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-24T10:38:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-24T10:38:33.581 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-24T10:38:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-24T10:38:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-24T10:38:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 9/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/73 2024-03-24T10:38:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : kernel-devel-5.14.0-430.el9.x86_64 12/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-24T10:38:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-24T10:38:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-24T10:38:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-24T10:38:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-24T10:38:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-24T10:38:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-24T10:38:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-24T10:38:38.523 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-24T10:38:38.523 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:38:38.523 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: git-2.43.0-1.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-24T10:38:38.524 INFO:teuthology.orchestra.run.smithi072.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: libss-1.46.5-5.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: make-1:4.3-8.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: python3-3.9.18-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2024-03-24T10:38:38.525 INFO:teuthology.orchestra.run.smithi072.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-430.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: udftools-2.2-5.el9.x86_64 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:38:38.526 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2024-03-24T10:38:39.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd -m fsgqa 2024-03-24T10:38:39.436 INFO:teuthology.orchestra.run.smithi072.stderr:useradd: user 'fsgqa' already exists 2024-03-24T10:38:39.437 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-24T10:38:39.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo groupadd fsgqa 2024-03-24T10:38:39.505 INFO:teuthology.orchestra.run.smithi072.stderr:groupadd: group 'fsgqa' already exists 2024-03-24T10:38:39.506 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-24T10:38:39.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd fsgqa2 2024-03-24T10:38:40.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo useradd 123456-fsgqa 2024-03-24T10:38:40.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-24T10:38:40.760 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.760+0000 7f5a648d4640 1 Processor -- start 2024-03-24T10:38:40.761 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.760+0000 7f5a648d4640 1 -- start start 2024-03-24T10:38:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a648d4640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f5a6006e680 0x7f5a60070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a648d4640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a60071380 0x7f5a600ad850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a648d4640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a600725b0 con 0x7f5a6015ae80 2024-03-24T10:38:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a648d4640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f5a60071830 con 0x7f5a60071380 2024-03-24T10:38:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a648d4640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f5a60071a10 con 0x7f5a6006e680 2024-03-24T10:38:40.763 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a60071380 0x7f5a600ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5a60071380 0x7f5a600ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34658/0 (socket says 172.21.15.72:34658) 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 -- 172.21.15.72:0/4195927393 learned_addr learned my addr 172.21.15.72:0/4195927393 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a55d9b640 1 --2- 172.21.15.72:0/4195927393 >> v2:172.21.15.79:3300/0 conn(0x7f5a6006e680 0x7f5a60070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 -- 172.21.15.72:0/4195927393 >> v2:172.21.15.79:3300/0 conn(0x7f5a6006e680 msgr2=0x7f5a60070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 --2- 172.21.15.72:0/4195927393 >> v2:172.21.15.79:3300/0 conn(0x7f5a6006e680 0x7f5a60070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 -- 172.21.15.72:0/4195927393 >> v1:172.21.15.79:6789/0 conn(0x7f5a6015ae80 legacy=0x7f5a6006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.761+0000 7f5a5ed9d640 1 -- 172.21.15.72:0/4195927393 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6015b260 con 0x7f5a60071380 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a5ed9d640 1 --2- 172.21.15.72:0/4195927393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a60071380 0x7f5a600ad850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5a6006c080 tx=0x7f5a5802e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fbd5fc414d2154 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a5dd9b640 1 -- 172.21.15.72:0/4195927393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800b0d0 con 0x7f5a60071380 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a5dd9b640 1 -- 172.21.15.72:0/4195927393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5800b230 con 0x7f5a60071380 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a5dd9b640 1 -- 172.21.15.72:0/4195927393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58009600 con 0x7f5a60071380 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 -- 172.21.15.72:0/4195927393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a60071380 msgr2=0x7f5a600ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:40.764 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 --2- 172.21.15.72:0/4195927393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a60071380 0x7f5a600ad850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f5a6006c080 tx=0x7f5a5802e180 comp rx=0 tx=0).stop 2024-03-24T10:38:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 -- 172.21.15.72:0/4195927393 shutdown_connections 2024-03-24T10:38:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 --2- 172.21.15.72:0/4195927393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a60071380 0x7f5a600ad850 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 --2- 172.21.15.72:0/4195927393 >> v2:172.21.15.79:3300/0 conn(0x7f5a6006e680 0x7f5a60070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 -- 172.21.15.72:0/4195927393 >> 172.21.15.72:0/4195927393 conn(0x7f5a600b1920 msgr2=0x7f5a600b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:38:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 -- 172.21.15.72:0/4195927393 shutdown_connections 2024-03-24T10:38:40.765 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.762+0000 7f5a648d4640 1 -- 172.21.15.72:0/4195927393 wait complete. 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.764+0000 7f5a648d4640 1 Processor -- start 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.764+0000 7f5a648d4640 1 -- start start 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 0x7f5a601426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a60071380 0x7f5a6014d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a6015ae80 0x7f5a600cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f5a6015cf10 con 0x7f5a6006e680 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60153870 con 0x7f5a60071380 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f5a6015c5e0 con 0x7f5a6015ae80 2024-03-24T10:38:40.769 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 0x7f5a601426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 0x7f5a601426d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34674/0 (socket says 172.21.15.72:34674) 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 -- 172.21.15.72:0/3543107999 learned_addr learned my addr 172.21.15.72:0/3543107999 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5ed9d640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a6015ae80 0x7f5a600cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a55d9b640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a60071380 0x7f5a6014d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 -- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a6015ae80 msgr2=0x7f5a600cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a6015ae80 0x7f5a600cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 -- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a60071380 msgr2=0x7f5a6014d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a60071380 0x7f5a6014d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 -- 172.21.15.72:0/3543107999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a5800bd40 con 0x7f5a6006e680 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a5e59c640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 0x7f5a601426d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c3c0 tx=0x7f5a5000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500052d0 con 0x7f5a6006e680 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a50005450 con 0x7f5a6006e680 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50007260 con 0x7f5a6006e680 2024-03-24T10:38:40.770 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.765+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6015c8c0 con 0x7f5a6006e680 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.766+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a60142c10 con 0x7f5a6006e680 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.767+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a6015c720 con 0x7f5a6006e680 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.767+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f5a500073c0 con 0x7f5a6006e680 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.767+0000 7f5a577fe640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5a4006b810 0x7f5a4006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.767+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f5a50089680 con 0x7f5a6006e680 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.767+0000 7f5a55d9b640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5a4006b810 0x7f5a4006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:40.771 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.768+0000 7f5a55d9b640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5a4006b810 0x7f5a4006dcd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5a600b1510 tx=0x7f5a48009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:38:40.772 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:40.772+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f5a6015c720 con 0x7f5a6006e680 2024-03-24T10:38:41.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.009+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5a6015c720 con 0x7f5a6006e680 2024-03-24T10:38:41.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.010+0000 7f5a577fe640 1 -- 172.21.15.72:0/3543107999 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1277 (secure 0 0 0) 0x7f5a6015c720 con 0x7f5a6006e680 2024-03-24T10:38:41.011 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:38:41.011 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":1,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","modified":"2024-03-24T10:35:27.383720Z","created":"2024-03-24T10:35:27.383720Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:3300","nonce":0},{"type":"v1","addr":"172.21.15.72:6789","nonce":0}]},"addr":"172.21.15.72:6789/0","public_addr":"172.21.15.72:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3301","nonce":0},{"type":"v1","addr":"172.21.15.79:6790","nonce":0}]},"addr":"172.21.15.79:6790/0","public_addr":"172.21.15.79:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-24T10:38:41.011 INFO:teuthology.orchestra.run.smithi072.stderr:dumped monmap epoch 1 2024-03-24T10:38:41.012 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.011+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5a4006b810 msgr2=0x7f5a4006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.011+0000 7f5a648d4640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5a4006b810 0x7f5a4006dcd0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5a600b1510 tx=0x7f5a48009190 comp rx=0 tx=0).stop 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.011+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 msgr2=0x7f5a601426d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.011+0000 7f5a648d4640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 0x7f5a601426d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000c3c0 tx=0x7f5a5000c880 comp rx=0 tx=0).stop 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 shutdown_connections 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f5a4006b810 0x7f5a4006dcd0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f5a6015ae80 0x7f5a600cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a60071380 0x7f5a6014d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 --2- 172.21.15.72:0/3543107999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5a6006e680 0x7f5a601426d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 >> 172.21.15.72:0/3543107999 conn(0x7f5a600b1920 msgr2=0x7f5a60068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 shutdown_connections 2024-03-24T10:38:41.013 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.012+0000 7f5a648d4640 1 -- 172.21.15.72:0/3543107999 wait complete. 2024-03-24T10:38:41.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-24T10:38:41.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.125+0000 7f314449d640 1 Processor -- start 2024-03-24T10:38:41.126 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.125+0000 7f314449d640 1 -- start start 2024-03-24T10:38:41.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f314449d640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f313c15bad0 0x7f313c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:41.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f314449d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c072c40 0x7f313c06b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f314449d640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313c06bef0 con 0x7f313c06ba90 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f314449d640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f313c071f50 con 0x7f313c15bad0 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f314449d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f313c0730a0 con 0x7f313c072c40 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3142a3a640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f313c06ba90 0x7f313c15e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:44664/0 (socket says 172.21.15.72:44664) 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3142a3a640 1 -- 172.21.15.72:0/3306707327 learned_addr learned my addr 172.21.15.72:0/3306707327 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3141a38640 1 --2- 172.21.15.72:0/3306707327 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c072c40 0x7f313c06b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3142239640 1 --2- 172.21.15.72:0/3306707327 >> v2:172.21.15.79:3300/0 conn(0x7f313c15bad0 0x7f313c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3141237640 1 -- 172.21.15.72:0/3306707327 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855679182 0 0) 0x7f313c06bef0 con 0x7f313c06ba90 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3141a38640 1 -- 172.21.15.72:0/3306707327 >> v2:172.21.15.79:3300/0 conn(0x7f313c15bad0 msgr2=0x7f313c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3141a38640 1 --2- 172.21.15.72:0/3306707327 >> v2:172.21.15.79:3300/0 conn(0x7f313c15bad0 0x7f313c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3141a38640 1 -- 172.21.15.72:0/3306707327 >> v1:172.21.15.72:6789/0 conn(0x7f313c06ba90 legacy=0x7f313c15e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.126+0000 7f3141a38640 1 -- 172.21.15.72:0/3306707327 --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313c15f6a0 con 0x7f313c072c40 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.127+0000 7f3141a38640 1 --2- 172.21.15.72:0/3306707327 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c072c40 0x7f313c06b550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f312c0097a0 tx=0x7f312c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3eeacb94d60cdbe8 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:38:41.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.127+0000 7f3141237640 1 -- 172.21.15.72:0/3306707327 <== mon.2 v2:172.21.15.79:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c02e070 con 0x7f313c072c40 2024-03-24T10:38:41.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.127+0000 7f3141237640 1 -- 172.21.15.72:0/3306707327 <== mon.2 v2:172.21.15.79:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f312c0315a0 con 0x7f313c072c40 2024-03-24T10:38:41.129 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.127+0000 7f3141237640 1 -- 172.21.15.72:0/3306707327 <== mon.2 v2:172.21.15.79:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f312c031930 con 0x7f313c072c40 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 -- 172.21.15.72:0/3306707327 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c072c40 msgr2=0x7f313c06b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 --2- 172.21.15.72:0/3306707327 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c072c40 0x7f313c06b550 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f312c0097a0 tx=0x7f312c02b840 comp rx=0 tx=0).stop 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 -- 172.21.15.72:0/3306707327 shutdown_connections 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 --2- 172.21.15.72:0/3306707327 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c072c40 0x7f313c06b550 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 --2- 172.21.15.72:0/3306707327 >> v2:172.21.15.79:3300/0 conn(0x7f313c15bad0 0x7f313c15beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 -- 172.21.15.72:0/3306707327 >> 172.21.15.72:0/3306707327 conn(0x7f313c0b1d40 msgr2=0x7f313c0b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 -- 172.21.15.72:0/3306707327 shutdown_connections 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.128+0000 7f314449d640 1 -- 172.21.15.72:0/3306707327 wait complete. 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.129+0000 7f314449d640 1 Processor -- start 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.129+0000 7f314449d640 1 -- start start 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c06ba90 0x7f313c149ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f313c072c40 0x7f313c14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 0x7f313c14aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f313c09c910 con 0x7f313c15bad0 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f313c15eea0 con 0x7f313c072c40 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f313c15ebc0 con 0x7f313c06ba90 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 0x7f313c14aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 0x7f313c14aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:34682/0 (socket says 172.21.15.72:34682) 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3141a38640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f313c072c40 0x7f313c14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 -- 172.21.15.72:0/3017857764 learned_addr learned my addr 172.21.15.72:0/3017857764 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142239640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c06ba90 0x7f313c149ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 -- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c06ba90 msgr2=0x7f313c149ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c06ba90 0x7f313c149ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 -- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f313c072c40 msgr2=0x7f313c14a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f313c072c40 0x7f313c14a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 -- 172.21.15.72:0/3017857764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c009400 con 0x7f313c15bad0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142239640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c06ba90 0x7f313c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3142a3a640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 0x7f313c14aa90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f313400c700 tx=0x7f313400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400ce10 con 0x7f313c15bad0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f313400a640 con 0x7f313c15bad0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f313c09ce20 con 0x7f313c15bad0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f313400aa70 con 0x7f313c15bad0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.130+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f313c1466b0 con 0x7f313c15bad0 2024-03-24T10:38:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.131+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f313c073d50 con 0x7f313c15bad0 2024-03-24T10:38:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.132+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f313400abd0 con 0x7f313c15bad0 2024-03-24T10:38:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.132+0000 7f3132ffd640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f312006b840 0x7f312006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T10:38:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.132+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f31340899a0 con 0x7f313c15bad0 2024-03-24T10:38:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.132+0000 7f3142239640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f312006b840 0x7f312006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T10:38:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.132+0000 7f3142239640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f312006b840 0x7f312006dd00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3138009f30 tx=0x7f3138009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T10:38:41.137 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.136+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3134054350 con 0x7f313c15bad0 2024-03-24T10:38:41.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.371+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f313c06d640 con 0x7f313c15bad0 2024-03-24T10:38:41.372 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.372+0000 7f3132ffd640 1 -- 172.21.15.72:0/3017857764 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v12) ==== 92+0+63 (secure 0 0 0) 0x7f3134018020 con 0x7f313c15bad0 2024-03-24T10:38:41.373 INFO:teuthology.orchestra.run.smithi072.stdout:[client.admin] 2024-03-24T10:38:41.373 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f312006b840 msgr2=0x7f312006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f312006b840 0x7f312006dd00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3138009f30 tx=0x7f3138009190 comp rx=0 tx=0).stop 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 msgr2=0x7f313c14aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 0x7f313c14aa90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f313400c700 tx=0x7f313400cbc0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 shutdown_connections 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f312006b840 0x7f312006dd00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f313c15bad0 0x7f313c14aa90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f313c072c40 0x7f313c14a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 --2- 172.21.15.72:0/3017857764 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f313c06ba90 0x7f313c149ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 >> 172.21.15.72:0/3017857764 conn(0x7f313c0b1d40 msgr2=0x7f313c06cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 shutdown_connections 2024-03-24T10:38:41.375 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T10:38:41.374+0000 7f314449d640 1 -- 172.21.15.72:0/3017857764 wait complete. 2024-03-24T10:38:41.386 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:38:41.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/tmp/tmp.jRAetzsE4Sxfstests-dev/local.config 2024-03-24T10:38:41.413 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.72:6789:/test export TEST_DIR=/tmp/tmp.yyEMJv2iLxtest export SCRATCH_DEV=172.21.15.72:6789:/scratch export SCRATCH_MNT=/tmp/tmp.BUwrcUzctNscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q==" 2024-03-24T10:38:41.413 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T10:38:41.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/tmp/tmp.jRAetzsE4Sxfstests-dev/ceph.exclude 2024-03-24T10:38:41.480 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo make) 2024-03-24T10:38:41.551 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize -cfi 2024-03-24T10:38:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-24T10:38:42.018 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './config.guess' 2024-03-24T10:38:42.021 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './config.sub' 2024-03-24T10:38:42.025 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './install-sh' 2024-03-24T10:38:42.029 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file './ltmain.sh' 2024-03-24T10:38:42.051 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-24T10:38:42.051 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-24T10:38:42.055 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-24T10:38:42.060 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-24T10:38:42.064 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-24T10:38:42.069 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-24T10:38:42.074 INFO:teuthology.orchestra.run.smithi072.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-24T10:38:42.076 INFO:teuthology.orchestra.run.smithi072.stdout:cp include/install-sh . 2024-03-24T10:38:42.077 INFO:teuthology.orchestra.run.smithi072.stdout:aclocal -I m4 2024-03-24T10:38:43.068 INFO:teuthology.orchestra.run.smithi072.stdout:autoheader 2024-03-24T10:38:43.354 INFO:teuthology.orchestra.run.smithi072.stdout:autoconf 2024-03-24T10:38:43.517 INFO:teuthology.orchestra.run.smithi072.stdout:./configure \ 2024-03-24T10:38:43.517 INFO:teuthology.orchestra.run.smithi072.stdout: --libexecdir=/usr/lib \ 2024-03-24T10:38:43.517 INFO:teuthology.orchestra.run.smithi072.stdout: --exec_prefix=/var/lib 2024-03-24T10:38:43.734 INFO:teuthology.orchestra.run.smithi072.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-24T10:38:43.734 INFO:teuthology.orchestra.run.smithi072.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-24T10:38:43.735 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to print strings... printf 2024-03-24T10:38:43.735 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc... gcc 2024-03-24T10:38:43.787 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether the C compiler works... yes 2024-03-24T10:38:43.788 INFO:teuthology.orchestra.run.smithi072.stdout:checking for C compiler default output file name... a.out 2024-03-24T10:38:43.814 INFO:teuthology.orchestra.run.smithi072.stdout:checking for suffix of executables... 2024-03-24T10:38:43.884 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are cross compiling... no 2024-03-24T10:38:43.900 INFO:teuthology.orchestra.run.smithi072.stdout:checking for suffix of object files... o 2024-03-24T10:38:43.915 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are using the GNU C compiler... yes 2024-03-24T10:38:43.930 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc accepts -g... yes 2024-03-24T10:38:43.956 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-24T10:38:43.958 INFO:teuthology.orchestra.run.smithi072.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-24T10:38:43.960 INFO:teuthology.orchestra.run.smithi072.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-24T10:38:43.961 INFO:teuthology.orchestra.run.smithi072.stdout:checking for egrep... /bin/grep -E 2024-03-24T10:38:43.963 INFO:teuthology.orchestra.run.smithi072.stdout:checking for fgrep... /bin/grep -F 2024-03-24T10:38:43.966 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ld used by gcc... /bin/ld 2024-03-24T10:38:43.967 INFO:teuthology.orchestra.run.smithi072.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-24T10:38:43.978 INFO:teuthology.orchestra.run.smithi072.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-24T10:38:46.067 INFO:teuthology.orchestra.run.smithi072.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-24T10:38:46.067 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether ln -s works... yes 2024-03-24T10:38:46.080 INFO:teuthology.orchestra.run.smithi072.stdout:checking the maximum length of command line arguments... 1572864 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking for /bin/ld option to reload object files... -r 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking for objdump... objdump 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to recognize dependent libraries... pass_all 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dlltool... no 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-24T10:38:46.085 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ar... ar 2024-03-24T10:38:46.135 INFO:teuthology.orchestra.run.smithi072.stdout:checking for archiver @FILE support... @ 2024-03-24T10:38:46.135 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strip... strip 2024-03-24T10:38:46.135 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ranlib... ranlib 2024-03-24T10:38:46.135 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gawk... gawk 2024-03-24T10:38:46.199 INFO:teuthology.orchestra.run.smithi072.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-24T10:38:46.201 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sysroot... no 2024-03-24T10:38:46.203 INFO:teuthology.orchestra.run.smithi072.stdout:checking for a working dd... /bin/dd 2024-03-24T10:38:46.205 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-24T10:38:46.218 INFO:teuthology.orchestra.run.smithi072.stdout:checking for mt... no 2024-03-24T10:38:46.220 INFO:teuthology.orchestra.run.smithi072.stdout:checking if : is a manifest tool... no 2024-03-24T10:38:46.269 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to run the C preprocessor... gcc -E 2024-03-24T10:38:46.447 INFO:teuthology.orchestra.run.smithi072.stdout:checking for ANSI C header files... yes 2024-03-24T10:38:46.467 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/types.h... yes 2024-03-24T10:38:46.494 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/stat.h... yes 2024-03-24T10:38:46.517 INFO:teuthology.orchestra.run.smithi072.stdout:checking for stdlib.h... yes 2024-03-24T10:38:46.541 INFO:teuthology.orchestra.run.smithi072.stdout:checking for string.h... yes 2024-03-24T10:38:46.571 INFO:teuthology.orchestra.run.smithi072.stdout:checking for memory.h... yes 2024-03-24T10:38:46.595 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strings.h... yes 2024-03-24T10:38:46.629 INFO:teuthology.orchestra.run.smithi072.stdout:checking for inttypes.h... yes 2024-03-24T10:38:46.653 INFO:teuthology.orchestra.run.smithi072.stdout:checking for stdint.h... yes 2024-03-24T10:38:46.691 INFO:teuthology.orchestra.run.smithi072.stdout:checking for unistd.h... yes 2024-03-24T10:38:46.724 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dlfcn.h... yes 2024-03-24T10:38:46.727 INFO:teuthology.orchestra.run.smithi072.stdout:checking for objdir... .libs 2024-03-24T10:38:46.788 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-24T10:38:46.789 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-24T10:38:46.803 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-24T10:38:46.820 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc static flag -static works... no 2024-03-24T10:38:46.840 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -c -o file.o... yes 2024-03-24T10:38:46.840 INFO:teuthology.orchestra.run.smithi072.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-24T10:38:46.846 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-24T10:38:46.871 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether -lc should be explicitly linked in... no 2024-03-24T10:38:46.928 INFO:teuthology.orchestra.run.smithi072.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-24T10:38:46.929 INFO:teuthology.orchestra.run.smithi072.stdout:checking how to hardcode library paths into programs... immediate 2024-03-24T10:38:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether stripping libraries is possible... yes 2024-03-24T10:38:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:checking if libtool supports shared libraries... yes 2024-03-24T10:38:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether to build shared libraries... yes 2024-03-24T10:38:46.930 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether to build static libraries... yes 2024-03-24T10:38:46.937 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc... (cached) gcc 2024-03-24T10:38:46.954 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-24T10:38:46.954 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-24T10:38:46.954 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-24T10:38:46.954 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gmake... /usr/bin/gmake 2024-03-24T10:38:46.955 INFO:teuthology.orchestra.run.smithi072.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-24T10:38:46.955 INFO:teuthology.orchestra.run.smithi072.stdout:checking for tar... /bin/tar 2024-03-24T10:38:46.955 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gzip... /bin/gzip 2024-03-24T10:38:46.964 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether gcc -MM is supported... yes 2024-03-24T10:38:46.964 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sort... /bin/sort 2024-03-24T10:38:46.964 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether ln -s works... yes 2024-03-24T10:38:46.964 INFO:teuthology.orchestra.run.smithi072.stdout:checking for rpm... /bin/rpm 2024-03-24T10:38:46.967 INFO:teuthology.orchestra.run.smithi072.stdout:checking for rpmbuild... no 2024-03-24T10:38:46.991 INFO:teuthology.orchestra.run.smithi072.stdout:checking assert.h usability... yes 2024-03-24T10:38:47.000 INFO:teuthology.orchestra.run.smithi072.stdout:checking assert.h presence... yes 2024-03-24T10:38:47.000 INFO:teuthology.orchestra.run.smithi072.stdout:checking for assert.h... yes 2024-03-24T10:38:47.026 INFO:teuthology.orchestra.run.smithi072.stdout:checking bstring.h usability... no 2024-03-24T10:38:47.037 INFO:teuthology.orchestra.run.smithi072.stdout:checking bstring.h presence... no 2024-03-24T10:38:47.037 INFO:teuthology.orchestra.run.smithi072.stdout:checking for bstring.h... no 2024-03-24T10:38:47.061 INFO:teuthology.orchestra.run.smithi072.stdout:checking libgen.h usability... yes 2024-03-24T10:38:47.069 INFO:teuthology.orchestra.run.smithi072.stdout:checking libgen.h presence... yes 2024-03-24T10:38:47.069 INFO:teuthology.orchestra.run.smithi072.stdout:checking for libgen.h... yes 2024-03-24T10:38:47.108 INFO:teuthology.orchestra.run.smithi072.stdout:checking dirent.h usability... yes 2024-03-24T10:38:47.117 INFO:teuthology.orchestra.run.smithi072.stdout:checking dirent.h presence... yes 2024-03-24T10:38:47.117 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dirent.h... yes 2024-03-24T10:38:47.183 INFO:teuthology.orchestra.run.smithi072.stdout:checking errno.h usability... yes 2024-03-24T10:38:47.191 INFO:teuthology.orchestra.run.smithi072.stdout:checking errno.h presence... yes 2024-03-24T10:38:47.191 INFO:teuthology.orchestra.run.smithi072.stdout:checking for errno.h... yes 2024-03-24T10:38:47.229 INFO:teuthology.orchestra.run.smithi072.stdout:checking malloc.h usability... yes 2024-03-24T10:38:47.239 INFO:teuthology.orchestra.run.smithi072.stdout:checking malloc.h presence... yes 2024-03-24T10:38:47.239 INFO:teuthology.orchestra.run.smithi072.stdout:checking for malloc.h... yes 2024-03-24T10:38:47.265 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid.h usability... no 2024-03-24T10:38:47.275 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid.h presence... no 2024-03-24T10:38:47.275 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid.h... no 2024-03-24T10:38:47.311 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid/uuid.h usability... yes 2024-03-24T10:38:47.321 INFO:teuthology.orchestra.run.smithi072.stdout:checking uuid/uuid.h presence... yes 2024-03-24T10:38:47.321 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid/uuid.h... yes 2024-03-24T10:38:47.346 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/uuid.h usability... no 2024-03-24T10:38:47.357 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/uuid.h presence... no 2024-03-24T10:38:47.357 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/uuid.h... no 2024-03-24T10:38:47.404 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/file.h usability... yes 2024-03-24T10:38:47.413 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/file.h presence... yes 2024-03-24T10:38:47.413 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/file.h... yes 2024-03-24T10:38:47.444 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fcntl.h usability... yes 2024-03-24T10:38:47.453 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fcntl.h presence... yes 2024-03-24T10:38:47.453 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fcntl.h... yes 2024-03-24T10:38:47.479 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/syssgi.h usability... no 2024-03-24T10:38:47.489 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/syssgi.h presence... no 2024-03-24T10:38:47.489 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/syssgi.h... no 2024-03-24T10:38:47.535 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/param.h usability... yes 2024-03-24T10:38:47.547 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/param.h presence... yes 2024-03-24T10:38:47.547 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/param.h... yes 2024-03-24T10:38:47.552 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/stat.h... (cached) yes 2024-03-24T10:38:47.580 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/statvfs.h usability... yes 2024-03-24T10:38:47.589 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/statvfs.h presence... yes 2024-03-24T10:38:47.589 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/statvfs.h... yes 2024-03-24T10:38:47.616 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/time.h usability... yes 2024-03-24T10:38:47.625 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/time.h presence... yes 2024-03-24T10:38:47.625 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/time.h... yes 2024-03-24T10:38:47.656 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/ioctl.h usability... yes 2024-03-24T10:38:47.664 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/ioctl.h presence... yes 2024-03-24T10:38:47.664 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/ioctl.h... yes 2024-03-24T10:38:47.692 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/wait.h usability... yes 2024-03-24T10:38:47.702 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/wait.h presence... yes 2024-03-24T10:38:47.702 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/wait.h... yes 2024-03-24T10:38:47.707 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/types.h... (cached) yes 2024-03-24T10:38:47.711 INFO:teuthology.orchestra.run.smithi072.stdout:checking for strings.h... (cached) yes 2024-03-24T10:38:47.737 INFO:teuthology.orchestra.run.smithi072.stdout:checking err.h usability... yes 2024-03-24T10:38:47.746 INFO:teuthology.orchestra.run.smithi072.stdout:checking err.h presence... yes 2024-03-24T10:38:47.746 INFO:teuthology.orchestra.run.smithi072.stdout:checking for err.h... yes 2024-03-24T10:38:47.776 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/falloc.h usability... yes 2024-03-24T10:38:47.783 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/falloc.h presence... yes 2024-03-24T10:38:47.784 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/falloc.h... yes 2024-03-24T10:38:47.809 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-24T10:38:47.820 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-24T10:38:47.820 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-24T10:38:47.844 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-24T10:38:47.854 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-24T10:38:47.854 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-24T10:38:47.877 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/platform_defs.h usability... no 2024-03-24T10:38:47.888 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/platform_defs.h presence... no 2024-03-24T10:38:47.888 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/platform_defs.h... no 2024-03-24T10:38:47.911 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfs/ioctl.h usability... no 2024-03-24T10:38:47.922 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfs/ioctl.h presence... no 2024-03-24T10:38:47.922 INFO:teuthology.orchestra.run.smithi072.stdout:checking for btrfs/ioctl.h... no 2024-03-24T10:38:47.945 INFO:teuthology.orchestra.run.smithi072.stdout:checking cifs/ioctl.h usability... no 2024-03-24T10:38:47.955 INFO:teuthology.orchestra.run.smithi072.stdout:checking cifs/ioctl.h presence... no 2024-03-24T10:38:47.955 INFO:teuthology.orchestra.run.smithi072.stdout:checking for cifs/ioctl.h... no 2024-03-24T10:38:47.992 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/mman.h usability... yes 2024-03-24T10:38:48.001 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/mman.h presence... yes 2024-03-24T10:38:48.001 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/mman.h... yes 2024-03-24T10:38:48.015 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xfs_log_format.h... no 2024-03-24T10:38:48.049 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid_compare... no 2024-03-24T10:38:48.079 INFO:teuthology.orchestra.run.smithi072.stdout:checking for uuid_compare in -luuid... yes 2024-03-24T10:38:48.166 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xfs.h... yes 2024-03-24T10:38:48.179 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/libxfs.h... no 2024-03-24T10:38:48.193 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-24T10:38:48.222 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/xqm.h... yes 2024-03-24T10:38:48.270 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-24T10:38:48.293 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/handle.h usability... yes 2024-03-24T10:38:48.300 INFO:teuthology.orchestra.run.smithi072.stdout:checking xfs/handle.h presence... yes 2024-03-24T10:38:48.300 INFO:teuthology.orchestra.run.smithi072.stdout:checking for xfs/handle.h... yes 2024-03-24T10:38:48.331 INFO:teuthology.orchestra.run.smithi072.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-24T10:38:48.354 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/acl.h usability... yes 2024-03-24T10:38:48.363 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/acl.h presence... yes 2024-03-24T10:38:48.363 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/acl.h... yes 2024-03-24T10:38:48.386 INFO:teuthology.orchestra.run.smithi072.stdout:checking acl/libacl.h usability... yes 2024-03-24T10:38:48.395 INFO:teuthology.orchestra.run.smithi072.stdout:checking acl/libacl.h presence... yes 2024-03-24T10:38:48.396 INFO:teuthology.orchestra.run.smithi072.stdout:checking for acl/libacl.h... yes 2024-03-24T10:38:48.426 INFO:teuthology.orchestra.run.smithi072.stdout:checking for acl_init in -lacl... yes 2024-03-24T10:38:48.450 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm-ndbm.h usability... no 2024-03-24T10:38:48.460 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm-ndbm.h presence... no 2024-03-24T10:38:48.460 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gdbm-ndbm.h... no 2024-03-24T10:38:48.482 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm/ndbm.h usability... yes 2024-03-24T10:38:48.492 INFO:teuthology.orchestra.run.smithi072.stdout:checking gdbm/ndbm.h presence... yes 2024-03-24T10:38:48.492 INFO:teuthology.orchestra.run.smithi072.stdout:checking for gdbm/ndbm.h... yes 2024-03-24T10:38:48.527 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_open in -lgdbm... no 2024-03-24T10:38:48.561 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-24T10:38:48.595 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_store in -lgdbm... no 2024-03-24T10:38:48.629 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_close in -lgdbm... no 2024-03-24T10:38:48.667 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-24T10:38:48.697 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-24T10:38:48.729 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-24T10:38:48.761 INFO:teuthology.orchestra.run.smithi072.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-24T10:38:48.784 INFO:teuthology.orchestra.run.smithi072.stdout:checking libaio.h usability... yes 2024-03-24T10:38:48.796 INFO:teuthology.orchestra.run.smithi072.stdout:checking libaio.h presence... yes 2024-03-24T10:38:48.796 INFO:teuthology.orchestra.run.smithi072.stdout:checking for libaio.h... yes 2024-03-24T10:38:48.817 INFO:teuthology.orchestra.run.smithi072.stdout:checking liburing.h usability... no 2024-03-24T10:38:48.829 INFO:teuthology.orchestra.run.smithi072.stdout:checking liburing.h presence... no 2024-03-24T10:38:48.829 INFO:teuthology.orchestra.run.smithi072.stdout:checking for liburing.h... no 2024-03-24T10:38:48.852 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/capability.h usability... yes 2024-03-24T10:38:48.862 INFO:teuthology.orchestra.run.smithi072.stdout:checking sys/capability.h presence... yes 2024-03-24T10:38:48.863 INFO:teuthology.orchestra.run.smithi072.stdout:checking for sys/capability.h... yes 2024-03-24T10:38:48.886 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fiemap.h usability... yes 2024-03-24T10:38:48.894 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fiemap.h presence... yes 2024-03-24T10:38:48.894 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/fiemap.h... yes 2024-03-24T10:38:48.926 INFO:teuthology.orchestra.run.smithi072.stdout:checking for fallocate... yes 2024-03-24T10:38:48.960 INFO:teuthology.orchestra.run.smithi072.stdout:checking for open_by_handle_at... yes 2024-03-24T10:38:48.984 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fs.h usability... yes 2024-03-24T10:38:48.992 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/fs.h presence... yes 2024-03-24T10:38:48.992 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/fs.h... yes 2024-03-24T10:38:49.013 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfsutil.h usability... no 2024-03-24T10:38:49.023 INFO:teuthology.orchestra.run.smithi072.stdout:checking btrfsutil.h presence... no 2024-03-24T10:38:49.023 INFO:teuthology.orchestra.run.smithi072.stdout:checking for btrfsutil.h... no 2024-03-24T10:38:49.058 INFO:teuthology.orchestra.run.smithi072.stdout:checking for copy_file_range... yes 2024-03-24T10:38:49.094 INFO:teuthology.orchestra.run.smithi072.stdout:checking for SEEK_DATA... yes 2024-03-24T10:38:49.143 INFO:teuthology.orchestra.run.smithi072.stdout:checking for BMV_OF_SHARED... yes 2024-03-24T10:38:49.187 INFO:teuthology.orchestra.run.smithi072.stdout:checking for nftw... yes 2024-03-24T10:38:49.221 INFO:teuthology.orchestra.run.smithi072.stdout:checking for RLIMIT_NOFILE... yes 2024-03-24T10:38:49.253 INFO:teuthology.orchestra.run.smithi072.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-24T10:38:49.286 INFO:teuthology.orchestra.run.smithi072.stdout:checking for FICLONE... yes 2024-03-24T10:38:49.319 INFO:teuthology.orchestra.run.smithi072.stdout:checking for renameat2... yes 2024-03-24T10:38:49.351 INFO:teuthology.orchestra.run.smithi072.stdout:checking for reallocarray... yes 2024-03-24T10:38:49.381 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct mount_attr... yes 2024-03-24T10:38:49.420 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-24T10:38:49.450 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-24T10:38:49.482 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-24T10:38:49.514 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-24T10:38:49.545 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-24T10:38:49.577 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-24T10:38:49.609 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-24T10:38:49.634 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs.h usability... yes 2024-03-24T10:38:49.643 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs.h presence... yes 2024-03-24T10:38:49.644 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/btrfs.h... yes 2024-03-24T10:38:49.672 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-24T10:38:49.680 INFO:teuthology.orchestra.run.smithi072.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-24T10:38:49.681 INFO:teuthology.orchestra.run.smithi072.stdout:checking for linux/btrfs_tree.h... yes 2024-03-24T10:38:49.701 INFO:teuthology.orchestra.run.smithi072.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-24T10:38:49.722 INFO:teuthology.orchestra.run.smithi072.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-24T10:38:49.738 INFO:teuthology.orchestra.run.smithi072.stdout:configure: creating ./config.status 2024-03-24T10:38:50.034 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: creating include/builddefs 2024-03-24T10:38:50.044 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: creating include/config.h 2024-03-24T10:38:50.052 INFO:teuthology.orchestra.run.smithi072.stdout:config.status: executing libtool commands 2024-03-24T10:38:50.088 INFO:teuthology.orchestra.run.smithi072.stdout:Building include 2024-03-24T10:38:50.091 INFO:teuthology.orchestra.run.smithi072.stdout:Building lib 2024-03-24T10:38:50.094 INFO:teuthology.orchestra.run.smithi072.stdout: [LTDEP] 2024-03-24T10:38:50.232 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dataascii.lo 2024-03-24T10:38:50.339 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] databin.lo 2024-03-24T10:38:50.470 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] datapid.lo 2024-03-24T10:38:50.563 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] file_lock.lo 2024-03-24T10:38:50.695 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] forker.lo 2024-03-24T10:38:50.814 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] pattern.lo 2024-03-24T10:38:50.922 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] open_flags.lo 2024-03-24T10:38:51.051 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] random_range.lo 2024-03-24T10:38:51.255 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] string_to_tokens.lo 2024-03-24T10:38:51.347 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] str_to_bytes.lo 2024-03-24T10:38:51.466 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] tlibio.lo 2024-03-24T10:38:51.680 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] write_log.lo 2024-03-24T10:38:51.892 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] random.lo 2024-03-24T10:38:51.987 INFO:teuthology.orchestra.run.smithi072.stdout: [LD] 2024-03-24T10:38:52.087 INFO:teuthology.orchestra.run.smithi072.stdout:Building ltp 2024-03-24T10:38:52.089 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-03-24T10:38:52.281 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] doio 2024-03-24T10:38:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsstress 2024-03-24T10:38:54.202 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsx 2024-03-24T10:38:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] growfiles 2024-03-24T10:38:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] iogen 2024-03-24T10:38:55.656 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-stress 2024-03-24T10:38:55.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:38:55.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:38:56.042 INFO:teuthology.orchestra.run.smithi072.stdout:Building src 2024-03-24T10:38:56.048 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-03-24T10:38:57.804 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-03-24T10:38:57.833 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-03-24T10:38:57.840 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-03-24T10:38:58.048 INFO:teuthology.orchestra.run.smithi072.stdout: [DEP] 2024-03-24T10:38:58.069 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirstress 2024-03-24T10:38:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fill 2024-03-24T10:38:58.403 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fill2 2024-03-24T10:38:58.599 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] getpagesize 2024-03-24T10:38:58.713 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] holes 2024-03-24T10:38:58.878 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] lstat64 2024-03-24T10:38:59.036 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] nametest 2024-03-24T10:38:59.248 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] permname 2024-03-24T10:38:59.419 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] randholes 2024-03-24T10:38:59.632 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] runas 2024-03-24T10:38:59.782 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] truncfile 2024-03-24T10:38:59.933 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] usemem 2024-03-24T10:39:00.060 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmapcat 2024-03-24T10:39:00.184 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] append_reader 2024-03-24T10:39:00.311 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] append_writer 2024-03-24T10:39:00.438 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirperf 2024-03-24T10:39:00.633 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] metaperf 2024-03-24T10:39:00.874 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] devzero 2024-03-24T10:39:01.024 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] feature 2024-03-24T10:39:01.209 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] alloc 2024-03-24T10:39:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fault 2024-03-24T10:39:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fstest 2024-03-24T10:39:01.729 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_access_root 2024-03-24T10:39:01.858 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] godown 2024-03-24T10:39:02.001 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] resvtest 2024-03-24T10:39:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] writemod 2024-03-24T10:39:02.280 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] writev_on_pagefault 2024-03-24T10:39:02.414 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] makeextents 2024-03-24T10:39:02.565 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] itrash 2024-03-24T10:39:02.692 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] rename 2024-03-24T10:39:02.809 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] multi_open_unlink 2024-03-24T10:39:02.949 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] unwritten_sync 2024-03-24T10:39:03.101 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] genhashnames 2024-03-24T10:39:03.265 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_holes 2024-03-24T10:39:03.389 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_writev 2024-03-24T10:39:03.513 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_truncate_cmtime 2024-03-24T10:39:03.647 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dirhash_collide 2024-03-24T10:39:03.804 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_rename_overwrite 2024-03-24T10:39:03.922 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] holetest 2024-03-24T10:39:04.118 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_truncate_self 2024-03-24T10:39:04.237 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] af_unix 2024-03-24T10:39:04.364 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_stale_pmd 2024-03-24T10:39:04.493 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_cow_race 2024-03-24T10:39:04.634 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_fallocate 2024-03-24T10:39:04.761 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsync-err 2024-03-24T10:39:04.919 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_write_ro 2024-03-24T10:39:05.048 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-24T10:39:05.182 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-24T10:39:05.313 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_ofd_locks 2024-03-24T10:39:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_collision 2024-03-24T10:39:05.649 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmap-write-concurrent 2024-03-24T10:39:05.793 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_get_file_time 2024-03-24T10:39:05.916 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_create_short_dirs 2024-03-24T10:39:06.059 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_create_long_dirs 2024-03-24T10:39:06.202 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_enospc 2024-03-24T10:39:06.362 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_writev_overlap 2024-03-24T10:39:06.506 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] checkpoint_journal 2024-03-24T10:39:06.638 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mmap-rw-fault 2024-03-24T10:39:06.795 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] allocstale 2024-03-24T10:39:06.939 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_cow_memory_failure 2024-03-24T10:39:07.084 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fake-dump-rootino 2024-03-24T10:39:07.212 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-buf-fault 2024-03-24T10:39:07.341 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] rewinddir-test 2024-03-24T10:39:07.485 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] readdir-while-renames 2024-03-24T10:39:07.623 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] xfsctl 2024-03-24T10:39:07.783 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bstat 2024-03-24T10:39:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mtab 2024-03-24T10:39:08.137 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] getdevicesize 2024-03-24T10:39:08.257 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] preallo_rw_pattern_reader 2024-03-24T10:39:08.391 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] preallo_rw_pattern_writer 2024-03-24T10:39:08.525 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] ftrunc 2024-03-24T10:39:08.649 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] trunc 2024-03-24T10:39:08.787 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fs_perms 2024-03-24T10:39:08.926 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] testx 2024-03-24T10:39:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] looptest 2024-03-24T10:39:09.202 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] locktest 2024-03-24T10:39:09.477 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] unwritten_mmap 2024-03-24T10:39:09.614 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_unlink_test 2024-03-24T10:39:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] deduperace 2024-03-24T10:39:09.951 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_unlink_test_modified 2024-03-24T10:39:10.120 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_offset 2024-03-24T10:39:10.244 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_futimens 2024-03-24T10:39:10.361 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_immutable 2024-03-24T10:39:10.915 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] stale_handle 2024-03-24T10:39:11.059 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] pwrite_mmap_blocked 2024-03-24T10:39:11.188 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_offset2 2024-03-24T10:39:11.354 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] seek_sanity_test 2024-03-24T10:39:11.746 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] seek_copy_test 2024-03-24T10:39:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_1 2024-03-24T10:39:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_2 2024-03-24T10:39:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fsync-tester 2024-03-24T10:39:12.371 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] nsexec 2024-03-24T10:39:12.523 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] cloner 2024-03-24T10:39:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] renameat2 2024-03-24T10:39:12.816 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_getcwd 2024-03-24T10:39:12.950 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] e4compact 2024-03-24T10:39:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] test-nextquota 2024-03-24T10:39:13.270 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] punch-alternating 2024-03-24T10:39:13.416 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-24T10:39:13.557 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] listxattr 2024-03-24T10:39:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-interleaved 2024-03-24T10:39:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_dir_type 2024-03-24T10:39:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dio-invalidate-cache 2024-03-24T10:39:14.128 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] stat_test 2024-03-24T10:39:14.386 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_encrypted_d_revalidate 2024-03-24T10:39:14.525 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] attr_replace_test 2024-03-24T10:39:14.662 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] swapon 2024-03-24T10:39:14.803 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mkswap 2024-03-24T10:39:14.932 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_attr_corruption 2024-03-24T10:39:15.057 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_open_tmpfiles 2024-03-24T10:39:15.210 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fscrypt-crypt-util 2024-03-24T10:39:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] bulkstat_null_ocount 2024-03-24T10:39:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] splice-test 2024-03-24T10:39:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] chprojid_fail 2024-03-24T10:39:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] detached_mounts_propagation 2024-03-24T10:39:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] ext4_resize 2024-03-24T10:39:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_readdir_3 2024-03-24T10:39:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] splice2pipe 2024-03-24T10:39:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] uuid_ioctl 2024-03-24T10:39:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-24T10:39:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fiemap-tester 2024-03-24T10:39:17.320 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_stripealign 2024-03-24T10:39:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] open_by_handle 2024-03-24T10:39:17.669 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] dbtest 2024-03-24T10:39:17.886 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_mmap_dio 2024-03-24T10:39:18.023 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] xfsfind 2024-03-24T10:39:18.191 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] t_reflink_read_race 2024-03-24T10:39:18.355 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] fssum 2024-03-24T10:39:18.748 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2024-03-24T10:39:18.753 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] replay-log 2024-03-24T10:39:19.032 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-03-24T10:39:19.035 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2024-03-24T10:39:19.040 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aiocp 2024-03-24T10:39:19.237 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-24T10:39:19.380 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-append-write-read-race 2024-03-24T10:39:19.530 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-cow-race 2024-03-24T10:39:19.659 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-cycle-write 2024-03-24T10:39:19.833 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-eof-race 2024-03-24T10:39:19.990 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-extend-stat 2024-03-24T10:39:20.129 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-fcntl-race 2024-03-24T10:39:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-hole-filling-race 2024-03-24T10:39:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-invalidate-failure 2024-03-24T10:39:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-invalidate-readahead 2024-03-24T10:39:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aiodio_sparse2 2024-03-24T10:39:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-subblock-eof-read 2024-03-24T10:39:20.980 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-dio-write-verify 2024-03-24T10:39:21.150 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-24T10:39:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-24T10:39:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] aio-last-ref-held-by-io 2024-03-24T10:39:21.525 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2024-03-24T10:39:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] vfstest 2024-03-24T10:39:24.823 INFO:teuthology.orchestra.run.smithi072.stdout: [CC] mount-idmapped 2024-03-24T10:39:25.162 INFO:teuthology.orchestra.run.smithi072.stdout:Building m4 2024-03-24T10:39:25.165 INFO:teuthology.orchestra.run.smithi072.stdout:Building common 2024-03-24T10:39:25.168 INFO:teuthology.orchestra.run.smithi072.stdout:Building tests 2024-03-24T10:39:25.173 INFO:teuthology.orchestra.run.smithi072.stdout:Building btrfs 2024-03-24T10:39:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/btrfs/group.list 2024-03-24T10:39:25.239 INFO:teuthology.orchestra.run.smithi072.stdout:Building ceph 2024-03-24T10:39:25.244 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ceph/group.list 2024-03-24T10:39:25.257 INFO:teuthology.orchestra.run.smithi072.stdout:Building cifs 2024-03-24T10:39:25.262 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/cifs/group.list 2024-03-24T10:39:25.274 INFO:teuthology.orchestra.run.smithi072.stdout:Building ext4 2024-03-24T10:39:25.279 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ext4/group.list 2024-03-24T10:39:25.315 INFO:teuthology.orchestra.run.smithi072.stdout:Building f2fs 2024-03-24T10:39:25.320 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/f2fs/group.list 2024-03-24T10:39:25.337 INFO:teuthology.orchestra.run.smithi072.stdout:Building generic 2024-03-24T10:39:25.343 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/generic/group.list 2024-03-24T10:39:25.437 INFO:teuthology.orchestra.run.smithi072.stdout:Building nfs 2024-03-24T10:39:25.442 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/nfs/group.list 2024-03-24T10:39:25.456 INFO:teuthology.orchestra.run.smithi072.stdout:Building ocfs2 2024-03-24T10:39:25.461 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ocfs2/group.list 2024-03-24T10:39:25.474 INFO:teuthology.orchestra.run.smithi072.stdout:Building overlay 2024-03-24T10:39:25.478 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/overlay/group.list 2024-03-24T10:39:25.518 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-03-24T10:39:25.523 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/perf/group.list 2024-03-24T10:39:25.534 INFO:teuthology.orchestra.run.smithi072.stdout:Building selftest 2024-03-24T10:39:25.538 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/selftest/group.list 2024-03-24T10:39:25.550 INFO:teuthology.orchestra.run.smithi072.stdout:Building shared 2024-03-24T10:39:25.555 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/shared/group.list 2024-03-24T10:39:25.572 INFO:teuthology.orchestra.run.smithi072.stdout:Building tmpfs 2024-03-24T10:39:25.577 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/tmpfs/group.list 2024-03-24T10:39:25.590 INFO:teuthology.orchestra.run.smithi072.stdout:Building udf 2024-03-24T10:39:25.594 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/udf/group.list 2024-03-24T10:39:25.605 INFO:teuthology.orchestra.run.smithi072.stdout:Building xfs 2024-03-24T10:39:25.612 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/xfs/group.list 2024-03-24T10:39:25.708 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo make install) 2024-03-24T10:39:25.746 INFO:teuthology.orchestra.run.smithi072.stdout:Building include 2024-03-24T10:39:25.749 INFO:teuthology.orchestra.run.smithi072.stdout:Building lib 2024-03-24T10:39:25.752 INFO:teuthology.orchestra.run.smithi072.stdout:Building ltp 2024-03-24T10:39:25.756 INFO:teuthology.orchestra.run.smithi072.stdout:Building src 2024-03-24T10:39:25.789 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2024-03-24T10:39:25.793 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-03-24T10:39:25.796 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2024-03-24T10:39:25.800 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2024-03-24T10:39:25.803 INFO:teuthology.orchestra.run.smithi072.stdout:Building m4 2024-03-24T10:39:25.807 INFO:teuthology.orchestra.run.smithi072.stdout:Building common 2024-03-24T10:39:25.810 INFO:teuthology.orchestra.run.smithi072.stdout:Building tests 2024-03-24T10:39:25.815 INFO:teuthology.orchestra.run.smithi072.stdout:Building btrfs 2024-03-24T10:39:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/btrfs/group.list 2024-03-24T10:39:25.879 INFO:teuthology.orchestra.run.smithi072.stdout:Building ceph 2024-03-24T10:39:25.884 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ceph/group.list 2024-03-24T10:39:25.898 INFO:teuthology.orchestra.run.smithi072.stdout:Building cifs 2024-03-24T10:39:25.903 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/cifs/group.list 2024-03-24T10:39:25.915 INFO:teuthology.orchestra.run.smithi072.stdout:Building ext4 2024-03-24T10:39:25.920 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ext4/group.list 2024-03-24T10:39:25.955 INFO:teuthology.orchestra.run.smithi072.stdout:Building f2fs 2024-03-24T10:39:25.960 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/f2fs/group.list 2024-03-24T10:39:25.977 INFO:teuthology.orchestra.run.smithi072.stdout:Building generic 2024-03-24T10:39:25.983 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/generic/group.list 2024-03-24T10:39:26.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:39:26.063 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:39:26.074 INFO:teuthology.orchestra.run.smithi072.stdout:Building nfs 2024-03-24T10:39:26.079 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/nfs/group.list 2024-03-24T10:39:26.094 INFO:teuthology.orchestra.run.smithi072.stdout:Building ocfs2 2024-03-24T10:39:26.098 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ocfs2/group.list 2024-03-24T10:39:26.111 INFO:teuthology.orchestra.run.smithi072.stdout:Building overlay 2024-03-24T10:39:26.116 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/overlay/group.list 2024-03-24T10:39:26.154 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-03-24T10:39:26.159 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/perf/group.list 2024-03-24T10:39:26.170 INFO:teuthology.orchestra.run.smithi072.stdout:Building selftest 2024-03-24T10:39:26.175 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/selftest/group.list 2024-03-24T10:39:26.187 INFO:teuthology.orchestra.run.smithi072.stdout:Building shared 2024-03-24T10:39:26.192 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/shared/group.list 2024-03-24T10:39:26.209 INFO:teuthology.orchestra.run.smithi072.stdout:Building tmpfs 2024-03-24T10:39:26.214 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/tmpfs/group.list 2024-03-24T10:39:26.226 INFO:teuthology.orchestra.run.smithi072.stdout:Building udf 2024-03-24T10:39:26.231 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/udf/group.list 2024-03-24T10:39:26.242 INFO:teuthology.orchestra.run.smithi072.stdout:Building xfs 2024-03-24T10:39:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/xfs/group.list 2024-03-24T10:39:26.340 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-24T10:39:26.341 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-24T10:39:26.342 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-24T10:39:26.344 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-24T10:39:26.344 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-24T10:39:26.346 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-24T10:39:26.354 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-24T10:39:26.422 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-24T10:39:26.430 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-24T10:39:26.447 INFO:teuthology.orchestra.run.smithi072.stdout:Building log-writes 2024-03-24T10:39:26.450 INFO:teuthology.orchestra.run.smithi072.stdout:Building perf 2024-03-24T10:39:26.454 INFO:teuthology.orchestra.run.smithi072.stdout:Building aio-dio-regress 2024-03-24T10:39:26.458 INFO:teuthology.orchestra.run.smithi072.stdout:Building vfs 2024-03-24T10:39:26.460 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C log-writes install 2024-03-24T10:39:26.462 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-24T10:39:26.470 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-24T10:39:26.478 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C perf install 2024-03-24T10:39:26.480 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-24T10:39:26.488 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-24T10:39:26.508 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-24T10:39:26.510 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-24T10:39:26.518 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-24T10:39:26.563 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake -C vfs install 2024-03-24T10:39:26.565 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-24T10:39:26.573 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-24T10:39:26.584 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-24T10:39:26.592 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-24T10:39:27.693 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-24T10:39:27.783 INFO:teuthology.orchestra.run.smithi072.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-24T10:39:27.806 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-24T10:39:27.808 INFO:teuthology.orchestra.run.smithi072.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-24T10:39:27.808 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-24T10:39:27.809 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-24T10:39:27.817 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-24T10:39:27.941 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-24T10:39:27.942 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/btrfs/ install 2024-03-24T10:39:27.945 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/btrfs/group.list 2024-03-24T10:39:28.004 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-24T10:39:28.012 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 /var/lib/xfstests/tests/btrfs 2024-03-24T10:39:28.776 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-24T10:39:28.783 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out /var/lib/xfstests/tests/btrfs 2024-03-24T10:39:29.547 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ceph/ install 2024-03-24T10:39:29.549 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ceph/group.list 2024-03-24T10:39:29.562 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-24T10:39:29.570 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-24T10:39:29.588 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-24T10:39:29.596 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-24T10:39:29.614 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/cifs/ install 2024-03-24T10:39:29.616 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/cifs/group.list 2024-03-24T10:39:29.627 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-24T10:39:29.635 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-24T10:39:29.644 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-24T10:39:29.652 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-24T10:39:29.660 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ext4/ install 2024-03-24T10:39:29.663 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ext4/group.list 2024-03-24T10:39:29.699 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-24T10:39:29.707 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-24T10:39:29.875 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-24T10:39:29.883 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-24T10:39:30.060 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/f2fs/ install 2024-03-24T10:39:30.063 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/f2fs/group.list 2024-03-24T10:39:30.078 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-24T10:39:30.087 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-24T10:39:30.097 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-24T10:39:30.105 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-24T10:39:30.116 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/generic/ install 2024-03-24T10:39:30.119 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/generic/group.list 2024-03-24T10:39:30.213 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-24T10:39:30.221 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-24T10:39:32.013 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-24T10:39:32.021 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-24T10:39:33.841 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/nfs/ install 2024-03-24T10:39:33.843 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/nfs/group.list 2024-03-24T10:39:33.856 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-24T10:39:33.864 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-24T10:39:33.872 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-24T10:39:33.881 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-24T10:39:33.889 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ocfs2/ install 2024-03-24T10:39:33.891 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/ocfs2/group.list 2024-03-24T10:39:33.903 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-24T10:39:33.911 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-24T10:39:33.919 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-24T10:39:33.927 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-24T10:39:33.936 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/overlay/ install 2024-03-24T10:39:33.939 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/overlay/group.list 2024-03-24T10:39:33.977 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-24T10:39:33.985 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-24T10:39:34.238 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-24T10:39:34.246 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-24T10:39:34.504 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/perf/ install 2024-03-24T10:39:34.506 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/perf/group.list 2024-03-24T10:39:34.516 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-24T10:39:34.524 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-24T10:39:34.533 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-24T10:39:34.541 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-24T10:39:34.549 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/selftest/ install 2024-03-24T10:39:34.551 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/selftest/group.list 2024-03-24T10:39:34.562 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-24T10:39:34.570 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-24T10:39:34.590 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-24T10:39:34.598 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-24T10:39:34.618 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/shared/ install 2024-03-24T10:39:34.621 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/shared/group.list 2024-03-24T10:39:34.636 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-24T10:39:34.644 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-24T10:39:34.657 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-24T10:39:34.665 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-24T10:39:34.678 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/tmpfs/ install 2024-03-24T10:39:34.680 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/tmpfs/group.list 2024-03-24T10:39:34.692 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-24T10:39:34.700 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-24T10:39:34.708 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-24T10:39:34.716 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-24T10:39:34.725 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/udf/ install 2024-03-24T10:39:34.727 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/udf/group.list 2024-03-24T10:39:34.737 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-24T10:39:34.745 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-24T10:39:34.753 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-24T10:39:34.761 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-24T10:39:34.770 INFO:teuthology.orchestra.run.smithi072.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/xfs/ install 2024-03-24T10:39:34.773 INFO:teuthology.orchestra.run.smithi072.stdout: [GROUP] /tmp/tmp.jRAetzsE4Sxfstests-dev/tests/xfs/group.list 2024-03-24T10:39:34.868 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-24T10:39:34.876 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-24T10:39:36.561 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-24T10:39:36.569 INFO:teuthology.orchestra.run.smithi072.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-24T10:39:38.286 INFO:teuthology.orchestra.run.smithi072.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-24T10:39:38.294 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-24T10:39:38.302 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-24T10:39:38.310 INFO:teuthology.orchestra.run.smithi072.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-24T10:39:38.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T10:39:38.321 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec ls tests/generic) 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:001 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:001.out 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:002 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:002.out 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:003 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:003.out 2024-03-24T10:39:38.377 INFO:teuthology.orchestra.run.smithi072.stdout:004 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:004.out 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:005 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:005.out 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:006 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:006.out 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:007 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:007.out 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:008 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:008.out 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:009 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:009.out 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:010 2024-03-24T10:39:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:010.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:011 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:011.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:012 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:012.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:013 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:013.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:014 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:014.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:015 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:015.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:016 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:016.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:017 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:017.out 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:018 2024-03-24T10:39:38.379 INFO:teuthology.orchestra.run.smithi072.stdout:018.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:019 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:019.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:020 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:020.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:021 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:021.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:022 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:022.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:023 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:023.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:024 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:024.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:025 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:025.out 2024-03-24T10:39:38.380 INFO:teuthology.orchestra.run.smithi072.stdout:026 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:026.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:027 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:027.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:028 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:028.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:029 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:029.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:030 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:030.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:031 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:031.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:032 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:032.out 2024-03-24T10:39:38.381 INFO:teuthology.orchestra.run.smithi072.stdout:033 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:033.out 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:034 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:034.out 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:035 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:035.cfg 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:035.out.default 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:035.out.nfs 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:036 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:036.out 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:037 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:037.out 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:038 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:038.out 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:039 2024-03-24T10:39:38.382 INFO:teuthology.orchestra.run.smithi072.stdout:039.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:040 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:040.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:041 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:041.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:042 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:042.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:043 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:043.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:044 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:044.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:045 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:045.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:046 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:046.out 2024-03-24T10:39:38.383 INFO:teuthology.orchestra.run.smithi072.stdout:047 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:047.out 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:048 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:048.out 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:049 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:049.out 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:050 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:050.cfg 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.default 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.nojournal 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:050.out.xfsquota 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:051 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:051.out 2024-03-24T10:39:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:052 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:052.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:053 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:053.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:054 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:054.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:055 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:055.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:056 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:056.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:057 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:057.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:058 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:058.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:059 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:059.out 2024-03-24T10:39:38.385 INFO:teuthology.orchestra.run.smithi072.stdout:060 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:060.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:061 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:061.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:062 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:062.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:063 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:063.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:064 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:064.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:065 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:065.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:066 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:066.out 2024-03-24T10:39:38.386 INFO:teuthology.orchestra.run.smithi072.stdout:067 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:067.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:068 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:068.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:069 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:069.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:070 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:070.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:071 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:071.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:072 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:072.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:073 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:073.out 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:074 2024-03-24T10:39:38.387 INFO:teuthology.orchestra.run.smithi072.stdout:074.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:075 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:075.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:076 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:076.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:077 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:077.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:078 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:078.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:079 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:079.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:080 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:080.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:081 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:081.out 2024-03-24T10:39:38.388 INFO:teuthology.orchestra.run.smithi072.stdout:082 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:082.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:083 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:083.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:084 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:084.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:085 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:085.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:086 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:086.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:087 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:087.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:088 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:088.out 2024-03-24T10:39:38.389 INFO:teuthology.orchestra.run.smithi072.stdout:089 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:089.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:090 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:090.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:091 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:091.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:092 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:092.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:093 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:093.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:094 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:094.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:095 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:095.out 2024-03-24T10:39:38.390 INFO:teuthology.orchestra.run.smithi072.stdout:096 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:096.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:097 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:097.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:098 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:098.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:099 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:099.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:100 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:100.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:101 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:101.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:102 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:102.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:103 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:103.out 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:104 2024-03-24T10:39:38.391 INFO:teuthology.orchestra.run.smithi072.stdout:104.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:105 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:105.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:106 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:106.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:107 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:107.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:108 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:108.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:109 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:109.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:110 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:110.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:111 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:111.out 2024-03-24T10:39:38.392 INFO:teuthology.orchestra.run.smithi072.stdout:112 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:112.out 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:113 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:113.out 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:114 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:114.out 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:115 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:115.out 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:116 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:116.out 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:117 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:117.out 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:118 2024-03-24T10:39:38.393 INFO:teuthology.orchestra.run.smithi072.stdout:118.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:119 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:119.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:120 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:120.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:121 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:121.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:122 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:122.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:123 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:123.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:124 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:124.out 2024-03-24T10:39:38.394 INFO:teuthology.orchestra.run.smithi072.stdout:125 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:125.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:126 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:126.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:127 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:127.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:128 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:128.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:129 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:129.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:130 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:130.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:131 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:131.out 2024-03-24T10:39:38.395 INFO:teuthology.orchestra.run.smithi072.stdout:132 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:132.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:133 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:133.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:134 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:134.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:135 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:135.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:136 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:136.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:137 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:137.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:138 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:138.out 2024-03-24T10:39:38.396 INFO:teuthology.orchestra.run.smithi072.stdout:139 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:139.out 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:140 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:140.out 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:141 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:141.out 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:142 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:142.out 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:143 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:143.out 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:144 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:144.out 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:145 2024-03-24T10:39:38.397 INFO:teuthology.orchestra.run.smithi072.stdout:145.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:146 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:146.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:147 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:147.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:148 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:148.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:149 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:149.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:150 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:150.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:151 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:151.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:152 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:152.out 2024-03-24T10:39:38.398 INFO:teuthology.orchestra.run.smithi072.stdout:153 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:153.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:154 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:154.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:155 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:155.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:156 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:156.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:157 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:157.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:158 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:158.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:159 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:159.out 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:160 2024-03-24T10:39:38.399 INFO:teuthology.orchestra.run.smithi072.stdout:160.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:161 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:161.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:162 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:162.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:163 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:163.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:164 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:164.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:165 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:165.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:166 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:166.out 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:167 2024-03-24T10:39:38.400 INFO:teuthology.orchestra.run.smithi072.stdout:167.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:168 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:168.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:169 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:169.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:170 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:170.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:171 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:171.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:172 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:172.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:173 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:173.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:174 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:174.out 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:175 2024-03-24T10:39:38.401 INFO:teuthology.orchestra.run.smithi072.stdout:175.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:176 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:176.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:177 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:177.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:178 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:178.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:179 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:179.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:180 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:180.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:181 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:181.out 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:182 2024-03-24T10:39:38.402 INFO:teuthology.orchestra.run.smithi072.stdout:182.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:183 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:183.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:184 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:184.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:185 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:185.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:186 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:186.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:187 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:187.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:188 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:188.out 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:189 2024-03-24T10:39:38.403 INFO:teuthology.orchestra.run.smithi072.stdout:189.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:190 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:190.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:191 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:191.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:192 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:192.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:193 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:193.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:194 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:194.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:195 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:195.out 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:196 2024-03-24T10:39:38.404 INFO:teuthology.orchestra.run.smithi072.stdout:196.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:197 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:197.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:198 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:198.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:199 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:199.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:200 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:200.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:201 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:201.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:202 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:202.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:203 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:203.out 2024-03-24T10:39:38.405 INFO:teuthology.orchestra.run.smithi072.stdout:204 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:204.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:205 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:205.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:206 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:206.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:207 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:207.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:208 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:208.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:209 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:209.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:210 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:210.out 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:211 2024-03-24T10:39:38.406 INFO:teuthology.orchestra.run.smithi072.stdout:211.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:212 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:212.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:213 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:213.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:214 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:214.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:215 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:215.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:216 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:216.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:217 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:217.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:218 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:218.out 2024-03-24T10:39:38.407 INFO:teuthology.orchestra.run.smithi072.stdout:219 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:219.out 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:220 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:220.out 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:221 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:221.out 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:222 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:222.out 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:223 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:223.out 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:224 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:224.out 2024-03-24T10:39:38.408 INFO:teuthology.orchestra.run.smithi072.stdout:225 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:225.out 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:226 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:226.out 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:227 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:227.out 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:228 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:228.out 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:229 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:229.out 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:230 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:230.out 2024-03-24T10:39:38.409 INFO:teuthology.orchestra.run.smithi072.stdout:231 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:231.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:232 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:232.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:233 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:233.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:234 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:234.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:235 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:235.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:236 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:236.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:237 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:237.out 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:238 2024-03-24T10:39:38.410 INFO:teuthology.orchestra.run.smithi072.stdout:238.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:239 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:239.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:240 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:240.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:241 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:241.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:242 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:242.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:243 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:243.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:244 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:244.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:245 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:245.out 2024-03-24T10:39:38.411 INFO:teuthology.orchestra.run.smithi072.stdout:246 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:246.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:247 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:247.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:248 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:248.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:249 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:249.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:250 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:250.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:251 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:251.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:252 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:252.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:253 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:253.out 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:254 2024-03-24T10:39:38.412 INFO:teuthology.orchestra.run.smithi072.stdout:254.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:255 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:255.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:256 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:256.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:257 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:257.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:258 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:258.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:259 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:259.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:260 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:260.out 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:261 2024-03-24T10:39:38.413 INFO:teuthology.orchestra.run.smithi072.stdout:261.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:262 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:262.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:263 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:263.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:264 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:264.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:265 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:265.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:266 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:266.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:267 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:267.out 2024-03-24T10:39:38.414 INFO:teuthology.orchestra.run.smithi072.stdout:268 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:268.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:269 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:269.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:270 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:270.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:271 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:271.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:272 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:272.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:273 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:273.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:274 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:274.out 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:275 2024-03-24T10:39:38.415 INFO:teuthology.orchestra.run.smithi072.stdout:275.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:276 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:276.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:277 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:277.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:278 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:278.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:279 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:279.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:280 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:280.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:281 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:281.out 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:282 2024-03-24T10:39:38.416 INFO:teuthology.orchestra.run.smithi072.stdout:282.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:283 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:283.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:284 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:284.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:285 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:285.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:286 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:286.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:287 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:287.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:288 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:288.out 2024-03-24T10:39:38.417 INFO:teuthology.orchestra.run.smithi072.stdout:289 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:289.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:290 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:290.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:291 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:291.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:292 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:292.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:293 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:293.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:294 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:294.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:295 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:295.out 2024-03-24T10:39:38.418 INFO:teuthology.orchestra.run.smithi072.stdout:296 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:296.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:297 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:297.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:298 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:298.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:299 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:299.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:300 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:300.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:301 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:301.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:302 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:302.out 2024-03-24T10:39:38.419 INFO:teuthology.orchestra.run.smithi072.stdout:303 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:303.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:304 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:304.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:305 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:305.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:306 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:306.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:307 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:307.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:308 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:308.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:309 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:309.out 2024-03-24T10:39:38.420 INFO:teuthology.orchestra.run.smithi072.stdout:310 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:310.out 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:311 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:311.out 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:312 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:312.out 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:313 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:313.out 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:314 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:314.out 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:315 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:315.out 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:316 2024-03-24T10:39:38.421 INFO:teuthology.orchestra.run.smithi072.stdout:316.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:317 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:317.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:318 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:318.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:319 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:319.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:320 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:320.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:321 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:321.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:322 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:322.out 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:323 2024-03-24T10:39:38.422 INFO:teuthology.orchestra.run.smithi072.stdout:323.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:324 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:324.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:325 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:325.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:326 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:326.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:327 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:327.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:328 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:328.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:329 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:329.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:330 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:330.out 2024-03-24T10:39:38.423 INFO:teuthology.orchestra.run.smithi072.stdout:331 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:331.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:332 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:332.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:333 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:333.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:334 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:334.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:335 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:335.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:336 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:336.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:337 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:337.out 2024-03-24T10:39:38.424 INFO:teuthology.orchestra.run.smithi072.stdout:338 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:338.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:339 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:339.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:340 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:340.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:341 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:341.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:342 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:342.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:343 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:343.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:344 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:344.out 2024-03-24T10:39:38.425 INFO:teuthology.orchestra.run.smithi072.stdout:345 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:345.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:346 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:346.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:347 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:347.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:348 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:348.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:349 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:349.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:350 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:350.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:351 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:351.out 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:352 2024-03-24T10:39:38.426 INFO:teuthology.orchestra.run.smithi072.stdout:352.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:353 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:353.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:354 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:354.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:355 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:355.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:356 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:356.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:357 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:357.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:358 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:358.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:359 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:359.out 2024-03-24T10:39:38.427 INFO:teuthology.orchestra.run.smithi072.stdout:360 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:360.out 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:361 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:361.out 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:362 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:362.out 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:363 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:363.out 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:364 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:364.out 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:365 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:365.out 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:366 2024-03-24T10:39:38.428 INFO:teuthology.orchestra.run.smithi072.stdout:366.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:367 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:367.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:368 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:368.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:369 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:369.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:370 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:370.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:371 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:371.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:372 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:372.out 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:373 2024-03-24T10:39:38.429 INFO:teuthology.orchestra.run.smithi072.stdout:373.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:374 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:374.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:375 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:375.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:376 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:376.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:377 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:377.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:378 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:378.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:379 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:379.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:380 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:380.out 2024-03-24T10:39:38.430 INFO:teuthology.orchestra.run.smithi072.stdout:381 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:381.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:382 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:382.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:383 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:383.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:384 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:384.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:385 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:385.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:386 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:386.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:387 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:387.out 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:388 2024-03-24T10:39:38.431 INFO:teuthology.orchestra.run.smithi072.stdout:388.out 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:389 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:389.out 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:390 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:390.out 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:391 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:391.out 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:392 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:392.out 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:393 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:393.out 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:394 2024-03-24T10:39:38.432 INFO:teuthology.orchestra.run.smithi072.stdout:394.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:395 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:395.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:396 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:396.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:397 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:397.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:398 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:398.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:399 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:399.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:400 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:400.out 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:401 2024-03-24T10:39:38.433 INFO:teuthology.orchestra.run.smithi072.stdout:401.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:402 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:402.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:403 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:403.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:404 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:404.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:405 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:405.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:406 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:406.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:407 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:407.out 2024-03-24T10:39:38.434 INFO:teuthology.orchestra.run.smithi072.stdout:408 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:408.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:409 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:409.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:410 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:410.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:411 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:411.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:412 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:412.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:413 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:413.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:414 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:414.out 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:415 2024-03-24T10:39:38.435 INFO:teuthology.orchestra.run.smithi072.stdout:415.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:416 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:416.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:417 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:417.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:418 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:418.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:419 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:419.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:420 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:420.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:421 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:421.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:422 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:422.out 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:423 2024-03-24T10:39:38.436 INFO:teuthology.orchestra.run.smithi072.stdout:423.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:424 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:424.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:425 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:425.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:426 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:426.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:427 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:427.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:428 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:428.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:429 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:429.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:430 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:430.out 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:431 2024-03-24T10:39:38.437 INFO:teuthology.orchestra.run.smithi072.stdout:431.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:432 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:432.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:433 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:433.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:434 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:434.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:435 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:435.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:436 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:436.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:437 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:437.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:438 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:438.out 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:439 2024-03-24T10:39:38.438 INFO:teuthology.orchestra.run.smithi072.stdout:439.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:440 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:440.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:441 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:441.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:442 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:442.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:443 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:443.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:444 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:444.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:445 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:445.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:446 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:446.out 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:447 2024-03-24T10:39:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:447.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:448 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:448.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:449 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:449.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:450 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:450.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:451 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:451.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:452 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:452.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:453 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:453.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:454 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:454.out 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:455 2024-03-24T10:39:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:455.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:456 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:456.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:457 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:457.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:458 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:458.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:459 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:459.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:460 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:460.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:461 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:461.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:462 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:462.out 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:463 2024-03-24T10:39:38.441 INFO:teuthology.orchestra.run.smithi072.stdout:463.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:464 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:464.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:465 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:465.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:466 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:466.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:467 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:467.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:468 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:468.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:469 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:469.out 2024-03-24T10:39:38.442 INFO:teuthology.orchestra.run.smithi072.stdout:470 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:470.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:471 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:471.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:472 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:472.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:473 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:473.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:474 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:474.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:475 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:475.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:476 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:476.out 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:477 2024-03-24T10:39:38.443 INFO:teuthology.orchestra.run.smithi072.stdout:477.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:478 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:478.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:479 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:479.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:480 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:480.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:481 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:481.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:482 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:482.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:483 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:483.out 2024-03-24T10:39:38.444 INFO:teuthology.orchestra.run.smithi072.stdout:484 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:484.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:485 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:485.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:486 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:486.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:487 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:487.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:488 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:488.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:489 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:489.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:490 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:490.out 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:491 2024-03-24T10:39:38.445 INFO:teuthology.orchestra.run.smithi072.stdout:491.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:492 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:492.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:493 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:493.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:494 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:494.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:495 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:495.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:496 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:496.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:497 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:497.out 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:498 2024-03-24T10:39:38.446 INFO:teuthology.orchestra.run.smithi072.stdout:498.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:499 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:499.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:500 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:500.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:501 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:501.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:502 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:502.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:503 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:503.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:504 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:504.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:505 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:505.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:506 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:506.out 2024-03-24T10:39:38.447 INFO:teuthology.orchestra.run.smithi072.stdout:507 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:507.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:508 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:508.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:509 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:509.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:510 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:510.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:511 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:511.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:512 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:512.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:513 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:513.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:514 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:514.out 2024-03-24T10:39:38.448 INFO:teuthology.orchestra.run.smithi072.stdout:515 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:515.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:516 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:516.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:517 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:517.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:518 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:518.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:519 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:519.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:520 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:520.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:521 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:521.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:522 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:522.out 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:523 2024-03-24T10:39:38.449 INFO:teuthology.orchestra.run.smithi072.stdout:523.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:524 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:524.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:525 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:525.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:526 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:526.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:527 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:527.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:528 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:528.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:529 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:529.out 2024-03-24T10:39:38.450 INFO:teuthology.orchestra.run.smithi072.stdout:530 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:530.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:531 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:531.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:532 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:532.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:533 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:533.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:534 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:534.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:535 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:535.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:536 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:536.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:537 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:537.out 2024-03-24T10:39:38.451 INFO:teuthology.orchestra.run.smithi072.stdout:538 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:538.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:539 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:539.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:540 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:540.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:541 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:541.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:542 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:542.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:543 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:543.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:544 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:544.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:545 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:545.out 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:546 2024-03-24T10:39:38.452 INFO:teuthology.orchestra.run.smithi072.stdout:546.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:547 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:547.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:548 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:548.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:549 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:549.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:550 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:550.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:551 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:551.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:552 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:552.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:553 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:553.out 2024-03-24T10:39:38.453 INFO:teuthology.orchestra.run.smithi072.stdout:554 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:554.out 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:555 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:555.out 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:556 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:556.out 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:557 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:557.out 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:558 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:558.out 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:559 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:559.out 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:560 2024-03-24T10:39:38.454 INFO:teuthology.orchestra.run.smithi072.stdout:560.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:561 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:561.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:562 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:562.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:563 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:563.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:564 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:564.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:565 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:565.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:566 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:566.out 2024-03-24T10:39:38.455 INFO:teuthology.orchestra.run.smithi072.stdout:567 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:567.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:568 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:568.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:569 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:569.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:570 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:570.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:571 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:571.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:572 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:572.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:573 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:573.out 2024-03-24T10:39:38.456 INFO:teuthology.orchestra.run.smithi072.stdout:574 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:574.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:575 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:575.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:576 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:576.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:577 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:577.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:578 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:578.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:579 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:579.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:580 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:580.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:581 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:581.out 2024-03-24T10:39:38.457 INFO:teuthology.orchestra.run.smithi072.stdout:582 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:582.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:583 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:583.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:584 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:584.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:585 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:585.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:586 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:586.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:587 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:587.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:588 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:588.out 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:589 2024-03-24T10:39:38.458 INFO:teuthology.orchestra.run.smithi072.stdout:589.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:590 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:590.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:591 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:591.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:592 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:592.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:593 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:593.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:594 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:594.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:595 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:595.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:596 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:596.out 2024-03-24T10:39:38.459 INFO:teuthology.orchestra.run.smithi072.stdout:597 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:597.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:598 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:598.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:599 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:599.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:600 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:600.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:601 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:601.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:602 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:602.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:603 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:603.out 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:604 2024-03-24T10:39:38.460 INFO:teuthology.orchestra.run.smithi072.stdout:604.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:605 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:605.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:606 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:606.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:607 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:607.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:608 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:608.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:609 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:609.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:610 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:610.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:611 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:611.out 2024-03-24T10:39:38.461 INFO:teuthology.orchestra.run.smithi072.stdout:612 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:612.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:613 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:613.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:614 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:614.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:615 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:615.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:616 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:616.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:617 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:617.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:618 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:618.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:619 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:619.out 2024-03-24T10:39:38.462 INFO:teuthology.orchestra.run.smithi072.stdout:620 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:620.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:621 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:621.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:622 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:622.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:623 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:623.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:624 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:624.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:625 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:625.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:626 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:626.out 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:627 2024-03-24T10:39:38.463 INFO:teuthology.orchestra.run.smithi072.stdout:627.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:628 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:628.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:629 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:629.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:630 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:630.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:631 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:631.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:632 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:632.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:633 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:633.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:634 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:634.out 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:635 2024-03-24T10:39:38.464 INFO:teuthology.orchestra.run.smithi072.stdout:635.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:636 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:636.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:637 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:637.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:638 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:638.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:639 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:639.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:640 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:640.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:641 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:641.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:642 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:642.out 2024-03-24T10:39:38.465 INFO:teuthology.orchestra.run.smithi072.stdout:643 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:643.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:644 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:644.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:645 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:645.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:646 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:646.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:647 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:647.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:648 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:648.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:649 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:649.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:650 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:650.out 2024-03-24T10:39:38.466 INFO:teuthology.orchestra.run.smithi072.stdout:651 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:651.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:652 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:652.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:653 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:653.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:654 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:654.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:655 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:655.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:656 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:656.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:657 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:657.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:658 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:658.out 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:659 2024-03-24T10:39:38.467 INFO:teuthology.orchestra.run.smithi072.stdout:659.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:660 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:660.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:661 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:661.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:662 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:662.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:663 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:663.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:664 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:664.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:665 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:665.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:666 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:666.out 2024-03-24T10:39:38.468 INFO:teuthology.orchestra.run.smithi072.stdout:667 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:667.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:668 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:668.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:669 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:669.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:670 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:670.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:671 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:671.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:672 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:672.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:673 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:673.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:674 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:674.out 2024-03-24T10:39:38.469 INFO:teuthology.orchestra.run.smithi072.stdout:675 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:675.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:676 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:676.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:677 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:677.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:678 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:678.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:679 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:679.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:680 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:680.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:681 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:681.out 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:682 2024-03-24T10:39:38.470 INFO:teuthology.orchestra.run.smithi072.stdout:682.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:683 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:683.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:684 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:684.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:685 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:685.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:686 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:686.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:687 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:687.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:688 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:688.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:689 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:689.out 2024-03-24T10:39:38.471 INFO:teuthology.orchestra.run.smithi072.stdout:690 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:690.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:691 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:691.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:692 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:692.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:693 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:693.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:694 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:694.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:695 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:695.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:696 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:696.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:697 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:697.out 2024-03-24T10:39:38.472 INFO:teuthology.orchestra.run.smithi072.stdout:698 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:698.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:699 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:699.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:700 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:700.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:701 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:701.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:702 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:702.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:703 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:703.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:704 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:704.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:705 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:705.out 2024-03-24T10:39:38.473 INFO:teuthology.orchestra.run.smithi072.stdout:706 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:706.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:707 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:707.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:708 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:708.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:709 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:709.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:710 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:710.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:711 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:711.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:712 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:712.out 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:713 2024-03-24T10:39:38.474 INFO:teuthology.orchestra.run.smithi072.stdout:713.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:714 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:714.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:715 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:715.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:716 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:716.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:717 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:717.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:718 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:718.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:719 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:719.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:720 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:720.out 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:721 2024-03-24T10:39:38.475 INFO:teuthology.orchestra.run.smithi072.stdout:721.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:722 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:722.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:723 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:723.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:724 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:724.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:725 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:725.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:726 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:726.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:727 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:727.out 2024-03-24T10:39:38.476 INFO:teuthology.orchestra.run.smithi072.stdout:728 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:728.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:729 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:729.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:730 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:730.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:731 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:731.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:732 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:732.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:733 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:733.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:734 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:734.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:735 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:735.out 2024-03-24T10:39:38.477 INFO:teuthology.orchestra.run.smithi072.stdout:736 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:736.out 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:737 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:737.out 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:738 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:738.out 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:739 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:739.out 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:group.list 2024-03-24T10:39:38.478 INFO:teuthology.orchestra.run.smithi072.stdout:Makefile 2024-03-24T10:39:38.478 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-24T10:39:38.664 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:39:38.668 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:39:38.668 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:39:38.669 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:39:38.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:44.123 INFO:teuthology.orchestra.run.smithi072.stdout:generic/001 6s 2024-03-24T10:39:44.128 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/001 2024-03-24T10:39:44.128 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:39:44.131 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:44.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:39:44.471 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-24T10:39:44.650 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:39:44.653 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:39:44.654 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:39:44.655 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:39:44.655 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:45.088 INFO:teuthology.orchestra.run.smithi072.stdout:generic/002 1s 2024-03-24T10:39:45.097 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/002 2024-03-24T10:39:45.097 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:39:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:45.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:39:45.249 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-24T10:39:45.428 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:39:45.431 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:39:45.432 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:39:45.433 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:39:45.433 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:45.632 INFO:teuthology.orchestra.run.smithi072.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-24T10:39:45.636 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/003 2024-03-24T10:39:45.636 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/003 2024-03-24T10:39:45.636 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:39:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:45.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:39:45.649 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-24T10:39:45.835 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:39:45.838 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:39:45.839 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:39:45.840 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:39:45.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:46.037 INFO:teuthology.orchestra.run.smithi072.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-24T10:39:46.040 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/004 2024-03-24T10:39:46.041 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/004 2024-03-24T10:39:46.041 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:39:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:46.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:39:46.054 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-24T10:39:46.226 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:39:46.230 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:39:46.230 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:39:46.231 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:39:46.232 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:46.604 INFO:teuthology.orchestra.run.smithi072.stdout:generic/005 0s 2024-03-24T10:39:46.609 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/005 2024-03-24T10:39:46.609 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:39:46.611 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:46.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:39:46.660 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-24T10:39:46.846 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:39:46.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:39:46.850 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:39:46.850 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:39:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:39:56.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:39:56.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:40:13.838 INFO:teuthology.orchestra.run.smithi072.stdout:generic/006 27s 2024-03-24T10:40:13.843 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/006 2024-03-24T10:40:13.843 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:40:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:40:14.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:40:14.086 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-24T10:40:14.273 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:40:14.276 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:40:14.277 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:40:14.278 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:40:14.278 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:40:26.685 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:40:26.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:40:57.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:40:57.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:41:08.478 INFO:teuthology.orchestra.run.smithi072.stdout:generic/007 54s 2024-03-24T10:41:08.483 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/007 2024-03-24T10:41:08.483 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:41:08.485 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:08.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:41:08.523 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-24T10:41:08.712 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:41:08.716 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:41:08.716 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:41:08.717 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:41:08.717 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:09.036 INFO:teuthology.orchestra.run.smithi072.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-24T10:41:09.040 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/008 2024-03-24T10:41:09.040 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/008 2024-03-24T10:41:09.040 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:41:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:09.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:41:09.056 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-24T10:41:09.228 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:41:09.231 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:41:09.232 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:41:09.233 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:41:09.233 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:09.494 INFO:teuthology.orchestra.run.smithi072.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-24T10:41:09.498 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/009 2024-03-24T10:41:09.498 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/009 2024-03-24T10:41:09.498 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:41:09.500 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:09.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:41:09.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-24T10:41:09.688 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:41:09.692 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:41:09.692 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:41:09.693 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:41:09.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:10.212 INFO:teuthology.orchestra.run.smithi072.stdout:generic/010 1s 2024-03-24T10:41:10.217 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/010 2024-03-24T10:41:10.218 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:41:10.220 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:10.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:41:10.256 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-24T10:41:10.443 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:41:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:41:10.447 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:41:10.448 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:41:10.448 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:27.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:41:27.439 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:41:41.553 INFO:teuthology.orchestra.run.smithi072.stdout:generic/011 31s 2024-03-24T10:41:41.558 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/011 2024-03-24T10:41:41.558 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:41:41.560 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:41.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:41:41.598 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-24T10:41:41.791 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:41:41.795 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:41:41.795 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:41:41.797 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:41:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:42.077 INFO:teuthology.orchestra.run.smithi072.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:41:42.081 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/012 2024-03-24T10:41:42.081 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/012 2024-03-24T10:41:42.081 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:41:42.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:42.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:41:42.129 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-24T10:41:42.355 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:41:42.358 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:41:42.358 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:41:42.359 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:41:42.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:41:57.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:41:57.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:42:28.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:42:28.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:42:49.663 INFO:teuthology.orchestra.run.smithi072.stdout:generic/013 67s 2024-03-24T10:42:49.671 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/013 2024-03-24T10:42:49.671 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:49.674 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:49.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:49.700 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-24T10:42:49.923 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:49.927 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:49.927 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:49.928 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:50.204 INFO:teuthology.orchestra.run.smithi072.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-24T10:42:50.210 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/014 2024-03-24T10:42:50.210 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/014 2024-03-24T10:42:50.210 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:50.213 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:50.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:50.232 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-24T10:42:50.457 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:50.462 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:50.462 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:50.464 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:50.464 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:50.712 INFO:teuthology.orchestra.run.smithi072.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T10:42:50.716 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/015 2024-03-24T10:42:50.716 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/015 2024-03-24T10:42:50.717 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:50.719 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:50.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:50.745 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-24T10:42:50.974 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:50.978 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:50.979 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:50.980 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:50.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:51.347 INFO:teuthology.orchestra.run.smithi072.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:42:51.353 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/016 2024-03-24T10:42:51.353 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/016 2024-03-24T10:42:51.353 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:51.356 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:51.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:51.380 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-24T10:42:51.649 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:51.654 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:51.654 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:51.655 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:51.943 INFO:teuthology.orchestra.run.smithi072.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T10:42:51.950 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/017 2024-03-24T10:42:51.950 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/017 2024-03-24T10:42:51.950 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:51.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:51.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:51.969 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-24T10:42:52.204 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:52.209 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:52.210 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:52.211 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:52.211 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:52.570 INFO:teuthology.orchestra.run.smithi072.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-24T10:42:52.577 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/018 2024-03-24T10:42:52.577 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/018 2024-03-24T10:42:52.577 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:52.579 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:52.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:52.593 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-24T10:42:52.827 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:52.831 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:52.831 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:52.833 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:52.833 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:53.083 INFO:teuthology.orchestra.run.smithi072.stdout:generic/019 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:42:53.087 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/019 2024-03-24T10:42:53.088 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/019 2024-03-24T10:42:53.088 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:53.091 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:53.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:53.144 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-24T10:42:53.367 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:53.372 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:53.373 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:53.374 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:53.374 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:58.117 INFO:teuthology.orchestra.run.smithi072.stdout:generic/020 4s 2024-03-24T10:42:58.218 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/020 2024-03-24T10:42:58.218 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:58.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:58.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-24T10:42:58.540 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:58.546 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:58.546 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:58.547 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:58.547 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:58.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:42:58.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:42:58.910 INFO:teuthology.orchestra.run.smithi072.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:42:58.915 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/021 2024-03-24T10:42:58.916 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/021 2024-03-24T10:42:58.916 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:58.919 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:58.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:58.943 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-24T10:42:59.233 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:59.238 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:59.238 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:59.239 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:59.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:59.609 INFO:teuthology.orchestra.run.smithi072.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:42:59.614 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/022 2024-03-24T10:42:59.615 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/022 2024-03-24T10:42:59.615 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:42:59.618 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:42:59.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:42:59.654 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-24T10:42:59.940 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:42:59.946 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:42:59.946 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:42:59.947 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:42:59.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:01.223 INFO:teuthology.orchestra.run.smithi072.stdout:generic/023 1s 2024-03-24T10:43:01.368 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/023 2024-03-24T10:43:01.369 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:01.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:01.441 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-24T10:43:01.719 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:01.724 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:01.724 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:01.726 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:01.726 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:02.007 INFO:teuthology.orchestra.run.smithi072.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-24T10:43:02.012 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/024 2024-03-24T10:43:02.012 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/024 2024-03-24T10:43:02.012 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:02.018 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:02.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:02.042 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-24T10:43:02.319 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:02.324 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:02.324 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:02.325 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:02.325 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:02.611 INFO:teuthology.orchestra.run.smithi072.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-24T10:43:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/025 2024-03-24T10:43:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/025 2024-03-24T10:43:02.616 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:02.619 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:02.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:02.650 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-24T10:43:02.924 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:02.929 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:02.929 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:02.930 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:02.930 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:03.209 INFO:teuthology.orchestra.run.smithi072.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-24T10:43:03.214 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/026 2024-03-24T10:43:03.215 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/026 2024-03-24T10:43:03.215 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:03.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:03.237 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-24T10:43:03.494 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:03.498 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:03.498 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:03.499 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:03.499 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:03.745 INFO:teuthology.orchestra.run.smithi072.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T10:43:03.750 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/027 2024-03-24T10:43:03.750 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/027 2024-03-24T10:43:03.750 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:03.752 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:03.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:03.765 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-24T10:43:04.034 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:04.038 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:04.039 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:04.040 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:04.040 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:09.337 INFO:teuthology.orchestra.run.smithi072.stdout:generic/028 5s 2024-03-24T10:43:09.393 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/028 2024-03-24T10:43:09.394 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:09.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:09.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:09.415 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-24T10:43:09.651 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:09.656 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:09.657 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:09.657 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:09.658 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:16.831 INFO:teuthology.orchestra.run.smithi072.stdout:generic/029 7s 2024-03-24T10:43:16.983 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/029 2024-03-24T10:43:16.983 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:16.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:16.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-24T10:43:17.210 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:17.214 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:17.215 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:17.216 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:17.216 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:19.808 INFO:teuthology.orchestra.run.smithi072.stdout:generic/030 2s 2024-03-24T10:43:19.815 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/030 2024-03-24T10:43:19.816 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:19.818 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:19.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:19.828 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-24T10:43:20.051 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:20.055 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:20.056 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:20.057 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:20.057 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:20.385 INFO:teuthology.orchestra.run.smithi072.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-24T10:43:20.390 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/031 2024-03-24T10:43:20.390 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/031 2024-03-24T10:43:20.390 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:20.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:20.411 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-24T10:43:20.626 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:20.631 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:20.632 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:20.633 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:20.893 INFO:teuthology.orchestra.run.smithi072.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:43:20.897 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/032 2024-03-24T10:43:20.897 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/032 2024-03-24T10:43:20.897 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:20.900 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:20.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:20.918 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-24T10:43:21.149 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:21.154 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:21.154 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:21.155 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:21.485 INFO:teuthology.orchestra.run.smithi072.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-24T10:43:21.490 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/033 2024-03-24T10:43:21.490 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/033 2024-03-24T10:43:21.490 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:21.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:21.511 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-24T10:43:21.738 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:21.743 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:21.743 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:21.745 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:22.014 INFO:teuthology.orchestra.run.smithi072.stdout:generic/034 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:22.018 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/034 2024-03-24T10:43:22.019 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/034 2024-03-24T10:43:22.019 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:22.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:22.035 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-24T10:43:22.276 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:22.281 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:22.281 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:22.282 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:22.283 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:22.608 INFO:teuthology.orchestra.run.smithi072.stdout:generic/035 0s 2024-03-24T10:43:22.615 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/035 2024-03-24T10:43:22.615 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:22.618 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:22.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:22.665 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-24T10:43:22.949 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:22.954 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:22.955 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:22.956 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:22.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:29.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:43:29.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:43:33.307 INFO:teuthology.orchestra.run.smithi072.stdout:generic/036 10s 2024-03-24T10:43:33.314 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/036 2024-03-24T10:43:33.314 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:33.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:33.347 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-24T10:43:33.635 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:33.640 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:33.641 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:33.642 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:38.076 INFO:teuthology.orchestra.run.smithi072.stdout:generic/037 5s 2024-03-24T10:43:38.083 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/037 2024-03-24T10:43:38.083 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:38.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:38.096 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-24T10:43:38.322 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:38.327 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:38.327 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:38.328 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:38.328 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:38.593 INFO:teuthology.orchestra.run.smithi072.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:43:38.598 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/038 2024-03-24T10:43:38.598 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/038 2024-03-24T10:43:38.599 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:38.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:38.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:38.621 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-24T10:43:38.840 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:38.845 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:38.845 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:38.847 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:39.129 INFO:teuthology.orchestra.run.smithi072.stdout:generic/039 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:39.134 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/039 2024-03-24T10:43:39.134 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/039 2024-03-24T10:43:39.134 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:39.137 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:39.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:39.157 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-24T10:43:39.380 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:39.385 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:39.385 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:39.386 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:39.661 INFO:teuthology.orchestra.run.smithi072.stdout:generic/040 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:39.666 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/040 2024-03-24T10:43:39.666 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/040 2024-03-24T10:43:39.667 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:39.669 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:39.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:39.693 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-24T10:43:39.930 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:39.934 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:39.934 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:39.935 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:39.935 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:40.210 INFO:teuthology.orchestra.run.smithi072.stdout:generic/041 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:40.215 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/041 2024-03-24T10:43:40.215 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/041 2024-03-24T10:43:40.215 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:40.218 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:40.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:40.238 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-24T10:43:40.463 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:40.467 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:40.467 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:40.468 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:40.468 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:40.813 INFO:teuthology.orchestra.run.smithi072.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-24T10:43:40.824 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/042 2024-03-24T10:43:40.824 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/042 2024-03-24T10:43:40.824 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:40.826 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:40.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:40.841 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-24T10:43:41.067 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:41.071 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:41.072 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:41.073 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:41.073 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:41.410 INFO:teuthology.orchestra.run.smithi072.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-24T10:43:41.418 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/043 2024-03-24T10:43:41.419 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/043 2024-03-24T10:43:41.419 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:41.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:41.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:41.436 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-24T10:43:41.694 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:41.699 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:41.699 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:41.700 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:41.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:42.036 INFO:teuthology.orchestra.run.smithi072.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-24T10:43:42.045 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/044 2024-03-24T10:43:42.046 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/044 2024-03-24T10:43:42.046 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:42.049 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:42.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:42.062 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-24T10:43:42.283 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:42.287 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:42.287 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:42.289 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:42.289 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:42.633 INFO:teuthology.orchestra.run.smithi072.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-24T10:43:42.640 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/045 2024-03-24T10:43:42.641 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/045 2024-03-24T10:43:42.641 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:42.643 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:42.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:42.657 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-24T10:43:42.875 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:42.882 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:42.883 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:42.884 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:42.884 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:43.238 INFO:teuthology.orchestra.run.smithi072.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-24T10:43:43.246 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/046 2024-03-24T10:43:43.246 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/046 2024-03-24T10:43:43.246 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:43.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:43.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:43.269 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-24T10:43:43.496 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:43.502 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:43.502 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:43.503 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:43.836 INFO:teuthology.orchestra.run.smithi072.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-24T10:43:43.844 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/047 2024-03-24T10:43:43.844 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/047 2024-03-24T10:43:43.844 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:43.847 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:43.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:43.861 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-24T10:43:44.087 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:44.092 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:44.092 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:44.093 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:44.093 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:44.441 INFO:teuthology.orchestra.run.smithi072.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-24T10:43:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/048 2024-03-24T10:43:44.448 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/048 2024-03-24T10:43:44.449 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:44.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:44.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:44.465 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-24T10:43:44.699 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:44.704 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:44.705 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:44.706 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:44.707 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:45.048 INFO:teuthology.orchestra.run.smithi072.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-24T10:43:45.065 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/049 2024-03-24T10:43:45.065 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/049 2024-03-24T10:43:45.065 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:45.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:45.082 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-24T10:43:45.308 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:45.313 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:45.313 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:45.314 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:45.315 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:45.656 INFO:teuthology.orchestra.run.smithi072.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-24T10:43:45.674 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/050 2024-03-24T10:43:45.674 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/050 2024-03-24T10:43:45.674 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:45.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:45.694 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-24T10:43:46.119 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:46.125 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:46.125 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:46.126 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:46.127 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:46.469 INFO:teuthology.orchestra.run.smithi072.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-24T10:43:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/051 2024-03-24T10:43:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/051 2024-03-24T10:43:46.474 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:46.477 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:46.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:46.492 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-24T10:43:46.723 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:46.727 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:46.728 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:46.729 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:46.729 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:47.064 INFO:teuthology.orchestra.run.smithi072.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-24T10:43:47.072 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/052 2024-03-24T10:43:47.072 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/052 2024-03-24T10:43:47.072 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:47.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:47.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:47.091 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-24T10:43:47.324 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:47.331 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:47.332 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:47.333 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:47.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:49.198 INFO:teuthology.orchestra.run.smithi072.stdout:generic/053 0s 2024-03-24T10:43:49.589 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/053 2024-03-24T10:43:49.589 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:49.592 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:49.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:49.602 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-24T10:43:49.847 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:49.853 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:49.853 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:49.855 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:49.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:50.227 INFO:teuthology.orchestra.run.smithi072.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-24T10:43:50.235 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/054 2024-03-24T10:43:50.235 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/054 2024-03-24T10:43:50.236 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:50.238 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:50.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:50.252 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-24T10:43:50.483 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:50.488 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:50.489 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:50.490 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:50.490 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:50.836 INFO:teuthology.orchestra.run.smithi072.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-24T10:43:50.854 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/055 2024-03-24T10:43:50.854 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/055 2024-03-24T10:43:50.854 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:50.856 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:50.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:50.869 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-24T10:43:51.229 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:51.233 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:51.234 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:51.235 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:51.235 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:51.532 INFO:teuthology.orchestra.run.smithi072.stdout:generic/056 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:51.537 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/056 2024-03-24T10:43:51.537 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/056 2024-03-24T10:43:51.537 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:51.541 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:51.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:51.569 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-24T10:43:51.911 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:51.915 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:51.915 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:51.917 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:51.917 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:52.190 INFO:teuthology.orchestra.run.smithi072.stdout:generic/057 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:52.195 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/057 2024-03-24T10:43:52.195 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/057 2024-03-24T10:43:52.195 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:52.199 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:52.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:52.217 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-24T10:43:52.446 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:52.451 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:52.452 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:52.453 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:52.453 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:52.817 INFO:teuthology.orchestra.run.smithi072.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:43:52.821 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/058 2024-03-24T10:43:52.821 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/058 2024-03-24T10:43:52.822 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:52.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:52.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:52.854 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-24T10:43:53.143 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:53.147 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:53.148 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:53.149 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:53.420 INFO:teuthology.orchestra.run.smithi072.stdout:generic/059 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:53.425 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/059 2024-03-24T10:43:53.425 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/059 2024-03-24T10:43:53.425 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:53.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:53.441 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-24T10:43:53.670 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:53.675 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:53.675 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:53.676 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:53.676 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:54.032 INFO:teuthology.orchestra.run.smithi072.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:43:54.037 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/060 2024-03-24T10:43:54.037 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/060 2024-03-24T10:43:54.037 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:54.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:54.071 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-24T10:43:54.362 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:54.367 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:54.367 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:54.369 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:54.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:54.747 INFO:teuthology.orchestra.run.smithi072.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:43:54.751 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/061 2024-03-24T10:43:54.751 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/061 2024-03-24T10:43:54.752 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:54.754 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:54.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:54.789 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-24T10:43:55.067 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:55.071 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:55.072 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:55.073 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:55.073 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:56.949 INFO:teuthology.orchestra.run.smithi072.stdout:generic/062 1s 2024-03-24T10:43:57.079 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/062 2024-03-24T10:43:57.079 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:57.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:57.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:57.094 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-24T10:43:57.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:57.374 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:57.375 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:57.376 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:57.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:57.849 INFO:teuthology.orchestra.run.smithi072.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:43:57.853 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/063 2024-03-24T10:43:57.853 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/063 2024-03-24T10:43:57.853 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:57.856 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:57.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:57.884 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-24T10:43:58.177 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:58.181 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:58.182 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:58.183 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:58.464 INFO:teuthology.orchestra.run.smithi072.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T10:43:58.469 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/064 2024-03-24T10:43:58.469 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/064 2024-03-24T10:43:58.470 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:58.472 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:58.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:58.492 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-24T10:43:58.711 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:58.715 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:58.715 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:58.717 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:58.995 INFO:teuthology.orchestra.run.smithi072.stdout:generic/065 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:58.999 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/065 2024-03-24T10:43:58.999 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/065 2024-03-24T10:43:58.999 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:59.002 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:59.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:59.021 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-24T10:43:59.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:43:59.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:43:59.255 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:59.261 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:59.261 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:59.263 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:59.263 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:59.562 INFO:teuthology.orchestra.run.smithi072.stdout:generic/066 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:43:59.566 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/066 2024-03-24T10:43:59.566 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/066 2024-03-24T10:43:59.567 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:43:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:43:59.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:43:59.586 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-24T10:43:59.865 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:43:59.871 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:43:59.871 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:43:59.872 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:43:59.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:00.164 INFO:teuthology.orchestra.run.smithi072.stdout:generic/067 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:44:00.168 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/067 2024-03-24T10:44:00.169 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/067 2024-03-24T10:44:00.169 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:00.172 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:00.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:00.200 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-24T10:44:00.509 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:00.516 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:00.516 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:00.517 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:00.518 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:01.148 INFO:teuthology.orchestra.run.smithi072.stdout:generic/068 [not run] ceph does not support freezing 2024-03-24T10:44:01.153 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/068 2024-03-24T10:44:01.153 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/068 2024-03-24T10:44:01.153 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:01.155 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:01.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:01.170 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-24T10:44:01.391 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:01.395 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:01.395 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:01.396 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:08.137 INFO:teuthology.orchestra.run.smithi072.stdout:generic/069 7s 2024-03-24T10:44:08.147 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/069 2024-03-24T10:44:08.147 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:08.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:08.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:08.168 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-24T10:44:08.418 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:08.424 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:08.424 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:08.425 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:08.426 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:29.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:44:29.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:44:29.622 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T10:44:29.621+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45435) UID: 0 2024-03-24T10:44:29.622 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T10:44:29.621+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45435) UID: 0 2024-03-24T10:44:51.377 INFO:teuthology.orchestra.run.smithi072.stdout:generic/070 43s 2024-03-24T10:44:51.383 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/070 2024-03-24T10:44:51.383 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:51.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:51.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:51.519 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-24T10:44:51.772 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:51.776 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:51.776 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:51.777 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:51.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:52.048 INFO:teuthology.orchestra.run.smithi072.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T10:44:52.053 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/071 2024-03-24T10:44:52.053 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/071 2024-03-24T10:44:52.053 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:52.055 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:52.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:52.073 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-24T10:44:52.297 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:52.301 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:52.301 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:52.302 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:52.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:52.635 INFO:teuthology.orchestra.run.smithi072.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-24T10:44:52.640 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/072 2024-03-24T10:44:52.640 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/072 2024-03-24T10:44:52.640 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:52.643 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:52.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:52.662 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-24T10:44:52.899 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:52.904 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:52.905 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:52.906 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:53.167 INFO:teuthology.orchestra.run.smithi072.stdout:generic/073 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:44:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/073 2024-03-24T10:44:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/073 2024-03-24T10:44:53.172 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:44:53.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:44:53.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:44:53.187 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-24T10:44:53.410 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:44:53.414 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:44:53.415 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:44:53.416 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:44:53.416 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:07.950 INFO:teuthology.orchestra.run.smithi072.stdout:generic/074 14s 2024-03-24T10:45:07.957 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/074 2024-03-24T10:45:07.957 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:07.960 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:09.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:09.106 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-24T10:45:09.452 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:09.456 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:09.456 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:09.458 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:09.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:33.537 INFO:teuthology.orchestra.run.smithi072.stdout:generic/075 24s 2024-03-24T10:45:33.543 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/075 2024-03-24T10:45:33.543 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:33.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:33.616 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-24T10:45:33.922 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:33.926 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:33.927 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:33.928 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:33.928 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:34.192 INFO:teuthology.orchestra.run.smithi072.stdout:generic/076 [not run] require 172.21.15.72:6789:/scratch to be local device 2024-03-24T10:45:34.197 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/076 2024-03-24T10:45:34.197 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/076 2024-03-24T10:45:34.197 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:34.199 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:34.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:34.215 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-24T10:45:34.444 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:34.448 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:34.449 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:34.450 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:34.450 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:35.384 INFO:teuthology.orchestra.run.smithi072.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T10:45:35.389 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/077 2024-03-24T10:45:35.389 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/077 2024-03-24T10:45:35.389 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:35.392 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:35.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:35.427 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-24T10:45:35.739 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:35.743 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:35.744 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:35.745 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:35.745 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:36.061 INFO:teuthology.orchestra.run.smithi072.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-24T10:45:36.066 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/078 2024-03-24T10:45:36.066 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/078 2024-03-24T10:45:36.066 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:36.069 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:36.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:36.117 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-24T10:45:36.423 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:36.428 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:36.428 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:36.430 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:36.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:36.704 INFO:teuthology.orchestra.run.smithi072.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-24T10:45:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/079 2024-03-24T10:45:36.710 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/079 2024-03-24T10:45:36.711 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:36.713 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:36.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:36.734 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-24T10:45:36.964 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:36.969 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:36.969 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:36.970 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:39.288 INFO:teuthology.orchestra.run.smithi072.stdout:generic/080 2s 2024-03-24T10:45:39.295 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/080 2024-03-24T10:45:39.295 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:39.298 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:39.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:39.319 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-24T10:45:39.544 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:39.549 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:39.549 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:39.550 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:39.550 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:39.878 INFO:teuthology.orchestra.run.smithi072.stdout:generic/081 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:45:39.883 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/081 2024-03-24T10:45:39.884 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/081 2024-03-24T10:45:39.884 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:39.886 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:39.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:39.903 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-24T10:45:40.147 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:40.152 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:40.153 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:40.154 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:40.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:40.417 INFO:teuthology.orchestra.run.smithi072.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T10:45:40.422 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/082 2024-03-24T10:45:40.422 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/082 2024-03-24T10:45:40.422 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:40.425 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:40.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:40.443 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-24T10:45:40.687 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:40.693 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:40.694 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:40.695 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:40.695 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:40.968 INFO:teuthology.orchestra.run.smithi072.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T10:45:40.973 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/083 2024-03-24T10:45:40.973 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/083 2024-03-24T10:45:40.973 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:40.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:40.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:40.992 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-24T10:45:41.252 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:41.260 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:41.260 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:41.261 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:41.262 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:46.781 INFO:teuthology.orchestra.run.smithi072.stdout:generic/084 5s 2024-03-24T10:45:46.837 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/084 2024-03-24T10:45:46.837 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:46.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:46.855 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-24T10:45:47.083 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:47.087 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:47.088 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:47.089 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:47.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:47.379 INFO:teuthology.orchestra.run.smithi072.stdout:generic/085 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/085 2024-03-24T10:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/085 2024-03-24T10:45:47.384 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:47.386 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:47.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:47.401 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-24T10:45:47.623 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:47.628 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:47.628 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:47.629 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:47.629 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:47.884 INFO:teuthology.orchestra.run.smithi072.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:45:47.889 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/086 2024-03-24T10:45:47.889 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/086 2024-03-24T10:45:47.889 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:47.891 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:47.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:47.910 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-24T10:45:48.142 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:48.147 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:48.147 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:48.148 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:48.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:48.590 INFO:teuthology.orchestra.run.smithi072.stdout:generic/087 0s 2024-03-24T10:45:48.680 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/087 2024-03-24T10:45:48.680 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:48.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:48.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:48.771 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-24T10:45:49.142 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:49.146 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:49.147 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:49.148 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:49.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:49.481 INFO:teuthology.orchestra.run.smithi072.stdout:generic/088 0s 2024-03-24T10:45:49.644 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/088 2024-03-24T10:45:49.644 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:45:49.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:45:49.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:45:49.693 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-24T10:45:50.169 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:45:50.173 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:45:50.174 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:45:50.175 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:45:50.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:47:36.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:47:36.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:48:10.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:48:10.053 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:48:40.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:48:40.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:49:10.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:49:10.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:49:40.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:49:40.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:50:11.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:50:11.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:50:11.299 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T10:50:11.299+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46713) UID: 0 2024-03-24T10:50:11.299 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T10:50:11.299+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46713) UID: 0 2024-03-24T10:53:25.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:53:25.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:53:55.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:53:55.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:53:55.608 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T10:53:55.608+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46758) UID: 0 2024-03-24T10:53:55.608 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T10:53:55.608+0000 7f4da498b640 -1 Fail to open '/proc/46758/cmdline' error = (2) No such file or directory 2024-03-24T10:53:55.609 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T10:53:55.608+0000 7f4da498b640 -1 received signal: Hangup from (PID: 46758) UID: 0 2024-03-24T10:54:57.218 INFO:teuthology.orchestra.run.smithi072.stdout:generic/089 547s 2024-03-24T10:54:57.223 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/089 2024-03-24T10:54:57.223 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:54:57.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:54:57.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:54:57.858 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-24T10:54:58.329 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:54:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:54:58.337 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:54:58.338 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:54:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:54:58.745 INFO:teuthology.orchestra.run.smithi072.stdout:generic/090 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:54:58.750 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/090 2024-03-24T10:54:58.750 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/090 2024-03-24T10:54:58.750 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:54:58.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:54:58.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:54:58.765 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-24T10:54:58.940 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:54:58.944 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:54:58.944 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:54:58.945 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:54:58.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:40.149 INFO:teuthology.orchestra.run.smithi072.stdout:generic/091 101s 2024-03-24T10:56:40.154 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/091 2024-03-24T10:56:40.154 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:40.156 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:40.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:40.211 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-24T10:56:40.556 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:40.560 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:40.561 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:40.562 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:40.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:40.767 INFO:teuthology.orchestra.run.smithi072.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:56:40.771 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/092 2024-03-24T10:56:40.771 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/092 2024-03-24T10:56:40.771 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:40.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:40.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:40.786 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-24T10:56:40.968 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:40.972 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:40.972 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:40.973 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:40.973 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:41.451 INFO:teuthology.orchestra.run.smithi072.stdout:generic/093 0s 2024-03-24T10:56:41.456 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/093 2024-03-24T10:56:41.456 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:41.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:41.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-24T10:56:41.938 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:41.942 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:41.942 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:41.943 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:42.184 INFO:teuthology.orchestra.run.smithi072.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T10:56:42.188 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/094 2024-03-24T10:56:42.188 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/094 2024-03-24T10:56:42.188 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:42.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:42.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:42.236 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-24T10:56:42.646 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:42.650 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:42.650 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:42.651 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:42.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:53.601 INFO:teuthology.orchestra.run.smithi072.stdout:generic/095 11s 2024-03-24T10:56:53.609 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/095 2024-03-24T10:56:53.609 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:53.611 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:53.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:53.628 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-24T10:56:53.829 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:53.833 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:53.833 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:53.834 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:53.834 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:54.107 INFO:teuthology.orchestra.run.smithi072.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-24T10:56:54.111 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/096 2024-03-24T10:56:54.111 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/096 2024-03-24T10:56:54.111 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:54.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:54.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:54.128 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-24T10:56:54.300 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:54.303 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:54.304 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:54.305 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:54.305 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:54.986 INFO:teuthology.orchestra.run.smithi072.stdout:generic/097 0s 2024-03-24T10:56:55.345 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/097 2024-03-24T10:56:55.345 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:56:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:55.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:56:55.362 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-24T10:56:55.554 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:56:55.558 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:56:55.558 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:56:55.559 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:56:55.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:56:56.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:56:56.534 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:57:00.559 INFO:teuthology.orchestra.run.smithi072.stdout:generic/098 5s 2024-03-24T10:57:00.564 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/098 2024-03-24T10:57:00.565 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:00.567 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:00.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:00.575 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-24T10:57:00.751 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:00.755 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:00.755 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:00.756 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:00.756 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:01.462 INFO:teuthology.orchestra.run.smithi072.stdout:generic/099 1s 2024-03-24T10:57:01.468 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/099 2024-03-24T10:57:01.469 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:01.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:01.529 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-24T10:57:01.876 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:01.880 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:01.881 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:01.882 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:01.882 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:12.811 INFO:teuthology.orchestra.run.smithi072.stdout:generic/100 11s 2024-03-24T10:57:12.816 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/100 2024-03-24T10:57:12.816 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:12.818 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:16.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:16.428 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-24T10:57:16.750 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:16.754 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:16.754 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:16.755 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:16.970 INFO:teuthology.orchestra.run.smithi072.stdout:generic/101 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:57:16.974 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/101 2024-03-24T10:57:16.974 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/101 2024-03-24T10:57:16.974 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:16.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:16.988 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-24T10:57:17.161 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:17.165 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:17.165 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:17.166 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:17.166 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:17.363 INFO:teuthology.orchestra.run.smithi072.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T10:57:17.367 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/102 2024-03-24T10:57:17.367 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/102 2024-03-24T10:57:17.367 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:17.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:17.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:17.380 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-24T10:57:17.779 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:17.783 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:17.783 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:17.785 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:17.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:18.006 INFO:teuthology.orchestra.run.smithi072.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T10:57:18.010 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/103 2024-03-24T10:57:18.011 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/103 2024-03-24T10:57:18.011 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:18.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:18.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:18.072 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-24T10:57:18.433 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:18.437 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:18.438 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:18.439 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:18.439 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:18.678 INFO:teuthology.orchestra.run.smithi072.stdout:generic/104 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:57:18.682 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/104 2024-03-24T10:57:18.682 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/104 2024-03-24T10:57:18.682 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:18.684 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:18.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:18.701 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-24T10:57:18.886 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:18.890 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:18.890 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:18.891 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:18.891 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:19.308 INFO:teuthology.orchestra.run.smithi072.stdout:generic/105 1s 2024-03-24T10:57:19.322 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/105 2024-03-24T10:57:19.322 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:19.326 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:19.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:19.338 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-24T10:57:19.668 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:19.672 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:19.672 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:19.673 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:19.673 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:19.897 INFO:teuthology.orchestra.run.smithi072.stdout:generic/106 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:57:19.900 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/106 2024-03-24T10:57:19.901 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/106 2024-03-24T10:57:19.901 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:19.903 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:19.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:19.919 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-24T10:57:20.101 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:20.105 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:20.105 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:20.106 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:20.106 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:20.327 INFO:teuthology.orchestra.run.smithi072.stdout:generic/107 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:57:20.330 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/107 2024-03-24T10:57:20.330 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/107 2024-03-24T10:57:20.331 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:20.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:20.350 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-24T10:57:20.525 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:20.529 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:20.530 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:20.531 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:20.831 INFO:teuthology.orchestra.run.smithi072.stdout:generic/108 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T10:57:20.835 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/108 2024-03-24T10:57:20.835 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/108 2024-03-24T10:57:20.835 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:20.837 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:20.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:20.850 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-24T10:57:21.020 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:21.024 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:21.024 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:21.025 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:27.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:57:27.633 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:57:32.057 INFO:teuthology.orchestra.run.smithi072.stdout:generic/109 11s 2024-03-24T10:57:32.198 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/109 2024-03-24T10:57:32.199 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:32.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:32.212 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-24T10:57:32.858 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:32.862 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:32.863 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:32.864 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:32.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:52.095 INFO:teuthology.orchestra.run.smithi072.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T10:57:52.099 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/110 2024-03-24T10:57:52.099 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/110 2024-03-24T10:57:52.099 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:52.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:52.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:52.177 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-24T10:57:52.656 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:52.659 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:52.660 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:52.661 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:52.661 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:53.074 INFO:teuthology.orchestra.run.smithi072.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T10:57:53.079 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/111 2024-03-24T10:57:53.080 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/111 2024-03-24T10:57:53.080 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:57:53.083 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:53.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:57:53.172 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-24T10:57:53.532 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:57:53.536 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:57:53.537 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:57:53.538 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:57:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:57:57.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:57:57.714 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:58:08.815 INFO:teuthology.orchestra.run.smithi072.stdout:generic/112 15s 2024-03-24T10:58:08.997 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/112 2024-03-24T10:58:08.997 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:09.000 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:09.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:09.061 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-24T10:58:09.402 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:09.406 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:09.406 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:09.407 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:09.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:25.460 INFO:teuthology.orchestra.run.smithi072.stdout:generic/113 16s 2024-03-24T10:58:25.466 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/113 2024-03-24T10:58:25.466 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:25.468 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:25.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:25.518 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-24T10:58:25.946 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:25.950 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:25.951 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:25.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:26.173 INFO:teuthology.orchestra.run.smithi072.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-24T10:58:26.177 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/114 2024-03-24T10:58:26.177 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/114 2024-03-24T10:58:26.177 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:26.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:26.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:26.198 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-24T10:58:26.415 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:26.428 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:26.430 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:26.435 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:26.733 INFO:teuthology.orchestra.run.smithi072.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T10:58:26.737 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/115 2024-03-24T10:58:26.737 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/115 2024-03-24T10:58:26.737 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:26.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:26.805 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-24T10:58:27.216 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:27.219 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:27.220 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:27.221 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:27.221 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:27.453 INFO:teuthology.orchestra.run.smithi072.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T10:58:27.457 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/116 2024-03-24T10:58:27.457 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/116 2024-03-24T10:58:27.457 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:27.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:27.512 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-24T10:58:27.947 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:27.951 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:27.952 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:27.952 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:27.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:28.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:58:28.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:58:49.045 INFO:teuthology.orchestra.run.smithi072.stdout:generic/117 21s 2024-03-24T10:58:49.050 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/117 2024-03-24T10:58:49.050 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:49.053 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:49.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:49.062 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-24T10:58:49.241 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:49.245 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:49.245 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:49.246 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:49.246 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:49.905 INFO:teuthology.orchestra.run.smithi072.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T10:58:49.909 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/118 2024-03-24T10:58:49.910 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/118 2024-03-24T10:58:49.910 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:49.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:49.968 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-24T10:58:50.389 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:50.394 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:50.395 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:50.396 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:50.396 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:50.690 INFO:teuthology.orchestra.run.smithi072.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T10:58:50.694 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/119 2024-03-24T10:58:50.694 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/119 2024-03-24T10:58:50.695 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:50.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:50.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:50.743 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-24T10:58:51.190 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:51.194 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:51.194 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:51.195 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:51.195 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:51.405 INFO:teuthology.orchestra.run.smithi072.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-24T10:58:51.409 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/120 2024-03-24T10:58:51.409 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/120 2024-03-24T10:58:51.409 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:51.411 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:51.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:51.427 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-24T10:58:51.605 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:51.609 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:51.609 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:51.610 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:51.610 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:51.842 INFO:teuthology.orchestra.run.smithi072.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T10:58:51.846 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/121 2024-03-24T10:58:51.846 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/121 2024-03-24T10:58:51.846 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:51.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:51.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:51.903 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-24T10:58:52.352 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:52.356 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:52.357 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:52.357 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:52.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:52.591 INFO:teuthology.orchestra.run.smithi072.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T10:58:52.595 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/122 2024-03-24T10:58:52.595 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/122 2024-03-24T10:58:52.595 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:52.597 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:52.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:52.660 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-24T10:58:53.054 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:53.058 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:53.058 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:53.059 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:53.059 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:53.550 INFO:teuthology.orchestra.run.smithi072.stdout:generic/123 0s 2024-03-24T10:58:53.555 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/123 2024-03-24T10:58:53.555 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:53.557 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:53.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:53.599 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-24T10:58:54.043 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:54.047 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:54.047 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:54.048 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:55.928 INFO:teuthology.orchestra.run.smithi072.stdout:generic/124 1s 2024-03-24T10:58:55.937 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/124 2024-03-24T10:58:55.937 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:58:55.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:56.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:58:56.543 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-24T10:58:56.924 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:58:56.928 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:58:56.928 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:58:56.929 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:58:56.929 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:58:58.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:58:58.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:59:28.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:59:28.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:59:58.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:59:58.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T10:59:58.304 INFO:teuthology.orchestra.run.smithi072.stdout:generic/125 61s 2024-03-24T10:59:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/125 2024-03-24T10:59:58.311 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:59:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:59:58.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:59:58.360 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-24T10:59:58.757 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:59:58.760 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:59:58.760 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:59:58.762 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:59:58.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:59:59.136 INFO:teuthology.orchestra.run.smithi072.stdout:generic/126 1s 2024-03-24T10:59:59.142 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/126 2024-03-24T10:59:59.142 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T10:59:59.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T10:59:59.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T10:59:59.233 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-24T10:59:59.595 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T10:59:59.598 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T10:59:59.599 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T10:59:59.600 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T10:59:59.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:00:28.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:00:28.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:00:58.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:00:58.533 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:01:28.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:01:28.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:01:58.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:01:58.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:02:29.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:02:29.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:02:59.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:02:59.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:03:29.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:03:29.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:03:59.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:03:59.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:04:29.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:04:29.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:04:59.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:04:59.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:05:30.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:05:30.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:06:00.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:06:00.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:06:30.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:06:30.393 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:07:00.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:07:00.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:07:30.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:07:30.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:08:00.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:08:00.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:08:30.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:08:30.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:09:00.850 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:09:00.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:09:17.765 INFO:teuthology.orchestra.run.smithi072.stdout:generic/127 558s 2024-03-24T11:09:17.770 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/127 2024-03-24T11:09:17.770 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:09:17.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:17.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:09:17.823 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-24T11:09:18.173 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:09:18.177 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:09:18.177 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:09:18.178 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:09:18.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:19.067 INFO:teuthology.orchestra.run.smithi072.stdout:generic/128 1s 2024-03-24T11:09:19.074 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/128 2024-03-24T11:09:19.074 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:09:19.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:19.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:09:19.087 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-24T11:09:19.268 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:09:19.272 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:09:19.272 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:09:19.273 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:09:19.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:19.495 INFO:teuthology.orchestra.run.smithi072.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-24T11:09:19.498 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/129 2024-03-24T11:09:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/129 2024-03-24T11:09:19.499 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:09:19.501 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:19.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:09:19.520 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-24T11:09:19.711 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:09:19.714 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:09:19.715 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:09:19.716 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:09:19.716 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:19.930 INFO:teuthology.orchestra.run.smithi072.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-24T11:09:19.934 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/130 2024-03-24T11:09:19.934 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/130 2024-03-24T11:09:19.934 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:09:19.936 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:19.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:09:19.956 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-24T11:09:20.143 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:09:20.146 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:09:20.147 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:09:20.148 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:09:20.148 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:21.458 INFO:teuthology.orchestra.run.smithi072.stdout:generic/131 1s 2024-03-24T11:09:21.464 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/131 2024-03-24T11:09:21.464 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:09:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:21.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:09:21.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-24T11:09:21.878 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:09:21.881 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:09:21.882 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:09:21.883 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:09:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:31.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:09:31.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:09:33.820 INFO:teuthology.orchestra.run.smithi072.stdout:generic/132 12s 2024-03-24T11:09:33.825 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/132 2024-03-24T11:09:33.825 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:09:33.827 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:09:33.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:09:33.836 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-24T11:09:34.010 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:09:34.014 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:09:34.014 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:09:34.016 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:09:34.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:10:01.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:10:01.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:10:31.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:10:31.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:11:01.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:11:01.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:11:31.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:11:31.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:12:02.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:12:02.029 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:12:32.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:12:32.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:13:02.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:13:02.230 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:13:20.883 INFO:teuthology.orchestra.run.smithi072.stdout:generic/133 226s 2024-03-24T11:13:20.920 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/133 2024-03-24T11:13:20.920 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:20.922 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:20.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:20.988 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-24T11:13:21.573 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:21.576 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:21.577 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:21.577 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:21.867 INFO:teuthology.orchestra.run.smithi072.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:21.872 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/134 2024-03-24T11:13:21.872 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/134 2024-03-24T11:13:21.872 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:21.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:21.933 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-24T11:13:22.294 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:22.299 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:22.299 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:22.300 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:22.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:23.116 INFO:teuthology.orchestra.run.smithi072.stdout:generic/135 1s 2024-03-24T11:13:23.122 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/135 2024-03-24T11:13:23.122 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:23.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:23.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:23.133 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-24T11:13:23.309 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:23.312 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:23.313 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:23.314 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:23.314 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:23.546 INFO:teuthology.orchestra.run.smithi072.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T11:13:23.550 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/136 2024-03-24T11:13:23.550 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/136 2024-03-24T11:13:23.550 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:23.552 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:23.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:23.603 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-24T11:13:23.950 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:23.954 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:23.955 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:23.956 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:23.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:24.199 INFO:teuthology.orchestra.run.smithi072.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:24.202 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/137 2024-03-24T11:13:24.203 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/137 2024-03-24T11:13:24.203 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:24.205 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:24.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:24.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-24T11:13:24.612 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:24.615 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:24.616 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:24.617 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:24.617 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:24.850 INFO:teuthology.orchestra.run.smithi072.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:24.853 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/138 2024-03-24T11:13:24.854 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/138 2024-03-24T11:13:24.854 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:24.856 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:24.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:24.891 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-24T11:13:25.255 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:25.259 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:25.260 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:25.260 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:25.495 INFO:teuthology.orchestra.run.smithi072.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:25.499 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/139 2024-03-24T11:13:25.499 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/139 2024-03-24T11:13:25.499 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:25.501 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:25.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:25.559 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-24T11:13:25.913 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:25.916 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:25.917 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:25.917 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:26.159 INFO:teuthology.orchestra.run.smithi072.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:26.162 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/140 2024-03-24T11:13:26.162 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/140 2024-03-24T11:13:26.163 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:26.165 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:26.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:26.219 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-24T11:13:26.565 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:26.569 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:26.569 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:26.570 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:27.049 INFO:teuthology.orchestra.run.smithi072.stdout:generic/141 0s 2024-03-24T11:13:27.253 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/141 2024-03-24T11:13:27.253 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:27.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:27.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:27.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-24T11:13:27.454 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:27.458 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:27.458 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:27.459 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:27.693 INFO:teuthology.orchestra.run.smithi072.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:27.697 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/142 2024-03-24T11:13:27.698 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/142 2024-03-24T11:13:27.698 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:27.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:27.756 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-24T11:13:28.094 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:28.098 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:28.098 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:28.099 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:28.099 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:28.332 INFO:teuthology.orchestra.run.smithi072.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/143 2024-03-24T11:13:28.335 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/143 2024-03-24T11:13:28.336 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:28.338 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:28.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:28.381 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-24T11:13:28.735 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:28.739 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:28.740 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:28.741 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:28.974 INFO:teuthology.orchestra.run.smithi072.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:28.978 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/144 2024-03-24T11:13:28.978 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/144 2024-03-24T11:13:28.978 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:28.980 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:29.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:29.024 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-24T11:13:29.461 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:29.465 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:29.465 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:29.466 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:29.466 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:29.697 INFO:teuthology.orchestra.run.smithi072.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:29.700 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/145 2024-03-24T11:13:29.700 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/145 2024-03-24T11:13:29.701 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:29.702 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:29.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:29.758 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-24T11:13:30.084 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:30.088 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:30.088 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:30.089 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:30.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:30.332 INFO:teuthology.orchestra.run.smithi072.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:30.336 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/146 2024-03-24T11:13:30.336 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/146 2024-03-24T11:13:30.336 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:30.338 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:30.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:30.371 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-24T11:13:30.726 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:30.730 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:30.730 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:30.731 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:30.731 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:30.980 INFO:teuthology.orchestra.run.smithi072.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:30.983 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/147 2024-03-24T11:13:30.984 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/147 2024-03-24T11:13:30.984 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:30.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:31.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:31.039 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-24T11:13:31.365 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:31.369 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:31.369 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:31.370 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:31.370 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:31.609 INFO:teuthology.orchestra.run.smithi072.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:31.613 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/148 2024-03-24T11:13:31.613 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/148 2024-03-24T11:13:31.613 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:31.615 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:31.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:31.674 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-24T11:13:32.012 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:32.016 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:32.016 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:32.017 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:32.265 INFO:teuthology.orchestra.run.smithi072.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:32.269 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/149 2024-03-24T11:13:32.269 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/149 2024-03-24T11:13:32.269 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:32.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:32.326 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-24T11:13:32.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:13:32.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:13:32.676 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:32.680 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:32.680 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:32.682 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:32.915 INFO:teuthology.orchestra.run.smithi072.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:32.919 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/150 2024-03-24T11:13:32.919 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/150 2024-03-24T11:13:32.919 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:32.921 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:32.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:32.986 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-24T11:13:33.318 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:33.322 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:33.323 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:33.324 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:33.555 INFO:teuthology.orchestra.run.smithi072.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:33.559 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/151 2024-03-24T11:13:33.559 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/151 2024-03-24T11:13:33.559 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:33.561 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:33.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:33.636 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-24T11:13:33.972 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:33.975 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:33.976 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:33.977 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:33.977 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:34.218 INFO:teuthology.orchestra.run.smithi072.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:34.222 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/152 2024-03-24T11:13:34.222 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/152 2024-03-24T11:13:34.222 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:34.224 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:34.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:34.287 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-24T11:13:34.626 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:34.630 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:34.631 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:34.631 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:34.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:34.868 INFO:teuthology.orchestra.run.smithi072.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:34.872 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/153 2024-03-24T11:13:34.872 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/153 2024-03-24T11:13:34.872 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:34.874 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:34.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:34.932 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-24T11:13:35.277 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:35.281 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:35.282 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:35.283 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:35.283 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:35.533 INFO:teuthology.orchestra.run.smithi072.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:35.537 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/154 2024-03-24T11:13:35.537 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/154 2024-03-24T11:13:35.537 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:35.539 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:35.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:35.602 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-24T11:13:35.947 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:35.951 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:35.952 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:35.952 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:36.186 INFO:teuthology.orchestra.run.smithi072.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:36.189 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/155 2024-03-24T11:13:36.190 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/155 2024-03-24T11:13:36.190 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:36.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:36.250 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-24T11:13:36.586 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:36.590 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:36.590 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:36.591 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:36.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:36.829 INFO:teuthology.orchestra.run.smithi072.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:36.832 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/156 2024-03-24T11:13:36.833 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/156 2024-03-24T11:13:36.833 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:36.835 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:36.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:36.885 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-24T11:13:37.224 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:37.228 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:37.229 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:37.229 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:37.469 INFO:teuthology.orchestra.run.smithi072.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:37.473 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/157 2024-03-24T11:13:37.473 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/157 2024-03-24T11:13:37.473 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:37.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:37.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:37.545 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-24T11:13:37.877 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:37.881 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:37.881 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:37.882 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:38.127 INFO:teuthology.orchestra.run.smithi072.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T11:13:38.131 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/158 2024-03-24T11:13:38.131 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/158 2024-03-24T11:13:38.132 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:38.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:38.189 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-24T11:13:38.528 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:38.532 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:38.533 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:38.534 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:38.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:38.757 INFO:teuthology.orchestra.run.smithi072.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-24T11:13:38.761 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/159 2024-03-24T11:13:38.761 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/159 2024-03-24T11:13:38.761 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:38.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:38.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:38.780 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-24T11:13:38.979 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:38.982 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:38.983 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:38.984 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:38.984 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:39.207 INFO:teuthology.orchestra.run.smithi072.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-24T11:13:39.211 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/160 2024-03-24T11:13:39.211 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/160 2024-03-24T11:13:39.211 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:39.213 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:39.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:39.230 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-24T11:13:39.415 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:39.419 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:39.420 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:39.420 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:39.764 INFO:teuthology.orchestra.run.smithi072.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:39.770 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/161 2024-03-24T11:13:39.770 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/161 2024-03-24T11:13:39.770 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:39.777 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:40.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:40.044 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-24T11:13:40.228 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:40.231 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:40.232 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:40.232 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:40.232 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:40.526 INFO:teuthology.orchestra.run.smithi072.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-24T11:13:40.575 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/162 2024-03-24T11:13:40.575 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/162 2024-03-24T11:13:40.576 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:40.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:40.918 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-24T11:13:41.100 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:41.104 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:41.105 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:41.106 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:41.106 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:41.407 INFO:teuthology.orchestra.run.smithi072.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-24T11:13:41.455 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/163 2024-03-24T11:13:41.455 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/163 2024-03-24T11:13:41.455 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:41.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:41.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:41.692 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-24T11:13:41.890 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:41.893 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:41.894 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:41.895 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:42.243 INFO:teuthology.orchestra.run.smithi072.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:42.248 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/164 2024-03-24T11:13:42.248 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/164 2024-03-24T11:13:42.249 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:42.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:42.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:42.467 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-24T11:13:42.666 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:42.670 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:42.670 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:42.671 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:42.671 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:43.003 INFO:teuthology.orchestra.run.smithi072.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:43.008 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/165 2024-03-24T11:13:43.009 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/165 2024-03-24T11:13:43.009 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:43.012 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:43.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:43.277 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-24T11:13:43.461 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:43.464 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:43.465 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:43.466 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:43.466 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:43.842 INFO:teuthology.orchestra.run.smithi072.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:43.847 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/166 2024-03-24T11:13:43.847 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/166 2024-03-24T11:13:43.847 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:43.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:44.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:44.028 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-24T11:13:44.232 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:44.235 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:44.235 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:44.236 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:44.237 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:44.580 INFO:teuthology.orchestra.run.smithi072.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:44.585 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/167 2024-03-24T11:13:44.585 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/167 2024-03-24T11:13:44.585 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:44.589 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:44.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:44.773 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-24T11:13:44.981 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:44.985 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:44.985 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:44.986 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:44.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:45.318 INFO:teuthology.orchestra.run.smithi072.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:45.323 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/168 2024-03-24T11:13:45.323 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/168 2024-03-24T11:13:45.324 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:45.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:45.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:45.518 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-24T11:13:45.740 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:45.743 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:45.744 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:45.745 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:45.745 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:46.168 INFO:teuthology.orchestra.run.smithi072.stdout:generic/169 1s 2024-03-24T11:13:46.173 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/169 2024-03-24T11:13:46.173 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:46.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:46.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:46.184 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-24T11:13:46.374 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:46.379 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:46.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:46.720 INFO:teuthology.orchestra.run.smithi072.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:46.727 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/170 2024-03-24T11:13:46.727 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/170 2024-03-24T11:13:46.727 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:46.729 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:46.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:46.923 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-24T11:13:47.128 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:47.132 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:47.132 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:47.133 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:47.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:47.476 INFO:teuthology.orchestra.run.smithi072.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:47.483 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/171 2024-03-24T11:13:47.483 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/171 2024-03-24T11:13:47.483 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:47.487 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:47.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:47.738 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-24T11:13:47.929 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:47.933 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:47.933 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:47.934 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:47.934 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:48.292 INFO:teuthology.orchestra.run.smithi072.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:48.299 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/172 2024-03-24T11:13:48.299 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/172 2024-03-24T11:13:48.299 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:48.302 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:48.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:48.518 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-24T11:13:48.709 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:48.713 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:48.713 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:48.714 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:48.714 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:49.068 INFO:teuthology.orchestra.run.smithi072.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:49.072 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/173 2024-03-24T11:13:49.072 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/173 2024-03-24T11:13:49.073 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:49.077 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:49.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:49.285 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-24T11:13:49.497 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:49.500 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:49.501 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:49.502 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:49.502 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:49.860 INFO:teuthology.orchestra.run.smithi072.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/174 2024-03-24T11:13:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/174 2024-03-24T11:13:49.865 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:50.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:50.048 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-24T11:13:50.259 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:50.263 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:50.263 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:50.264 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:50.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:50.618 INFO:teuthology.orchestra.run.smithi072.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:50.623 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/175 2024-03-24T11:13:50.623 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/175 2024-03-24T11:13:50.623 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:50.627 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:50.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:50.866 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-24T11:13:51.059 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:51.063 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:51.064 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:51.065 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:51.413 INFO:teuthology.orchestra.run.smithi072.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:51.420 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/176 2024-03-24T11:13:51.420 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/176 2024-03-24T11:13:51.420 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:51.422 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:51.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:51.629 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-24T11:13:51.845 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:51.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:51.849 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:51.850 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:51.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:52.220 INFO:teuthology.orchestra.run.smithi072.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T11:13:52.224 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/177 2024-03-24T11:13:52.224 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/177 2024-03-24T11:13:52.224 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:52.226 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:52.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:52.293 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-24T11:13:52.627 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:52.631 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:52.631 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:52.632 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:52.633 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:52.883 INFO:teuthology.orchestra.run.smithi072.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:52.887 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/178 2024-03-24T11:13:52.887 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/178 2024-03-24T11:13:52.887 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:52.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:53.001 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-24T11:13:53.304 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:53.308 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:53.309 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:53.309 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:53.310 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:53.550 INFO:teuthology.orchestra.run.smithi072.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:53.551 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/179 2024-03-24T11:13:53.551 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/179 2024-03-24T11:13:53.551 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:53.553 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:53.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:53.614 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-24T11:13:53.967 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:53.971 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:53.972 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:53.973 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:53.973 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:54.209 INFO:teuthology.orchestra.run.smithi072.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:54.213 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/180 2024-03-24T11:13:54.213 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/180 2024-03-24T11:13:54.213 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:54.215 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:54.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:54.288 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-24T11:13:54.619 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:54.623 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:54.624 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:54.625 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:54.625 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:54.865 INFO:teuthology.orchestra.run.smithi072.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:13:54.869 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/181 2024-03-24T11:13:54.869 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/181 2024-03-24T11:13:54.869 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:54.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:54.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:54.924 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-24T11:13:55.281 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:55.285 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:55.285 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:55.286 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:55.525 INFO:teuthology.orchestra.run.smithi072.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T11:13:55.528 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/182 2024-03-24T11:13:55.528 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/182 2024-03-24T11:13:55.529 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:55.531 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:55.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:55.584 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-24T11:13:55.946 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:55.950 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:55.950 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:55.951 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:55.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:56.281 INFO:teuthology.orchestra.run.smithi072.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:56.288 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/183 2024-03-24T11:13:56.288 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/183 2024-03-24T11:13:56.288 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:56.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:56.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:56.508 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-24T11:13:56.730 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:56.733 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:56.734 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:56.734 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:56.735 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:56.980 INFO:teuthology.orchestra.run.smithi072.stdout:generic/184 0s 2024-03-24T11:13:56.985 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/184 2024-03-24T11:13:56.985 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:56.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:57.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:57.000 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-24T11:13:57.176 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:57.179 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:57.180 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:57.181 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:57.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:57.546 INFO:teuthology.orchestra.run.smithi072.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:57.552 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/185 2024-03-24T11:13:57.552 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/185 2024-03-24T11:13:57.552 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:57.556 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:57.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:57.881 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-24T11:13:58.061 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:58.064 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:58.065 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:58.066 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:58.066 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:58.401 INFO:teuthology.orchestra.run.smithi072.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:58.408 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/186 2024-03-24T11:13:58.408 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/186 2024-03-24T11:13:58.408 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:58.410 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:58.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:58.726 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-24T11:13:58.906 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:58.910 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:58.910 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:58.912 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:58.912 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:59.241 INFO:teuthology.orchestra.run.smithi072.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:13:59.246 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/187 2024-03-24T11:13:59.246 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/187 2024-03-24T11:13:59.246 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:13:59.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:13:59.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:13:59.491 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-24T11:13:59.682 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:13:59.686 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:13:59.686 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:13:59.687 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:13:59.687 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:00.009 INFO:teuthology.orchestra.run.smithi072.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:00.015 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/188 2024-03-24T11:14:00.015 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/188 2024-03-24T11:14:00.016 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:00.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:00.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:00.251 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-24T11:14:00.458 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:00.461 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:00.462 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:00.463 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:00.463 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:00.815 INFO:teuthology.orchestra.run.smithi072.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:00.821 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/189 2024-03-24T11:14:00.822 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/189 2024-03-24T11:14:00.822 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:00.823 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:01.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:01.102 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-24T11:14:01.283 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:01.287 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:01.287 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:01.288 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:01.289 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:01.618 INFO:teuthology.orchestra.run.smithi072.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:01.625 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/190 2024-03-24T11:14:01.625 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/190 2024-03-24T11:14:01.625 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:01.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:01.839 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-24T11:14:02.047 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:02.051 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:02.051 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:02.052 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:02.052 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:02.382 INFO:teuthology.orchestra.run.smithi072.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:02.387 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/191 2024-03-24T11:14:02.387 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/191 2024-03-24T11:14:02.387 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:02.391 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:02.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:14:02.455 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:14:02.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:02.756 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-24T11:14:02.929 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:02.933 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:02.934 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:02.934 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:03.138 INFO:teuthology.orchestra.run.smithi072.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-24T11:14:03.142 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/192 2024-03-24T11:14:03.142 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/192 2024-03-24T11:14:03.142 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:03.144 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:03.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:03.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-24T11:14:03.582 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:03.586 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:03.590 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:03.590 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:08.411 INFO:teuthology.orchestra.run.smithi072.stdout:generic/193 5s 2024-03-24T11:14:08.456 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/193 2024-03-24T11:14:08.456 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:08.458 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:08.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:08.519 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-24T11:14:08.891 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:08.895 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:08.896 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:08.897 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:08.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:09.230 INFO:teuthology.orchestra.run.smithi072.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:09.237 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/194 2024-03-24T11:14:09.237 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/194 2024-03-24T11:14:09.237 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:09.239 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:09.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:09.554 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-24T11:14:09.733 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:09.736 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:09.737 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:09.738 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:10.062 INFO:teuthology.orchestra.run.smithi072.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:10.068 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/195 2024-03-24T11:14:10.068 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/195 2024-03-24T11:14:10.068 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:10.071 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:10.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:10.317 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-24T11:14:10.512 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:10.515 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:10.516 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:10.517 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:10.517 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:10.840 INFO:teuthology.orchestra.run.smithi072.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:10.847 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/196 2024-03-24T11:14:10.847 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/196 2024-03-24T11:14:10.847 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:10.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:11.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:11.200 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-24T11:14:11.379 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:11.382 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:11.383 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:11.383 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:11.383 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:11.700 INFO:teuthology.orchestra.run.smithi072.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:11.708 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/197 2024-03-24T11:14:11.708 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/197 2024-03-24T11:14:11.708 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:11.712 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:11.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:11.968 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-24T11:14:12.162 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:12.165 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:12.166 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:12.167 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:12.775 INFO:teuthology.orchestra.run.smithi072.stdout:generic/198 0s 2024-03-24T11:14:12.780 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/198 2024-03-24T11:14:12.780 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:12.783 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:12.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:12.834 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-24T11:14:13.182 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:13.186 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:13.186 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:13.187 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:13.566 INFO:teuthology.orchestra.run.smithi072.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:13.572 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/199 2024-03-24T11:14:13.573 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/199 2024-03-24T11:14:13.573 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:13.575 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:13.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:13.827 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-24T11:14:14.011 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:14.015 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:14.016 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:14.016 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:14.351 INFO:teuthology.orchestra.run.smithi072.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:14.356 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/200 2024-03-24T11:14:14.357 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/200 2024-03-24T11:14:14.357 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:14.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:14.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:14.586 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-24T11:14:14.788 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:14.792 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:14.792 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:14.793 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:14.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:15.125 INFO:teuthology.orchestra.run.smithi072.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:15.132 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/201 2024-03-24T11:14:15.132 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/201 2024-03-24T11:14:15.132 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:15.135 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:15.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:15.338 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-24T11:14:15.548 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:15.551 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:15.552 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:15.553 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:15.553 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:15.902 INFO:teuthology.orchestra.run.smithi072.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:15.909 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/202 2024-03-24T11:14:15.909 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/202 2024-03-24T11:14:15.909 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:16.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:16.229 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-24T11:14:16.399 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:16.403 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:16.403 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:16.404 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:16.727 INFO:teuthology.orchestra.run.smithi072.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:16.732 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/203 2024-03-24T11:14:16.732 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/203 2024-03-24T11:14:16.732 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:17.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:17.037 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-24T11:14:17.215 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:17.218 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:17.219 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:17.219 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:17.220 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:19.621 INFO:teuthology.orchestra.run.smithi072.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:14:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/204 2024-03-24T11:14:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/204 2024-03-24T11:14:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:19.629 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:19.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:19.643 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-24T11:14:19.836 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:19.840 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:19.840 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:19.841 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:19.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:20.182 INFO:teuthology.orchestra.run.smithi072.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:20.189 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/205 2024-03-24T11:14:20.189 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/205 2024-03-24T11:14:20.189 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:20.191 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:20.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:20.514 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-24T11:14:20.692 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:20.696 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:20.696 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:20.697 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:21.026 INFO:teuthology.orchestra.run.smithi072.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:14:21.032 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/206 2024-03-24T11:14:21.032 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/206 2024-03-24T11:14:21.032 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:21.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:21.319 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-24T11:14:21.500 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:21.504 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:21.504 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:27.819 INFO:teuthology.orchestra.run.smithi072.stdout:generic/207 6s 2024-03-24T11:14:27.825 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/207 2024-03-24T11:14:27.825 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:14:27.828 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:27.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:14:27.864 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-24T11:14:28.296 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:14:28.299 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:14:28.300 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:14:28.301 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:14:28.301 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:14:32.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:14:32.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:15:03.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:15:03.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:15:33.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:15:33.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:16:04.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:16:04.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:16:34.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:16:34.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:16:34.163 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T11:16:34.162+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49384) UID: 0 2024-03-24T11:16:34.163 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T11:16:34.162+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49384) UID: 0 2024-03-24T11:16:34.163 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T11:16:34.162+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49384) UID: 0 2024-03-24T11:16:34.164 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T11:16:34.162+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49384) UID: 0 2024-03-24T11:17:49.005 INFO:teuthology.orchestra.run.smithi072.stdout:generic/208 200s 2024-03-24T11:17:49.018 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/208 2024-03-24T11:17:49.019 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:17:49.021 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:17:49.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:17:49.053 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-24T11:17:50.141 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:17:50.145 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:17:50.145 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:17:50.146 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:17:50.146 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:27.693 INFO:teuthology.orchestra.run.smithi072.stdout:generic/209 37s 2024-03-24T11:18:27.698 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/209 2024-03-24T11:18:27.698 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:27.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:27.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:27.751 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-24T11:18:28.121 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:28.125 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:28.125 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:28.126 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:28.126 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:28.455 INFO:teuthology.orchestra.run.smithi072.stdout:generic/210 0s 2024-03-24T11:18:28.461 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/210 2024-03-24T11:18:28.461 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:28.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:28.513 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-24T11:18:28.964 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:28.967 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:28.968 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:28.969 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:28.969 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:29.342 INFO:teuthology.orchestra.run.smithi072.stdout:generic/211 0s 2024-03-24T11:18:29.347 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/211 2024-03-24T11:18:29.347 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:29.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:29.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:29.363 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-24T11:18:29.548 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:29.552 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:29.553 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:29.554 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:29.554 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:29.837 INFO:teuthology.orchestra.run.smithi072.stdout:generic/212 0s 2024-03-24T11:18:29.842 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/212 2024-03-24T11:18:29.843 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:29.845 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:29.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:29.857 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-24T11:18:30.033 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:30.036 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:30.037 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:30.038 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:30.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:30.252 INFO:teuthology.orchestra.run.smithi072.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:18:30.255 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/213 2024-03-24T11:18:30.256 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/213 2024-03-24T11:18:30.256 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:30.258 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:30.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:30.270 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-24T11:18:30.438 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:30.441 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:30.442 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:30.443 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:30.443 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:30.655 INFO:teuthology.orchestra.run.smithi072.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:18:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/214 2024-03-24T11:18:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/214 2024-03-24T11:18:30.659 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:30.661 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:30.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:30.673 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-24T11:18:30.853 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:30.856 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:30.857 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:30.858 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:30.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:33.142 INFO:teuthology.orchestra.run.smithi072.stdout:generic/215 3s 2024-03-24T11:18:33.148 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/215 2024-03-24T11:18:33.148 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:33.151 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:33.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:33.180 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-24T11:18:33.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:33.373 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:33.374 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:33.375 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:33.730 INFO:teuthology.orchestra.run.smithi072.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:33.736 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/216 2024-03-24T11:18:33.736 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/216 2024-03-24T11:18:33.737 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:33.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:34.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:34.064 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-24T11:18:34.239 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:34.243 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:34.244 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:34.245 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:34.245 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:34.603 INFO:teuthology.orchestra.run.smithi072.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:34.610 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/217 2024-03-24T11:18:34.610 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/217 2024-03-24T11:18:34.610 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:34.612 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:34.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:34.937 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-24T11:18:35.119 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:35.123 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:35.123 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:35.124 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:35.466 INFO:teuthology.orchestra.run.smithi072.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:35.472 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/218 2024-03-24T11:18:35.472 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/218 2024-03-24T11:18:35.472 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:35.474 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:35.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:35.784 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-24T11:18:35.968 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:35.972 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:35.973 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:35.973 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:36.178 INFO:teuthology.orchestra.run.smithi072.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:36.182 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/219 2024-03-24T11:18:36.182 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/219 2024-03-24T11:18:36.182 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:36.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:36.195 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-24T11:18:36.379 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:36.383 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:36.383 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:36.384 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:36.384 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:36.726 INFO:teuthology.orchestra.run.smithi072.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:36.738 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/220 2024-03-24T11:18:36.738 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/220 2024-03-24T11:18:36.738 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:36.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:36.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:36.923 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-24T11:18:37.136 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:37.140 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:37.141 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:37.142 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:38.378 INFO:teuthology.orchestra.run.smithi072.stdout:generic/221 1s 2024-03-24T11:18:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/221 2024-03-24T11:18:38.384 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:38.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:38.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:38.402 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-24T11:18:38.583 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:38.586 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:38.587 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:38.588 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:38.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:38.944 INFO:teuthology.orchestra.run.smithi072.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:38.948 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/222 2024-03-24T11:18:38.948 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/222 2024-03-24T11:18:38.948 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:38.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:39.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:39.288 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-24T11:18:39.471 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:39.474 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:39.475 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:39.475 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:39.691 INFO:teuthology.orchestra.run.smithi072.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:18:39.695 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/223 2024-03-24T11:18:39.695 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/223 2024-03-24T11:18:39.695 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:39.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:39.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:39.710 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-24T11:18:39.895 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:39.899 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:39.899 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:39.900 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:39.900 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:40.104 INFO:teuthology.orchestra.run.smithi072.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:18:40.108 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/224 2024-03-24T11:18:40.108 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/224 2024-03-24T11:18:40.108 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:40.110 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:40.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:40.121 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-24T11:18:40.308 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:40.312 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:40.312 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:40.313 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:40.313 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:40.573 INFO:teuthology.orchestra.run.smithi072.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T11:18:40.577 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/225 2024-03-24T11:18:40.577 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/225 2024-03-24T11:18:40.577 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:40.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:40.653 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-24T11:18:41.081 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:41.084 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:41.085 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:41.086 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:41.086 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:41.329 INFO:teuthology.orchestra.run.smithi072.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:18:41.330 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/226 2024-03-24T11:18:41.330 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/226 2024-03-24T11:18:41.330 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:41.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:41.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:41.346 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-24T11:18:41.525 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:41.529 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:41.529 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:41.530 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:41.530 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:41.858 INFO:teuthology.orchestra.run.smithi072.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:41.864 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/227 2024-03-24T11:18:41.864 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/227 2024-03-24T11:18:41.864 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:42.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:42.154 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-24T11:18:42.344 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:42.348 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:42.348 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:42.349 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:42.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:42.603 INFO:teuthology.orchestra.run.smithi072.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:18:42.607 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/228 2024-03-24T11:18:42.607 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/228 2024-03-24T11:18:42.607 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:42.609 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:42.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:42.621 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-24T11:18:42.799 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:42.803 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:42.803 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:42.804 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:42.804 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:43.163 INFO:teuthology.orchestra.run.smithi072.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:43.169 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/229 2024-03-24T11:18:43.169 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/229 2024-03-24T11:18:43.169 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:43.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:43.376 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-24T11:18:43.574 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:43.578 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:43.578 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:43.579 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:43.579 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:43.774 INFO:teuthology.orchestra.run.smithi072.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:43.777 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/230 2024-03-24T11:18:43.777 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/230 2024-03-24T11:18:43.777 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:43.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:43.790 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-24T11:18:43.973 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:43.977 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:43.977 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:43.978 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:43.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:44.175 INFO:teuthology.orchestra.run.smithi072.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:44.179 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/231 2024-03-24T11:18:44.179 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/231 2024-03-24T11:18:44.179 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:44.181 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:44.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:44.192 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-24T11:18:44.369 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:44.372 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:44.372 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:44.373 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:44.373 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:44.575 INFO:teuthology.orchestra.run.smithi072.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:44.579 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/232 2024-03-24T11:18:44.579 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/232 2024-03-24T11:18:44.579 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:44.581 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:44.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:44.592 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-24T11:18:44.773 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:44.859 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:44.859 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:44.859 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:44.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:44.972 INFO:teuthology.orchestra.run.smithi072.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:44.975 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/233 2024-03-24T11:18:44.976 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/233 2024-03-24T11:18:44.976 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:44.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:44.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:44.989 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-24T11:18:45.162 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:45.166 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:45.167 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:45.167 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:45.168 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:45.368 INFO:teuthology.orchestra.run.smithi072.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:45.372 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/234 2024-03-24T11:18:45.372 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/234 2024-03-24T11:18:45.372 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:45.374 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:45.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:45.385 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-24T11:18:45.567 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:45.570 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:45.571 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:45.572 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:45.572 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:45.766 INFO:teuthology.orchestra.run.smithi072.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:18:45.770 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/235 2024-03-24T11:18:45.770 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/235 2024-03-24T11:18:45.770 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:45.772 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:45.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:45.804 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-24T11:18:45.981 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:45.984 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:45.985 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:45.986 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:47.265 INFO:teuthology.orchestra.run.smithi072.stdout:generic/236 1s 2024-03-24T11:18:47.271 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/236 2024-03-24T11:18:47.272 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:47.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:47.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:47.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-24T11:18:47.768 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:47.772 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:47.772 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:47.773 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:47.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:48.077 INFO:teuthology.orchestra.run.smithi072.stdout:generic/237 1s 2024-03-24T11:18:48.082 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/237 2024-03-24T11:18:48.083 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:48.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:48.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:48.137 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-24T11:18:48.592 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:48.596 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:48.596 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:48.597 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:48.930 INFO:teuthology.orchestra.run.smithi072.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:18:48.937 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/238 2024-03-24T11:18:48.937 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/238 2024-03-24T11:18:48.937 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:48.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:49.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:49.229 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-24T11:18:49.419 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:49.422 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:49.423 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:49.424 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:49.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:49.646 INFO:teuthology.orchestra.run.smithi072.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-24T11:18:49.650 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/239 2024-03-24T11:18:49.650 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/239 2024-03-24T11:18:49.650 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:49.652 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:49.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:49.672 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-24T11:18:49.850 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:49.854 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:49.854 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:49.855 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:49.855 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:50.078 INFO:teuthology.orchestra.run.smithi072.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-24T11:18:50.081 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/240 2024-03-24T11:18:50.081 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/240 2024-03-24T11:18:50.082 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:18:50.084 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:18:50.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:18:50.103 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-24T11:18:50.285 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:18:50.289 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:18:50.289 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:18:50.290 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:18:50.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:19:55.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:19:55.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:19:55.227 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T11:19:55.226+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49421) UID: 0 2024-03-24T11:19:55.228 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T11:19:55.226+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49421) UID: 0 2024-03-24T11:20:03.872 INFO:teuthology.orchestra.run.smithi072.stdout:generic/241 73s 2024-03-24T11:20:03.884 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/241 2024-03-24T11:20:03.884 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:03.887 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:06.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:06.670 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-24T11:20:06.959 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:06.962 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:06.963 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:06.964 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:06.964 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:07.305 INFO:teuthology.orchestra.run.smithi072.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:07.311 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/242 2024-03-24T11:20:07.311 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/242 2024-03-24T11:20:07.311 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:07.315 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:07.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:07.882 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-24T11:20:08.303 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:08.312 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:08.312 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:08.315 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:08.315 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:09.070 INFO:teuthology.orchestra.run.smithi072.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:09.077 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/243 2024-03-24T11:20:09.077 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/243 2024-03-24T11:20:09.077 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:09.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:09.344 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-24T11:20:09.552 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:09.555 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:09.556 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:09.557 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:09.557 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:09.888 INFO:teuthology.orchestra.run.smithi072.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:20:09.893 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/244 2024-03-24T11:20:09.893 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/244 2024-03-24T11:20:09.893 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:09.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:09.913 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-24T11:20:10.138 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:10.142 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:10.142 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:10.143 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:10.143 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:generic/245 0s 2024-03-24T11:20:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/245 2024-03-24T11:20:10.460 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:10.462 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:10.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:10.522 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-24T11:20:10.895 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:10.899 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:10.899 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:10.900 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:10.900 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:11.172 INFO:teuthology.orchestra.run.smithi072.stdout:generic/246 1s 2024-03-24T11:20:11.177 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/246 2024-03-24T11:20:11.177 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:11.180 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:11.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:11.247 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-24T11:20:11.613 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:11.617 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:11.617 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:11.618 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:11.619 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:19.435 INFO:teuthology.orchestra.run.smithi072.stdout:generic/247 8s 2024-03-24T11:20:19.440 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/247 2024-03-24T11:20:19.440 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:19.442 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:19.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:19.451 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-24T11:20:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:19.628 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:19.629 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:19.630 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:19.630 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:19.891 INFO:teuthology.orchestra.run.smithi072.stdout:generic/248 0s 2024-03-24T11:20:19.897 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/248 2024-03-24T11:20:19.897 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:19.899 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:19.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:19.924 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-24T11:20:20.104 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:20.108 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:20.108 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:20.109 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:20.109 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:20.568 INFO:teuthology.orchestra.run.smithi072.stdout:generic/249 0s 2024-03-24T11:20:20.574 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/249 2024-03-24T11:20:20.574 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:20.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:20.632 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-24T11:20:21.003 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:21.006 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:21.007 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:21.008 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:21.008 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:21.258 INFO:teuthology.orchestra.run.smithi072.stdout:generic/250 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:20:21.262 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/250 2024-03-24T11:20:21.262 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/250 2024-03-24T11:20:21.262 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:21.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:21.279 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-24T11:20:21.461 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:21.464 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:21.465 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:21.466 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:21.789 INFO:teuthology.orchestra.run.smithi072.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:21.798 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/251 2024-03-24T11:20:21.798 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/251 2024-03-24T11:20:21.798 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:21.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:21.813 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-24T11:20:21.989 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:21.993 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:21.993 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:21.994 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:22.211 INFO:teuthology.orchestra.run.smithi072.stdout:generic/252 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:20:22.215 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/252 2024-03-24T11:20:22.215 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/252 2024-03-24T11:20:22.215 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:22.217 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:22.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:22.232 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-24T11:20:22.426 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:22.430 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:22.430 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:22.433 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:22.433 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:22.803 INFO:teuthology.orchestra.run.smithi072.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:22.810 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/253 2024-03-24T11:20:22.810 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/253 2024-03-24T11:20:22.810 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:23.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:23.054 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-24T11:20:23.248 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:23.252 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:23.252 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:23.253 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:23.253 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:23.612 INFO:teuthology.orchestra.run.smithi072.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:23.618 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/254 2024-03-24T11:20:23.618 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/254 2024-03-24T11:20:23.618 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:23.624 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:23.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:23.900 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-24T11:20:24.096 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:24.100 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:24.100 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:24.101 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:24.101 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:24.424 INFO:teuthology.orchestra.run.smithi072.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:20:24.428 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/255 2024-03-24T11:20:24.428 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/255 2024-03-24T11:20:24.428 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:24.430 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:24.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:24.500 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-24T11:20:24.838 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:24.842 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:24.842 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:24.843 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:24.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:25.636 INFO:teuthology.orchestra.run.smithi072.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:20:25.640 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/256 2024-03-24T11:20:25.640 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/256 2024-03-24T11:20:25.640 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:25.642 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:25.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:25.667 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-24T11:20:25.845 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:25.849 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:25.850 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:26.829 INFO:teuthology.orchestra.run.smithi072.stdout:generic/257 1s 2024-03-24T11:20:26.834 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/257 2024-03-24T11:20:26.834 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:26.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:26.915 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-24T11:20:27.243 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:27.247 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:27.247 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:27.248 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:27.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:27.454 INFO:teuthology.orchestra.run.smithi072.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-24T11:20:27.457 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/258 2024-03-24T11:20:27.458 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/258 2024-03-24T11:20:27.458 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:27.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:27.474 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-24T11:20:27.752 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:27.756 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:27.756 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:27.757 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:28.117 INFO:teuthology.orchestra.run.smithi072.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:28.123 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/259 2024-03-24T11:20:28.123 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/259 2024-03-24T11:20:28.124 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:28.126 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:28.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:28.357 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-24T11:20:28.556 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:28.560 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:28.561 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:28.562 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:28.846 INFO:teuthology.orchestra.run.smithi072.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:28.855 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/260 2024-03-24T11:20:28.855 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/260 2024-03-24T11:20:28.855 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:28.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:28.871 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-24T11:20:29.049 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:29.053 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:29.053 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:29.054 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:29.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:29.444 INFO:teuthology.orchestra.run.smithi072.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:29.449 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/261 2024-03-24T11:20:29.449 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/261 2024-03-24T11:20:29.449 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:29.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:29.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:29.650 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-24T11:20:29.873 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:29.877 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:29.878 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:29.879 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:29.879 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:30.270 INFO:teuthology.orchestra.run.smithi072.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:20:30.277 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/262 2024-03-24T11:20:30.277 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/262 2024-03-24T11:20:30.277 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:20:30.280 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:20:30.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:20:30.530 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-24T11:20:30.722 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:20:30.726 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:20:30.726 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:20:30.727 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:20:30.727 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:11.009 INFO:teuthology.orchestra.run.smithi072.stdout:generic/263 41s 2024-03-24T11:21:11.013 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/263 2024-03-24T11:21:11.014 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:11.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:11.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:11.061 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-24T11:21:11.561 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:11.564 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:11.565 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:11.565 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:11.566 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:11.908 INFO:teuthology.orchestra.run.smithi072.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:11.917 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/264 2024-03-24T11:21:11.917 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/264 2024-03-24T11:21:11.917 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:12.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:12.365 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-24T11:21:12.563 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:12.566 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:12.567 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:12.568 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:12.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:12.948 INFO:teuthology.orchestra.run.smithi072.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:12.954 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/265 2024-03-24T11:21:12.954 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/265 2024-03-24T11:21:12.954 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:12.965 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:13.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:13.359 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-24T11:21:13.540 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:13.543 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:13.544 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:13.545 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:13.545 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:13.948 INFO:teuthology.orchestra.run.smithi072.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:13.954 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/266 2024-03-24T11:21:13.954 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/266 2024-03-24T11:21:13.954 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:14.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:14.339 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-24T11:21:14.524 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:14.528 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:14.528 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:14.529 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:14.529 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:14.900 INFO:teuthology.orchestra.run.smithi072.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:14.906 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/267 2024-03-24T11:21:14.906 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/267 2024-03-24T11:21:14.906 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:14.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:15.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:15.283 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-24T11:21:15.460 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:15.463 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:15.464 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:15.464 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:15.465 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:15.842 INFO:teuthology.orchestra.run.smithi072.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:15.849 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/268 2024-03-24T11:21:15.849 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/268 2024-03-24T11:21:15.849 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:16.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:16.244 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-24T11:21:16.423 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:16.427 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:16.427 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:16.428 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:16.634 INFO:teuthology.orchestra.run.smithi072.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:21:16.638 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/269 2024-03-24T11:21:16.638 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/269 2024-03-24T11:21:16.638 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:16.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:16.653 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-24T11:21:16.839 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:16.842 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:16.843 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:16.844 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:17.041 INFO:teuthology.orchestra.run.smithi072.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:21:17.044 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/270 2024-03-24T11:21:17.044 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/270 2024-03-24T11:21:17.045 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:17.047 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:17.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:17.059 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-24T11:21:17.238 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:17.241 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:17.242 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:17.243 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:17.243 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:17.597 INFO:teuthology.orchestra.run.smithi072.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:17.603 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/271 2024-03-24T11:21:17.603 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/271 2024-03-24T11:21:17.603 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:17.606 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:18.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:18.023 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-24T11:21:18.204 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:18.208 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:18.208 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:18.209 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:18.209 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:18.550 INFO:teuthology.orchestra.run.smithi072.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/272 2024-03-24T11:21:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/272 2024-03-24T11:21:18.555 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:18.560 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:18.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:18.951 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-24T11:21:19.323 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:19.327 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:19.327 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:19.328 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:19.328 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:19.529 INFO:teuthology.orchestra.run.smithi072.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:21:19.533 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/273 2024-03-24T11:21:19.533 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/273 2024-03-24T11:21:19.533 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:19.535 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:19.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:19.547 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-24T11:21:19.718 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:19.721 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:19.722 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:19.722 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:19.723 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:19.935 INFO:teuthology.orchestra.run.smithi072.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T11:21:19.939 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/274 2024-03-24T11:21:19.939 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/274 2024-03-24T11:21:19.939 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:19.942 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:19.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:19.976 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-24T11:21:20.148 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:20.152 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:20.153 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:20.154 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:20.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:20.350 INFO:teuthology.orchestra.run.smithi072.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:21:20.354 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/275 2024-03-24T11:21:20.354 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/275 2024-03-24T11:21:20.354 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:20.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:20.368 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-24T11:21:20.543 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:20.547 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:20.547 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:20.548 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:20.913 INFO:teuthology.orchestra.run.smithi072.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:20.920 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/276 2024-03-24T11:21:20.920 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/276 2024-03-24T11:21:20.920 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:20.922 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:21.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:21.327 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-24T11:21:21.501 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:21.506 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:21.762 INFO:teuthology.orchestra.run.smithi072.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-24T11:21:21.766 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/277 2024-03-24T11:21:21.766 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/277 2024-03-24T11:21:21.766 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:21.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:21.786 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-24T11:21:21.965 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:21.969 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:21.969 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:21.970 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:22.339 INFO:teuthology.orchestra.run.smithi072.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:22.344 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/278 2024-03-24T11:21:22.344 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/278 2024-03-24T11:21:22.344 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:22.351 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:22.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:22.731 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-24T11:21:22.904 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:22.907 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:22.908 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:22.909 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:22.909 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:23.260 INFO:teuthology.orchestra.run.smithi072.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:23.271 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/279 2024-03-24T11:21:23.272 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/279 2024-03-24T11:21:23.272 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:23.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:23.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:23.664 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-24T11:21:23.837 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:23.841 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:23.841 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:23.843 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:23.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:24.076 INFO:teuthology.orchestra.run.smithi072.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:21:24.079 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/280 2024-03-24T11:21:24.079 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/280 2024-03-24T11:21:24.080 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:24.082 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:24.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:24.093 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-24T11:21:24.269 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:24.272 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:24.273 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:24.274 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:24.274 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:24.666 INFO:teuthology.orchestra.run.smithi072.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:24.672 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/281 2024-03-24T11:21:24.672 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/281 2024-03-24T11:21:24.672 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:24.675 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:25.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:25.006 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-24T11:21:25.189 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:25.193 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:25.193 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:25.194 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:25.194 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:25.561 INFO:teuthology.orchestra.run.smithi072.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:25.568 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/282 2024-03-24T11:21:25.568 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/282 2024-03-24T11:21:25.568 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:25.570 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:25.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:25.989 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-24T11:21:26.185 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:26.188 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:26.189 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:26.190 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:26.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:26.553 INFO:teuthology.orchestra.run.smithi072.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:26.560 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/283 2024-03-24T11:21:26.560 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/283 2024-03-24T11:21:26.560 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:26.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:26.975 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-24T11:21:27.152 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:27.156 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:27.157 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:27.157 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:27.158 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:27.518 INFO:teuthology.orchestra.run.smithi072.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/284 2024-03-24T11:21:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/284 2024-03-24T11:21:27.523 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:27.531 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:27.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:27.934 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-24T11:21:28.107 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:28.111 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:28.112 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:28.113 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:29.164 INFO:teuthology.orchestra.run.smithi072.stdout:generic/285 1s 2024-03-24T11:21:29.169 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/285 2024-03-24T11:21:29.169 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:29.171 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:29.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:29.548 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-24T11:21:29.949 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:29.953 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:29.953 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:29.955 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:29.955 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:30.233 INFO:teuthology.orchestra.run.smithi072.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:21:30.238 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/286 2024-03-24T11:21:30.238 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/286 2024-03-24T11:21:30.238 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:30.241 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:30.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:30.262 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-24T11:21:30.479 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:30.483 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:30.484 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:30.485 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:30.485 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:30.949 INFO:teuthology.orchestra.run.smithi072.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:30.956 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/287 2024-03-24T11:21:30.956 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/287 2024-03-24T11:21:30.956 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:30.958 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:31.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:31.353 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-24T11:21:31.584 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:31.589 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:31.589 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:31.591 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:31.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:31.960 INFO:teuthology.orchestra.run.smithi072.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:31.967 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/288 2024-03-24T11:21:31.967 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/288 2024-03-24T11:21:31.968 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:31.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:31.985 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-24T11:21:32.217 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:32.221 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:32.221 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:32.222 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:32.668 INFO:teuthology.orchestra.run.smithi072.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:32.675 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/289 2024-03-24T11:21:32.675 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/289 2024-03-24T11:21:32.675 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:33.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:33.049 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-24T11:21:33.276 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:33.281 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:33.282 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:33.283 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:33.283 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:33.703 INFO:teuthology.orchestra.run.smithi072.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:33.710 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/290 2024-03-24T11:21:33.710 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/290 2024-03-24T11:21:33.710 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:33.712 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:34.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:34.107 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-24T11:21:34.316 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:34.322 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:34.322 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:34.322 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:34.322 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:34.752 INFO:teuthology.orchestra.run.smithi072.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:34.758 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/291 2024-03-24T11:21:34.758 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/291 2024-03-24T11:21:34.759 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:34.762 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:35.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:35.200 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-24T11:21:35.408 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:35.412 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:35.413 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:35.414 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:35.414 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:35.825 INFO:teuthology.orchestra.run.smithi072.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/292 2024-03-24T11:21:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/292 2024-03-24T11:21:35.832 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:35.834 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:36.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:36.248 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-24T11:21:36.433 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:36.437 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:36.437 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:36.438 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:36.439 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:36.791 INFO:teuthology.orchestra.run.smithi072.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:36.797 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/293 2024-03-24T11:21:36.797 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/293 2024-03-24T11:21:36.797 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:36.799 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:37.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:37.210 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-24T11:21:37.386 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:37.389 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:37.389 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:37.390 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:37.391 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:37.845 INFO:teuthology.orchestra.run.smithi072.stdout:generic/294 0s 2024-03-24T11:21:37.855 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/294 2024-03-24T11:21:37.855 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:37.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:37.873 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-24T11:21:38.326 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:38.330 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:38.330 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:38.331 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:38.331 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:38.697 INFO:teuthology.orchestra.run.smithi072.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:38.703 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/295 2024-03-24T11:21:38.703 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/295 2024-03-24T11:21:38.704 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:38.712 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:39.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:39.107 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-24T11:21:39.282 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:39.286 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:39.286 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:39.287 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:39.287 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:39.608 INFO:teuthology.orchestra.run.smithi072.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:39.613 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/296 2024-03-24T11:21:39.614 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/296 2024-03-24T11:21:39.614 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:39.622 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:39.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:39.973 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-24T11:21:40.170 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:40.174 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:40.174 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:40.175 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:40.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:40.552 INFO:teuthology.orchestra.run.smithi072.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:40.559 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/297 2024-03-24T11:21:40.559 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/297 2024-03-24T11:21:40.559 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:40.561 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:40.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:40.960 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-24T11:21:41.206 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:41.209 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:41.210 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:41.211 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:41.211 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:41.574 INFO:teuthology.orchestra.run.smithi072.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:41.579 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/298 2024-03-24T11:21:41.579 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/298 2024-03-24T11:21:41.580 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:41.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:41.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:41.977 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-24T11:21:42.149 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:42.153 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:42.154 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:42.154 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:42.154 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:42.599 INFO:teuthology.orchestra.run.smithi072.stdout:generic/299 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:21:42.603 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/299 2024-03-24T11:21:42.603 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/299 2024-03-24T11:21:42.603 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:42.606 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:42.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:42.618 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-24T11:21:42.798 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:42.801 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:42.802 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:42.803 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:42.803 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:43.069 INFO:teuthology.orchestra.run.smithi072.stdout:generic/300 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:21:43.072 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/300 2024-03-24T11:21:43.072 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/300 2024-03-24T11:21:43.072 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:43.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:43.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:43.090 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-24T11:21:43.263 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:43.267 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:43.267 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:43.268 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:43.268 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:43.608 INFO:teuthology.orchestra.run.smithi072.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:43.614 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/301 2024-03-24T11:21:43.614 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/301 2024-03-24T11:21:43.614 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:43.617 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:44.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:44.043 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-24T11:21:44.215 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:44.219 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:44.219 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:44.220 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:44.220 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:44.574 INFO:teuthology.orchestra.run.smithi072.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:44.580 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/302 2024-03-24T11:21:44.580 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/302 2024-03-24T11:21:44.580 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:44.583 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:45.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:45.014 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-24T11:21:45.198 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:45.201 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:45.202 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:45.203 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:45.203 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:45.455 INFO:teuthology.orchestra.run.smithi072.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:21:45.459 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/303 2024-03-24T11:21:45.459 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/303 2024-03-24T11:21:45.459 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:45.461 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:45.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:45.503 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-24T11:21:45.977 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:45.980 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:45.981 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:45.982 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:45.982 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:46.219 INFO:teuthology.orchestra.run.smithi072.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T11:21:46.222 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/304 2024-03-24T11:21:46.222 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/304 2024-03-24T11:21:46.222 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:46.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:46.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:46.274 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-24T11:21:46.719 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:46.723 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:46.723 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:46.724 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:46.724 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:47.071 INFO:teuthology.orchestra.run.smithi072.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:21:47.078 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/305 2024-03-24T11:21:47.078 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/305 2024-03-24T11:21:47.078 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:47.081 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:47.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:47.537 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-24T11:21:47.715 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:47.719 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:47.719 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:47.720 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:47.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:48.171 INFO:teuthology.orchestra.run.smithi072.stdout:generic/306 1s 2024-03-24T11:21:48.179 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/306 2024-03-24T11:21:48.179 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:48.182 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:48.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:48.588 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-24T11:21:49.148 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:49.152 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:49.152 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:49.153 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:49.153 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:50.622 INFO:teuthology.orchestra.run.smithi072.stdout:generic/307 1s 2024-03-24T11:21:50.627 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/307 2024-03-24T11:21:50.627 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:50.630 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:50.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:50.639 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-24T11:21:50.819 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:50.823 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:50.823 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:50.824 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:50.824 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:51.068 INFO:teuthology.orchestra.run.smithi072.stdout:generic/308 1s 2024-03-24T11:21:51.073 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/308 2024-03-24T11:21:51.073 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:51.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:51.090 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-24T11:21:51.265 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:51.269 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:51.269 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:51.270 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:51.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:52.525 INFO:teuthology.orchestra.run.smithi072.stdout:generic/309 1s 2024-03-24T11:21:52.531 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/309 2024-03-24T11:21:52.531 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:21:52.534 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:21:52.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:21:52.592 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-24T11:21:53.036 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:21:53.040 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:21:53.040 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:21:53.041 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:21:53.041 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:10.698 INFO:teuthology.orchestra.run.smithi072.stdout:generic/310 77s 2024-03-24T11:23:10.703 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/310 2024-03-24T11:23:10.703 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:10.705 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:10.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:10.871 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-24T11:23:11.243 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:11.247 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:11.247 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:11.248 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:11.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:11.758 INFO:teuthology.orchestra.run.smithi072.stdout:generic/311 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:23:11.762 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/311 2024-03-24T11:23:11.762 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/311 2024-03-24T11:23:11.762 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:11.764 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:11.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:11.779 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-24T11:23:11.953 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:11.957 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:11.957 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:11.958 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:12.055 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T11:23:12.055+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49486) UID: 0 2024-03-24T11:23:12.056 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T11:23:12.055+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49486) UID: 0 2024-03-24T11:23:12.056 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T11:23:12.055+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49486) UID: 0 2024-03-24T11:23:12.056 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T11:23:12.055+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49486) UID: 0 2024-03-24T11:23:12.166 INFO:teuthology.orchestra.run.smithi072.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:23:12.170 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/312 2024-03-24T11:23:12.170 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/312 2024-03-24T11:23:12.170 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:12.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:12.185 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-24T11:23:12.368 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:12.371 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:12.372 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:12.373 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:12.373 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:16.611 INFO:teuthology.orchestra.run.smithi072.stdout:generic/313 4s 2024-03-24T11:23:16.617 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/313 2024-03-24T11:23:16.617 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:16.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:16.636 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-24T11:23:16.823 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:16.827 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:16.827 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:16.828 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:17.518 INFO:teuthology.orchestra.run.smithi072.stdout:generic/314 1s 2024-03-24T11:23:17.523 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/314 2024-03-24T11:23:17.523 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:17.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:17.540 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-24T11:23:17.724 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:17.728 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:17.728 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:17.729 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:17.729 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:17.942 INFO:teuthology.orchestra.run.smithi072.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T11:23:17.946 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/315 2024-03-24T11:23:17.946 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/315 2024-03-24T11:23:17.946 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:17.948 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:17.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:17.962 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-24T11:23:18.140 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:18.143 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:18.144 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:18.145 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:18.145 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:18.478 INFO:teuthology.orchestra.run.smithi072.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T11:23:18.481 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/316 2024-03-24T11:23:18.482 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/316 2024-03-24T11:23:18.482 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:18.484 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:18.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:18.532 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-24T11:23:18.878 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:18.881 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:18.882 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:18.883 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:18.883 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:20.027 INFO:teuthology.orchestra.run.smithi072.stdout:generic/317 2s 2024-03-24T11:23:20.033 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/317 2024-03-24T11:23:20.033 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:20.035 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:20.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:20.044 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-24T11:23:20.219 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:20.223 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:20.224 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:20.224 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:20.743 INFO:teuthology.orchestra.run.smithi072.stdout:generic/318 0s 2024-03-24T11:23:20.749 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/318 2024-03-24T11:23:20.749 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:20.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:20.759 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-24T11:23:20.945 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:20.949 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:20.950 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:20.950 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:20.950 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:21.259 INFO:teuthology.orchestra.run.smithi072.stdout:generic/319 0s 2024-03-24T11:23:21.264 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/319 2024-03-24T11:23:21.264 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:21.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:21.275 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-24T11:23:21.455 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:21.458 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:21.459 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:21.460 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:21.658 INFO:teuthology.orchestra.run.smithi072.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:23:21.662 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/320 2024-03-24T11:23:21.662 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/320 2024-03-24T11:23:21.662 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:21.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:21.675 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-24T11:23:21.864 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:21.870 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:21.870 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:21.870 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:22.067 INFO:teuthology.orchestra.run.smithi072.stdout:generic/321 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:23:22.071 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/321 2024-03-24T11:23:22.071 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/321 2024-03-24T11:23:22.071 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:22.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:22.085 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-24T11:23:22.274 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:22.277 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:22.278 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:22.279 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:22.279 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:22.482 INFO:teuthology.orchestra.run.smithi072.stdout:generic/322 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:23:22.486 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/322 2024-03-24T11:23:22.486 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/322 2024-03-24T11:23:22.486 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:23:22.488 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:23:22.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:23:22.499 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-24T11:23:22.673 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:23:22.676 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:23:22.677 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:23:22.677 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:23:22.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:23.398 INFO:teuthology.orchestra.run.smithi072.stdout:generic/323 121s 2024-03-24T11:25:23.403 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/323 2024-03-24T11:25:23.403 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:23.405 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:23.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:23.449 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-24T11:25:23.798 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:23.801 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:23.802 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:23.803 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:23.803 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:24.005 INFO:teuthology.orchestra.run.smithi072.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-24T11:25:24.009 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/324 2024-03-24T11:25:24.009 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/324 2024-03-24T11:25:24.009 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:24.011 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:24.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:24.023 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-24T11:25:24.207 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:24.211 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:24.211 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:24.212 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:24.212 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:24.423 INFO:teuthology.orchestra.run.smithi072.stdout:generic/325 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:25:24.427 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/325 2024-03-24T11:25:24.427 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/325 2024-03-24T11:25:24.427 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:24.429 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:24.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:24.440 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-24T11:25:24.613 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:24.616 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:24.617 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:24.618 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:24.618 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:24.937 INFO:teuthology.orchestra.run.smithi072.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:24.942 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/326 2024-03-24T11:25:24.942 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/326 2024-03-24T11:25:24.942 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:24.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:25.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:25.112 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-24T11:25:25.350 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:25.354 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:25.355 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:25.355 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:25.356 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:25.721 INFO:teuthology.orchestra.run.smithi072.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/327 2024-03-24T11:25:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/327 2024-03-24T11:25:25.727 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:25.730 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:25.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:25.894 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-24T11:25:26.136 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:26.140 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:26.140 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:26.141 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:26.142 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:26.508 INFO:teuthology.orchestra.run.smithi072.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:26.518 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/328 2024-03-24T11:25:26.518 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/328 2024-03-24T11:25:26.518 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:26.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:26.798 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-24T11:25:27.005 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:27.009 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:27.010 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:27.011 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:27.440 INFO:teuthology.orchestra.run.smithi072.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:27.447 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/329 2024-03-24T11:25:27.447 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/329 2024-03-24T11:25:27.447 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:27.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:27.654 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-24T11:25:27.859 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:27.863 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:27.863 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:27.864 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:27.864 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:28.217 INFO:teuthology.orchestra.run.smithi072.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:28.224 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/330 2024-03-24T11:25:28.224 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/330 2024-03-24T11:25:28.224 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:28.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:28.397 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-24T11:25:28.627 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:28.631 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:28.632 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:28.632 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:29.008 INFO:teuthology.orchestra.run.smithi072.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:29.015 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/331 2024-03-24T11:25:29.015 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/331 2024-03-24T11:25:29.015 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:29.021 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:29.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:29.239 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-24T11:25:29.437 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:29.440 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:29.441 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:29.442 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:29.442 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:29.782 INFO:teuthology.orchestra.run.smithi072.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:29.787 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/332 2024-03-24T11:25:29.787 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/332 2024-03-24T11:25:29.787 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:29.790 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:30.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:30.025 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-24T11:25:30.238 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:30.242 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:30.242 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:30.246 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:30.246 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:30.611 INFO:teuthology.orchestra.run.smithi072.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/333 2024-03-24T11:25:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/333 2024-03-24T11:25:30.617 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:30.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:30.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:30.844 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-24T11:25:31.036 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:31.040 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:31.041 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:31.041 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:31.411 INFO:teuthology.orchestra.run.smithi072.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:25:31.416 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/334 2024-03-24T11:25:31.416 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/334 2024-03-24T11:25:31.416 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:31.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:31.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:31.644 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-24T11:25:31.838 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:31.842 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:31.842 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:31.843 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:31.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:32.057 INFO:teuthology.orchestra.run.smithi072.stdout:generic/335 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:25:32.061 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/335 2024-03-24T11:25:32.061 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/335 2024-03-24T11:25:32.061 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:32.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:32.078 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-24T11:25:32.267 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:32.271 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:32.271 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:32.272 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:32.516 INFO:teuthology.orchestra.run.smithi072.stdout:generic/336 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:25:32.520 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/336 2024-03-24T11:25:32.520 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/336 2024-03-24T11:25:32.520 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:32.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:32.538 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-24T11:25:32.713 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:32.717 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:32.717 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:32.718 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:33.065 INFO:teuthology.orchestra.run.smithi072.stdout:generic/337 1s 2024-03-24T11:25:33.070 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/337 2024-03-24T11:25:33.070 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:33.072 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:33.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:33.081 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-24T11:25:33.252 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:33.255 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:33.256 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:33.257 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:33.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:33.482 INFO:teuthology.orchestra.run.smithi072.stdout:generic/338 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:25:33.486 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/338 2024-03-24T11:25:33.486 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/338 2024-03-24T11:25:33.486 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:25:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:25:33.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:25:33.501 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-24T11:25:33.682 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:25:33.686 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:25:33.686 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:25:33.687 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:25:33.687 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:27.980 INFO:teuthology.orchestra.run.smithi072.stdout:generic/339 54s 2024-03-24T11:26:27.985 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/339 2024-03-24T11:26:27.985 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:27.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:27.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:27.997 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-24T11:26:28.190 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:28.193 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:28.194 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:28.195 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:28.195 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:30.672 INFO:teuthology.orchestra.run.smithi072.stdout:generic/340 2s 2024-03-24T11:26:30.678 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/340 2024-03-24T11:26:30.678 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:30.681 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:30.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:30.699 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-24T11:26:31.056 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:31.060 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:31.060 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:31.061 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:31.062 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:31.305 INFO:teuthology.orchestra.run.smithi072.stdout:generic/341 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:26:31.309 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/341 2024-03-24T11:26:31.309 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/341 2024-03-24T11:26:31.309 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:31.311 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:31.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:31.323 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-24T11:26:31.505 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:31.510 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:31.511 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:31.512 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:31.512 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:31.794 INFO:teuthology.orchestra.run.smithi072.stdout:generic/342 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:26:31.799 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/342 2024-03-24T11:26:31.800 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/342 2024-03-24T11:26:31.800 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:31.803 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:31.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:31.831 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-24T11:26:32.055 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:32.058 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:32.059 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:32.060 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:32.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:32.297 INFO:teuthology.orchestra.run.smithi072.stdout:generic/343 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:26:32.301 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/343 2024-03-24T11:26:32.301 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/343 2024-03-24T11:26:32.301 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:32.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:32.322 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-24T11:26:32.504 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:32.507 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:32.508 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:32.509 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:32.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:36.668 INFO:teuthology.orchestra.run.smithi072.stdout:generic/344 4s 2024-03-24T11:26:36.675 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/344 2024-03-24T11:26:36.675 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:36.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:36.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:36.689 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-24T11:26:37.112 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:37.116 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:37.116 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:37.117 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:42.201 INFO:teuthology.orchestra.run.smithi072.stdout:generic/345 5s 2024-03-24T11:26:42.247 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/345 2024-03-24T11:26:42.248 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:42.250 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:42.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:42.266 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-24T11:26:42.752 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:42.756 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:42.756 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:42.757 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:42.757 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:45.393 INFO:teuthology.orchestra.run.smithi072.stdout:generic/346 3s 2024-03-24T11:26:45.407 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/346 2024-03-24T11:26:45.407 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:45.408 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:45.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:45.419 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-24T11:26:45.789 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:45.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:45.794 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:45.796 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:45.796 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:46.122 INFO:teuthology.orchestra.run.smithi072.stdout:generic/347 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:26:46.127 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/347 2024-03-24T11:26:46.128 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/347 2024-03-24T11:26:46.128 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:46.132 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:46.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:46.152 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-24T11:26:46.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:46.378 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:46.378 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:46.625 INFO:teuthology.orchestra.run.smithi072.stdout:generic/348 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:26:46.628 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/348 2024-03-24T11:26:46.628 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/348 2024-03-24T11:26:46.629 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:46.631 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:46.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:46.649 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-24T11:26:46.823 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:46.827 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:46.827 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:46.828 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:47.145 INFO:teuthology.orchestra.run.smithi072.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-24T11:26:47.148 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/349 2024-03-24T11:26:47.148 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/349 2024-03-24T11:26:47.149 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:47.152 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:47.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:47.169 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-24T11:26:47.352 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:47.356 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:47.356 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:47.357 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:47.358 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:47.987 INFO:teuthology.orchestra.run.smithi072.stdout:generic/350 0s 2024-03-24T11:26:47.992 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/350 2024-03-24T11:26:47.992 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:48.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:48.003 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-24T11:26:48.183 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:48.186 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:48.187 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:48.188 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:48.188 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:48.408 INFO:teuthology.orchestra.run.smithi072.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:26:48.412 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/351 2024-03-24T11:26:48.412 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/351 2024-03-24T11:26:48.412 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:48.414 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:48.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:48.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-24T11:26:48.616 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:48.620 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:48.620 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:48.621 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:48.976 INFO:teuthology.orchestra.run.smithi072.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:26:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/352 2024-03-24T11:26:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/352 2024-03-24T11:26:48.982 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:48.985 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:49.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:49.372 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-24T11:26:49.563 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:49.566 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:49.567 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:49.568 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:49.568 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:49.910 INFO:teuthology.orchestra.run.smithi072.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:26:49.916 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/353 2024-03-24T11:26:49.916 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/353 2024-03-24T11:26:49.917 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:26:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:26:50.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:26:50.354 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-24T11:26:50.533 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:26:50.537 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:26:50.537 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:26:50.538 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:26:50.538 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:03.935 INFO:teuthology.orchestra.run.smithi072.stdout:generic/354 13s 2024-03-24T11:27:03.943 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/354 2024-03-24T11:27:03.944 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:03.947 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:03.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:03.961 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-24T11:27:04.382 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:04.386 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:04.387 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:04.388 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:04.388 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:05.241 INFO:teuthology.orchestra.run.smithi072.stdout:generic/355 1s 2024-03-24T11:27:05.246 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/355 2024-03-24T11:27:05.246 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:05.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:05.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:05.303 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-24T11:27:05.755 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:05.759 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:05.759 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:05.760 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:05.760 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:06.365 INFO:teuthology.orchestra.run.smithi072.stdout:generic/356 [not run] swapfiles are not supported 2024-03-24T11:27:06.369 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/356 2024-03-24T11:27:06.369 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/356 2024-03-24T11:27:06.369 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:06.371 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:06.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:06.385 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-24T11:27:06.568 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:06.572 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:06.572 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:06.573 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:06.573 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:06.869 INFO:teuthology.orchestra.run.smithi072.stdout:generic/357 [not run] swapfiles are not supported 2024-03-24T11:27:06.873 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/357 2024-03-24T11:27:06.873 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/357 2024-03-24T11:27:06.873 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:06.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:06.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:06.889 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-24T11:27:07.069 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:07.073 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:07.073 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:07.074 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:07.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:07.415 INFO:teuthology.orchestra.run.smithi072.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/358 2024-03-24T11:27:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/358 2024-03-24T11:27:07.422 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:07.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:07.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:07.797 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-24T11:27:07.983 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:07.987 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:07.987 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:07.988 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:07.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:08.328 INFO:teuthology.orchestra.run.smithi072.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/359 2024-03-24T11:27:08.334 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/359 2024-03-24T11:27:08.335 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:08.337 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:08.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:08.676 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-24T11:27:08.854 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:08.857 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:08.858 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:08.859 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:08.859 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:09.088 INFO:teuthology.orchestra.run.smithi072.stdout:generic/360 1s 2024-03-24T11:27:09.093 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/360 2024-03-24T11:27:09.093 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:09.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:09.113 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-24T11:27:09.289 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:09.293 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:09.293 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:09.294 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:09.294 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:09.512 INFO:teuthology.orchestra.run.smithi072.stdout:generic/361 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:27:09.516 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/361 2024-03-24T11:27:09.516 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/361 2024-03-24T11:27:09.516 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:09.519 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:09.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:09.533 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-24T11:27:09.710 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:09.713 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:09.714 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:09.718 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:09.718 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:09.919 INFO:teuthology.orchestra.run.smithi072.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:09.926 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/362 2024-03-24T11:27:09.926 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/362 2024-03-24T11:27:09.926 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:09.926 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:09.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:09.937 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-24T11:27:10.110 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:10.114 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:10.114 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:10.115 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:10.115 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:10.325 INFO:teuthology.orchestra.run.smithi072.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/363 2024-03-24T11:27:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/363 2024-03-24T11:27:10.329 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:10.331 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:10.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:10.343 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-24T11:27:10.517 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:10.521 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:10.521 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:10.522 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:10.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:10.721 INFO:teuthology.orchestra.run.smithi072.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:10.725 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/364 2024-03-24T11:27:10.725 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/364 2024-03-24T11:27:10.725 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:10.727 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:10.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:10.739 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-24T11:27:10.913 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:10.917 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:10.917 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:10.918 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:10.918 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:11.118 INFO:teuthology.orchestra.run.smithi072.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:11.122 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/365 2024-03-24T11:27:11.122 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/365 2024-03-24T11:27:11.122 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:11.124 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:11.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:11.155 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-24T11:27:11.339 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:11.342 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:11.343 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:11.344 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:11.344 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:11.538 INFO:teuthology.orchestra.run.smithi072.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:11.542 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/366 2024-03-24T11:27:11.542 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/366 2024-03-24T11:27:11.542 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:11.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:11.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:11.556 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-24T11:27:11.742 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:11.745 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:11.746 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:11.747 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:11.747 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:11.945 INFO:teuthology.orchestra.run.smithi072.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:11.948 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/367 2024-03-24T11:27:11.949 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/367 2024-03-24T11:27:11.949 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:11.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:11.963 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-24T11:27:12.134 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:12.138 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:12.138 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:12.139 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:12.341 INFO:teuthology.orchestra.run.smithi072.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:12.345 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/368 2024-03-24T11:27:12.345 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/368 2024-03-24T11:27:12.345 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:12.347 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:12.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:12.359 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-24T11:27:12.531 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:12.534 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:12.535 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:12.536 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:12.731 INFO:teuthology.orchestra.run.smithi072.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:12.735 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/369 2024-03-24T11:27:12.735 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/369 2024-03-24T11:27:12.735 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:12.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:12.757 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-24T11:27:12.931 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:12.934 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:12.935 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:12.936 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:12.936 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:13.141 INFO:teuthology.orchestra.run.smithi072.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-24T11:27:13.145 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/370 2024-03-24T11:27:13.145 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/370 2024-03-24T11:27:13.145 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:13.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:13.159 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-24T11:27:13.333 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:13.336 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:13.337 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:13.338 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:13.551 INFO:teuthology.orchestra.run.smithi072.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:27:13.555 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/371 2024-03-24T11:27:13.555 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/371 2024-03-24T11:27:13.555 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:13.558 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:13.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:13.573 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-24T11:27:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:13.767 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:13.767 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:13.768 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:14.123 INFO:teuthology.orchestra.run.smithi072.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:14.129 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/372 2024-03-24T11:27:14.129 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/372 2024-03-24T11:27:14.129 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:14.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:14.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:14.516 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-24T11:27:14.693 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:14.697 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:14.697 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:14.698 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:14.698 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:15.053 INFO:teuthology.orchestra.run.smithi072.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:15.059 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/373 2024-03-24T11:27:15.060 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/373 2024-03-24T11:27:15.060 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:15.061 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:15.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:15.414 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-24T11:27:15.603 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:15.607 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:15.607 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:15.608 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:15.909 INFO:teuthology.orchestra.run.smithi072.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-24T11:27:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/374 2024-03-24T11:27:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/374 2024-03-24T11:27:15.968 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:16.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:16.396 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-24T11:27:16.581 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:16.585 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:16.585 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:16.586 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:16.871 INFO:teuthology.orchestra.run.smithi072.stdout:generic/375 0s 2024-03-24T11:27:16.876 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/375 2024-03-24T11:27:16.877 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:16.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:16.930 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-24T11:27:17.286 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:17.289 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:17.290 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:17.299 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:17.299 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:17.541 INFO:teuthology.orchestra.run.smithi072.stdout:generic/376 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:27:17.545 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/376 2024-03-24T11:27:17.545 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/376 2024-03-24T11:27:17.545 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:17.547 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:17.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:17.562 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-24T11:27:17.738 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:17.742 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:17.742 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:17.743 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:17.743 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:18.084 INFO:teuthology.orchestra.run.smithi072.stdout:generic/377 1s 2024-03-24T11:27:18.089 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/377 2024-03-24T11:27:18.090 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:18.092 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:18.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:18.100 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-24T11:27:18.281 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:18.285 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:18.285 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:18.286 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:18.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:18.721 INFO:teuthology.orchestra.run.smithi072.stdout:generic/378 0s 2024-03-24T11:27:18.726 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/378 2024-03-24T11:27:18.727 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:18.729 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:18.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:18.787 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-24T11:27:19.262 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:19.266 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:19.266 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:19.267 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:19.267 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:19.486 INFO:teuthology.orchestra.run.smithi072.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:19.490 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/379 2024-03-24T11:27:19.490 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/379 2024-03-24T11:27:19.490 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:19.492 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:19.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:19.504 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-24T11:27:19.678 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:19.682 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:19.682 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:19.683 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:19.683 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:19.882 INFO:teuthology.orchestra.run.smithi072.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:19.886 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/380 2024-03-24T11:27:19.886 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/380 2024-03-24T11:27:19.886 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:19.888 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:19.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:19.901 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-24T11:27:20.089 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:20.093 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:20.093 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:20.094 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:20.094 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:20.303 INFO:teuthology.orchestra.run.smithi072.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:20.307 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/381 2024-03-24T11:27:20.307 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/381 2024-03-24T11:27:20.307 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:20.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:20.331 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-24T11:27:20.501 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:20.504 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:20.505 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:20.505 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:20.703 INFO:teuthology.orchestra.run.smithi072.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:20.707 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/382 2024-03-24T11:27:20.707 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/382 2024-03-24T11:27:20.707 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:20.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:20.721 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-24T11:27:20.897 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:20.901 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:20.901 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:20.902 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:20.902 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:21.108 INFO:teuthology.orchestra.run.smithi072.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:21.112 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/383 2024-03-24T11:27:21.112 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/383 2024-03-24T11:27:21.112 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:21.114 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:21.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:21.132 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-24T11:27:21.313 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:21.319 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:21.319 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:21.319 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:21.514 INFO:teuthology.orchestra.run.smithi072.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:21.518 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/384 2024-03-24T11:27:21.518 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/384 2024-03-24T11:27:21.518 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:21.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:21.533 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-24T11:27:21.715 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:21.719 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:21.719 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:21.720 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:21.927 INFO:teuthology.orchestra.run.smithi072.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:21.931 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/385 2024-03-24T11:27:21.931 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/385 2024-03-24T11:27:21.931 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:21.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:21.946 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-24T11:27:22.125 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:22.129 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:22.129 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:22.130 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:22.322 INFO:teuthology.orchestra.run.smithi072.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:22.326 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/386 2024-03-24T11:27:22.326 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/386 2024-03-24T11:27:22.327 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:22.328 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:22.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:22.343 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-24T11:27:22.522 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:22.525 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:22.526 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:22.527 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:22.527 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:22.871 INFO:teuthology.orchestra.run.smithi072.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:22.877 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/387 2024-03-24T11:27:22.878 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/387 2024-03-24T11:27:22.878 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:22.881 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:23.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:23.342 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-24T11:27:23.518 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:23.522 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:23.523 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:23.524 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:23.524 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:23.754 INFO:teuthology.orchestra.run.smithi072.stdout:generic/388 [not run] require 172.21.15.72:6789:/scratch to be local device 2024-03-24T11:27:23.757 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/388 2024-03-24T11:27:23.757 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/388 2024-03-24T11:27:23.757 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:23.759 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:23.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:23.772 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-24T11:27:23.944 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:23.948 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:23.948 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:23.949 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:23.949 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:24.165 INFO:teuthology.orchestra.run.smithi072.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-24T11:27:24.169 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/389 2024-03-24T11:27:24.169 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/389 2024-03-24T11:27:24.169 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:24.172 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:24.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:24.184 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-24T11:27:24.367 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:24.371 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:24.371 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:24.372 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:24.372 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:24.601 INFO:teuthology.orchestra.run.smithi072.stdout:generic/390 [not run] ceph does not support freezing 2024-03-24T11:27:24.605 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/390 2024-03-24T11:27:24.605 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/390 2024-03-24T11:27:24.605 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:24.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:24.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:24.622 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-24T11:27:24.808 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:24.811 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:24.812 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:24.813 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:24.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:25.027 INFO:teuthology.orchestra.run.smithi072.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:27:25.031 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/391 2024-03-24T11:27:25.031 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/391 2024-03-24T11:27:25.031 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:25.033 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:25.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:25.064 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-24T11:27:25.244 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:25.247 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:25.248 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:25.249 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:25.249 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:25.518 INFO:teuthology.orchestra.run.smithi072.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-24T11:27:25.527 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/392 2024-03-24T11:27:25.527 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/392 2024-03-24T11:27:25.527 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:25.529 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:25.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:25.552 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-24T11:27:25.731 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:25.735 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:25.736 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:25.736 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:26.362 INFO:teuthology.orchestra.run.smithi072.stdout:generic/393 1s 2024-03-24T11:27:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/393 2024-03-24T11:27:26.367 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:26.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:26.378 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-24T11:27:26.551 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:26.555 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:26.555 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:26.556 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:26.805 INFO:teuthology.orchestra.run.smithi072.stdout:generic/394 0s 2024-03-24T11:27:26.810 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/394 2024-03-24T11:27:26.810 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:26.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:26.868 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-24T11:27:27.387 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:27.391 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:27.391 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:27.392 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:27.392 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:27.761 INFO:teuthology.orchestra.run.smithi072.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-03-24T11:27:27.776 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/395 2024-03-24T11:27:27.776 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/395 2024-03-24T11:27:27.776 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:27.778 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:27.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:27.803 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-24T11:27:28.032 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:28.036 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:28.037 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:28.038 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:28.467 INFO:teuthology.orchestra.run.smithi072.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-03-24T11:27:28.478 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/396 2024-03-24T11:27:28.479 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/396 2024-03-24T11:27:28.479 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:28.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:28.500 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-24T11:27:28.715 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:28.720 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:28.720 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:28.722 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:29.087 INFO:teuthology.orchestra.run.smithi072.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-03-24T11:27:29.095 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/397 2024-03-24T11:27:29.095 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/397 2024-03-24T11:27:29.095 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:29.097 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:29.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:29.120 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-24T11:27:29.295 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:29.299 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:29.299 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:29.300 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:29.300 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:29.622 INFO:teuthology.orchestra.run.smithi072.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-03-24T11:27:29.629 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/398 2024-03-24T11:27:29.629 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/398 2024-03-24T11:27:29.629 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:29.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:29.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:29.657 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-24T11:27:29.832 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:29.835 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:29.836 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:29.837 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:29.837 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:30.161 INFO:teuthology.orchestra.run.smithi072.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-03-24T11:27:30.168 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/399 2024-03-24T11:27:30.168 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/399 2024-03-24T11:27:30.168 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:30.170 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:30.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:30.203 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-24T11:27:30.383 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:30.386 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:30.387 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:30.388 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:30.388 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:30.588 INFO:teuthology.orchestra.run.smithi072.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T11:27:30.592 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/400 2024-03-24T11:27:30.593 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/400 2024-03-24T11:27:30.593 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:30.594 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:30.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:30.619 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-24T11:27:30.790 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:30.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:30.794 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:30.795 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:30.795 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:31.259 INFO:teuthology.orchestra.run.smithi072.stdout:generic/401 1s 2024-03-24T11:27:31.272 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/401 2024-03-24T11:27:31.272 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:31.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:31.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:31.287 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-24T11:27:31.631 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:31.635 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:31.635 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:31.636 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:31.636 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:31.950 INFO:teuthology.orchestra.run.smithi072.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-24T11:27:31.959 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/402 2024-03-24T11:27:31.959 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/402 2024-03-24T11:27:31.959 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:31.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:31.973 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-24T11:27:32.156 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:32.160 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:32.160 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:32.161 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:32.606 INFO:teuthology.orchestra.run.smithi072.stdout:generic/403 0s 2024-03-24T11:27:32.611 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/403 2024-03-24T11:27:32.611 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:32.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:32.622 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-24T11:27:32.808 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:32.812 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:32.812 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:32.813 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:33.025 INFO:teuthology.orchestra.run.smithi072.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:27:33.029 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/404 2024-03-24T11:27:33.030 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/404 2024-03-24T11:27:33.030 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:33.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:33.062 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-24T11:27:33.251 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:33.255 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:33.255 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:33.256 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:33.256 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:33.489 INFO:teuthology.orchestra.run.smithi072.stdout:generic/405 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:27:33.493 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/405 2024-03-24T11:27:33.493 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/405 2024-03-24T11:27:33.493 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:33.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:33.508 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-24T11:27:33.689 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:33.693 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:33.693 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:33.694 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:33.694 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:35.245 INFO:teuthology.orchestra.run.smithi072.stdout:generic/406 2s 2024-03-24T11:27:35.250 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/406 2024-03-24T11:27:35.250 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:35.252 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:35.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:35.261 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-24T11:27:35.451 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:35.455 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:35.455 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:35.456 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:35.456 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:35.754 INFO:teuthology.orchestra.run.smithi072.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/407 2024-03-24T11:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/407 2024-03-24T11:27:35.758 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:35.760 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:35.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:35.851 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-24T11:27:36.200 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:36.204 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:36.204 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:36.205 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:36.206 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:36.465 INFO:teuthology.orchestra.run.smithi072.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T11:27:36.469 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/408 2024-03-24T11:27:36.469 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/408 2024-03-24T11:27:36.469 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:36.471 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:36.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:36.543 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-24T11:27:36.938 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:36.941 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:36.942 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:36.943 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:37.147 INFO:teuthology.orchestra.run.smithi072.stdout:generic/409 [not run] require 172.21.15.72:6789:/scratch to be local device 2024-03-24T11:27:37.151 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/409 2024-03-24T11:27:37.151 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/409 2024-03-24T11:27:37.151 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:37.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:37.179 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-24T11:27:37.357 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:37.360 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:37.361 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:37.362 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:37.362 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:37.571 INFO:teuthology.orchestra.run.smithi072.stdout:generic/410 [not run] require 172.21.15.72:6789:/scratch to be local device 2024-03-24T11:27:37.574 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/410 2024-03-24T11:27:37.575 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/410 2024-03-24T11:27:37.575 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:37.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:37.589 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-24T11:27:37.777 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:37.780 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:37.781 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:37.782 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:37.997 INFO:teuthology.orchestra.run.smithi072.stdout:generic/411 [not run] require 172.21.15.72:6789:/scratch to be local device 2024-03-24T11:27:38.001 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/411 2024-03-24T11:27:38.001 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/411 2024-03-24T11:27:38.001 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:38.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:38.016 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-24T11:27:38.209 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:38.212 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:38.213 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:38.214 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:38.659 INFO:teuthology.orchestra.run.smithi072.stdout:generic/412 0s 2024-03-24T11:27:38.664 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/412 2024-03-24T11:27:38.664 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:38.666 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:38.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:38.675 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-24T11:27:38.853 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:38.857 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:38.857 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:38.858 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:39.128 INFO:teuthology.orchestra.run.smithi072.stdout:generic/413 [not run] mount 172.21.15.72:6789:/scratch with dax failed 2024-03-24T11:27:39.132 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/413 2024-03-24T11:27:39.132 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/413 2024-03-24T11:27:39.132 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:39.134 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:39.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:39.147 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-24T11:27:39.327 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:39.331 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:39.331 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:39.332 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:39.332 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:39.691 INFO:teuthology.orchestra.run.smithi072.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/414 2024-03-24T11:27:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/414 2024-03-24T11:27:39.697 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:39.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:40.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:40.151 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-24T11:27:40.332 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:40.335 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:40.336 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:40.337 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:40.337 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:40.696 INFO:teuthology.orchestra.run.smithi072.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:27:40.702 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/415 2024-03-24T11:27:40.702 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/415 2024-03-24T11:27:40.702 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:40.705 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:41.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:41.083 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-24T11:27:41.268 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:41.272 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:41.272 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:41.273 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:41.273 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:41.489 INFO:teuthology.orchestra.run.smithi072.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:27:41.493 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/416 2024-03-24T11:27:41.493 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/416 2024-03-24T11:27:41.493 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:41.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:41.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:41.508 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-24T11:27:41.694 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:41.698 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:41.698 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:41.699 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:41.699 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:41.966 INFO:teuthology.orchestra.run.smithi072.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-24T11:27:41.973 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/417 2024-03-24T11:27:41.973 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/417 2024-03-24T11:27:41.973 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:41.976 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:42.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:42.001 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-24T11:27:42.174 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:42.178 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:42.178 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:42.179 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:42.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:42.411 INFO:teuthology.orchestra.run.smithi072.stdout:generic/418 [not run] require 172.21.15.72:6789:/test to be valid block disk 2024-03-24T11:27:42.415 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/418 2024-03-24T11:27:42.415 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/418 2024-03-24T11:27:42.415 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:42.417 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:42.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:42.454 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-24T11:27:42.632 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:42.636 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:42.636 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:42.637 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:42.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:42.947 INFO:teuthology.orchestra.run.smithi072.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-03-24T11:27:42.954 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/419 2024-03-24T11:27:42.954 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/419 2024-03-24T11:27:42.954 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:42.956 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:42.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:42.989 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-24T11:27:43.166 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:43.170 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:43.170 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:43.171 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:43.502 INFO:teuthology.orchestra.run.smithi072.stdout:generic/420 0s 2024-03-24T11:27:43.507 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/420 2024-03-24T11:27:43.507 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:43.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:43.579 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-24T11:27:43.984 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:43.987 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:43.988 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:43.989 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:43.989 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:44.311 INFO:teuthology.orchestra.run.smithi072.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-03-24T11:27:44.320 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/421 2024-03-24T11:27:44.320 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/421 2024-03-24T11:27:44.320 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:44.322 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:44.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:44.356 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-24T11:27:44.539 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:44.543 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:44.543 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:44.544 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:44.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:44.773 INFO:teuthology.orchestra.run.smithi072.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T11:27:44.777 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/422 2024-03-24T11:27:44.778 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/422 2024-03-24T11:27:44.778 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:44.779 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:44.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:44.796 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-24T11:27:44.970 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:44.974 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:44.974 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:44.975 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:44.975 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:45.345 INFO:teuthology.orchestra.run.smithi072.stdout:generic/423 0s 2024-03-24T11:27:45.459 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/423 2024-03-24T11:27:45.459 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:45.461 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:45.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:45.523 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-24T11:27:45.946 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:45.950 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:45.950 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:45.951 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:45.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:46.257 INFO:teuthology.orchestra.run.smithi072.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-24T11:27:46.261 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/424 2024-03-24T11:27:46.261 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/424 2024-03-24T11:27:46.261 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:46.263 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:46.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:46.279 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-24T11:27:46.453 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:46.457 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:46.458 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:46.459 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:46.699 INFO:teuthology.orchestra.run.smithi072.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-24T11:27:46.702 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/425 2024-03-24T11:27:46.702 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/425 2024-03-24T11:27:46.702 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:27:46.704 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:27:46.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:27:46.764 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-24T11:27:47.116 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:27:47.120 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:27:47.121 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:27:47.122 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:27:47.122 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:14.287 INFO:teuthology.orchestra.run.smithi072.stdout:generic/426 27s 2024-03-24T11:28:14.425 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/426 2024-03-24T11:28:14.425 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:14.428 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:14.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:14.704 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-24T11:28:15.143 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:28:15.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:28:15.177 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T11:28:15.176+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50342) UID: 0 2024-03-24T11:28:15.177 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T11:28:15.176+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50342) UID: 0 2024-03-24T11:28:15.177 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T11:28:15.176+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50342) UID: 0 2024-03-24T11:28:15.178 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T11:28:15.176+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50342) UID: 0 2024-03-24T11:28:15.525 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T11:28:15.524+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 358711) UID: 0 2024-03-24T11:28:15.525 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T11:28:15.524+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 358711) UID: 0 2024-03-24T11:28:15.526 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T11:28:15.524+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 358711) UID: 0 2024-03-24T11:28:15.526 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T11:28:15.524+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 358711) UID: 0 2024-03-24T11:28:17.201 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:17.205 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:17.205 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:17.206 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:17.206 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:17.670 INFO:teuthology.orchestra.run.smithi072.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:28:17.674 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/427 2024-03-24T11:28:17.674 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/427 2024-03-24T11:28:17.674 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:17.676 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:17.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:17.693 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-24T11:28:17.868 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:17.872 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:17.872 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:17.873 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:17.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:18.125 INFO:teuthology.orchestra.run.smithi072.stdout:generic/428 1s 2024-03-24T11:28:18.131 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/428 2024-03-24T11:28:18.131 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:18.133 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:18.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:18.151 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-24T11:28:18.347 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:18.351 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:18.351 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:18.352 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:18.352 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:18.723 INFO:teuthology.orchestra.run.smithi072.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-03-24T11:28:18.731 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/429 2024-03-24T11:28:18.731 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/429 2024-03-24T11:28:18.731 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:18.733 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:18.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:18.746 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-24T11:28:18.926 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:18.930 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:18.930 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:18.931 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:18.931 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:19.288 INFO:teuthology.orchestra.run.smithi072.stdout:generic/430 0s 2024-03-24T11:28:19.293 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/430 2024-03-24T11:28:19.294 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:19.296 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:19.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:19.387 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-24T11:28:19.760 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:19.764 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:19.765 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:19.766 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:19.766 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:20.064 INFO:teuthology.orchestra.run.smithi072.stdout:generic/431 1s 2024-03-24T11:28:20.069 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/431 2024-03-24T11:28:20.069 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:20.072 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:20.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:20.144 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-24T11:28:20.517 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:20.521 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:20.521 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:20.522 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:20.863 INFO:teuthology.orchestra.run.smithi072.stdout:generic/432 0s 2024-03-24T11:28:20.868 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/432 2024-03-24T11:28:20.868 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:20.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:20.941 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-24T11:28:21.322 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:21.325 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:21.326 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:21.327 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:21.625 INFO:teuthology.orchestra.run.smithi072.stdout:generic/433 0s 2024-03-24T11:28:21.630 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/433 2024-03-24T11:28:21.630 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:21.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:21.696 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-24T11:28:22.107 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:22.111 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:22.111 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:22.112 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:22.427 INFO:teuthology.orchestra.run.smithi072.stdout:generic/434 0s 2024-03-24T11:28:22.432 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/434 2024-03-24T11:28:22.432 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:22.434 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:22.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:22.498 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-24T11:28:22.909 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:22.913 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:22.913 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:22.914 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:22.914 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:23.235 INFO:teuthology.orchestra.run.smithi072.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-03-24T11:28:23.244 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/435 2024-03-24T11:28:23.244 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/435 2024-03-24T11:28:23.244 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:23.246 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:23.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:23.260 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-24T11:28:23.447 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:23.451 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:23.451 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:23.452 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:23.452 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:24.008 INFO:teuthology.orchestra.run.smithi072.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:28:24.012 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/436 2024-03-24T11:28:24.012 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/436 2024-03-24T11:28:24.012 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:24.014 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:24.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:24.088 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-24T11:28:24.473 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:24.476 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:24.477 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:24.478 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:24.478 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:25.369 INFO:teuthology.orchestra.run.smithi072.stdout:generic/437 1s 2024-03-24T11:28:25.374 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/437 2024-03-24T11:28:25.374 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:28:25.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:28:25.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:28:25.396 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-24T11:28:25.568 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:28:25.572 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:28:25.573 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:28:25.573 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:28:25.574 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:35.519 INFO:teuthology.orchestra.run.smithi072.stdout:generic/438 70s 2024-03-24T11:29:35.524 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/438 2024-03-24T11:29:35.524 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:35.526 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:35.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:35.543 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-24T11:29:35.723 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:35.726 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:35.727 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:35.730 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:35.730 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:36.593 INFO:teuthology.orchestra.run.smithi072.stdout:generic/439 1s 2024-03-24T11:29:36.599 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/439 2024-03-24T11:29:36.599 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:36.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:36.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:36.616 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-24T11:29:36.817 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:36.821 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:36.821 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:36.822 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:36.822 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:37.169 INFO:teuthology.orchestra.run.smithi072.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-03-24T11:29:37.176 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/440 2024-03-24T11:29:37.176 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/440 2024-03-24T11:29:37.176 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:37.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:37.192 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-24T11:29:37.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:37.374 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:37.374 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:37.375 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:37.375 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:37.727 INFO:teuthology.orchestra.run.smithi072.stdout:generic/441 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:29:37.731 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/441 2024-03-24T11:29:37.731 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/441 2024-03-24T11:29:37.731 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:37.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:37.749 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-24T11:29:37.941 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:37.945 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:37.945 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:37.946 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:38.173 INFO:teuthology.orchestra.run.smithi072.stdout:generic/442 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:29:38.177 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/442 2024-03-24T11:29:38.177 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/442 2024-03-24T11:29:38.177 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:38.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:38.192 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-24T11:29:38.367 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:38.371 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:38.371 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:38.372 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:38.372 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:38.630 INFO:teuthology.orchestra.run.smithi072.stdout:generic/443 0s 2024-03-24T11:29:38.635 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/443 2024-03-24T11:29:38.635 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:38.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:38.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:38.656 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-24T11:29:38.833 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:38.837 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:38.837 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:38.838 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:39.185 INFO:teuthology.orchestra.run.smithi072.stdout:generic/444 1s 2024-03-24T11:29:39.190 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/444 2024-03-24T11:29:39.190 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:39.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:39.210 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-24T11:29:39.394 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:39.398 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:39.398 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:39.399 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:39.904 INFO:teuthology.orchestra.run.smithi072.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:29:39.908 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/445 2024-03-24T11:29:39.908 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/445 2024-03-24T11:29:39.908 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:39.910 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:39.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:39.944 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-24T11:29:40.364 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:40.368 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:40.368 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:40.369 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:40.369 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:57.260 INFO:teuthology.orchestra.run.smithi072.stdout:generic/446 17s 2024-03-24T11:29:57.303 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/446 2024-03-24T11:29:57.304 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:57.307 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:57.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:57.320 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-24T11:29:57.565 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:57.568 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:57.569 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:57.570 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:57.570 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:58.062 INFO:teuthology.orchestra.run.smithi072.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/447 2024-03-24T11:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/447 2024-03-24T11:29:58.072 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:58.074 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:58.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:58.259 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-24T11:29:58.468 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:58.472 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:58.472 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:58.473 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:58.473 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:59.408 INFO:teuthology.orchestra.run.smithi072.stdout:generic/448 1s 2024-03-24T11:29:59.413 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/448 2024-03-24T11:29:59.413 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:29:59.415 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:29:59.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:29:59.452 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-24T11:29:59.880 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:29:59.884 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:29:59.884 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:29:59.885 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:29:59.885 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:00.161 INFO:teuthology.orchestra.run.smithi072.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T11:30:00.165 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/449 2024-03-24T11:30:00.165 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/449 2024-03-24T11:30:00.165 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:00.167 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:00.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:00.226 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-24T11:30:00.612 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:00.617 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:00.617 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:01.283 INFO:teuthology.orchestra.run.smithi072.stdout:generic/450 1s 2024-03-24T11:30:01.288 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/450 2024-03-24T11:30:01.288 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:01.290 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:01.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:01.341 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-24T11:30:01.721 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:01.725 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:01.725 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:01.726 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:01.726 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:32.079 INFO:teuthology.orchestra.run.smithi072.stdout:generic/451 31s 2024-03-24T11:30:32.084 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/451 2024-03-24T11:30:32.084 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:32.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:32.150 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-24T11:30:32.548 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:32.552 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:32.552 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:32.553 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:33.454 INFO:teuthology.orchestra.run.smithi072.stdout:generic/452 1s 2024-03-24T11:30:33.465 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/452 2024-03-24T11:30:33.465 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:33.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:33.477 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-24T11:30:33.860 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:33.864 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:33.864 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:33.864 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:33.865 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:34.224 INFO:teuthology.orchestra.run.smithi072.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-24T11:30:34.228 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/453 2024-03-24T11:30:34.228 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/453 2024-03-24T11:30:34.228 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:34.230 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:34.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:34.243 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-24T11:30:34.512 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:34.516 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:34.517 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:34.518 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:34.518 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:35.113 INFO:teuthology.orchestra.run.smithi072.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-24T11:30:35.117 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/454 2024-03-24T11:30:35.117 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/454 2024-03-24T11:30:35.117 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:35.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:35.139 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-24T11:30:35.308 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:35.312 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:35.313 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:35.314 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:35.314 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:35.797 INFO:teuthology.orchestra.run.smithi072.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-24T11:30:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/455 2024-03-24T11:30:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/455 2024-03-24T11:30:35.800 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:35.803 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:35.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:35.818 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-24T11:30:36.003 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:36.007 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:36.007 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:36.009 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:36.009 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:36.306 INFO:teuthology.orchestra.run.smithi072.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T11:30:36.310 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/456 2024-03-24T11:30:36.310 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/456 2024-03-24T11:30:36.310 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:36.312 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:36.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:36.328 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-24T11:30:36.499 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:36.502 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:36.503 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:36.504 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:36.504 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:36.959 INFO:teuthology.orchestra.run.smithi072.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:30:36.965 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/457 2024-03-24T11:30:36.965 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/457 2024-03-24T11:30:36.965 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:37.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:37.167 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-24T11:30:37.355 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:37.359 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:37.359 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:37.360 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:37.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:37.732 INFO:teuthology.orchestra.run.smithi072.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T11:30:37.739 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/458 2024-03-24T11:30:37.739 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/458 2024-03-24T11:30:37.739 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:37.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:37.983 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-24T11:30:38.200 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:38.204 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:38.204 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:38.205 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:39.183 INFO:teuthology.orchestra.run.smithi072.stdout:generic/459 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:30:39.187 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/459 2024-03-24T11:30:39.187 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/459 2024-03-24T11:30:39.187 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:39.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:39.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:39.206 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-24T11:30:39.380 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:39.384 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:39.384 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:39.385 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:41.104 INFO:teuthology.orchestra.run.smithi072.stdout:generic/460 2s 2024-03-24T11:30:41.109 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/460 2024-03-24T11:30:41.109 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:41.111 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:41.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:41.119 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-24T11:30:41.308 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:41.311 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:41.312 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:41.313 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:41.313 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:41.641 INFO:teuthology.orchestra.run.smithi072.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-24T11:30:41.644 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/461 2024-03-24T11:30:41.645 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/461 2024-03-24T11:30:41.645 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:41.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:41.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:41.672 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-24T11:30:41.904 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:41.911 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:41.911 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:41.913 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:42.264 INFO:teuthology.orchestra.run.smithi072.stdout:generic/462 [not run] mount 172.21.15.72:6789:/scratch with dax failed 2024-03-24T11:30:42.267 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/462 2024-03-24T11:30:42.267 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/462 2024-03-24T11:30:42.267 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:42.270 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:42.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:42.294 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-24T11:30:42.470 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:42.473 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:42.474 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:42.475 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:42.475 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:42.746 INFO:teuthology.orchestra.run.smithi072.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-24T11:30:42.750 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/463 2024-03-24T11:30:42.750 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/463 2024-03-24T11:30:42.750 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:30:42.753 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:30:42.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:30:42.802 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-24T11:30:43.184 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:30:43.187 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:30:43.188 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:30:43.189 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:30:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:31:39.333 INFO:teuthology.orchestra.run.smithi072.stdout:generic/464 56s 2024-03-24T11:31:39.358 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/464 2024-03-24T11:31:39.358 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:31:39.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:31:39.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:31:39.369 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-24T11:31:39.554 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:31:39.558 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:31:39.558 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:31:39.559 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:31:39.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:31:44.124 INFO:teuthology.orchestra.run.smithi072.stdout:generic/465 4s 2024-03-24T11:31:44.159 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/465 2024-03-24T11:31:44.159 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:31:44.162 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:31:44.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:31:44.175 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-24T11:31:44.540 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:31:44.543 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:31:44.544 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:31:44.545 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:31:44.545 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:31:44.807 INFO:teuthology.orchestra.run.smithi072.stdout:generic/466 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:31:44.811 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/466 2024-03-24T11:31:44.811 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/466 2024-03-24T11:31:44.811 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:31:44.813 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:31:44.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:31:44.828 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-24T11:31:45.025 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:31:45.029 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:31:45.029 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:31:45.030 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:31:45.030 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:04.061 INFO:teuthology.orchestra.run.smithi072.stdout:generic/467 18s 2024-03-24T11:32:04.357 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/467 2024-03-24T11:32:04.357 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:32:04.360 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:04.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:32:04.701 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-24T11:32:08.874 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:32:08.878 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:32:08.879 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:32:08.879 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:32:08.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:09.387 INFO:teuthology.orchestra.run.smithi072.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-24T11:32:09.395 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/468 2024-03-24T11:32:09.395 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/468 2024-03-24T11:32:09.395 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:32:09.397 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:09.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:32:09.410 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-24T11:32:09.589 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:32:09.592 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:32:09.593 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:32:09.593 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:32:09.594 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:09.843 INFO:teuthology.orchestra.run.smithi072.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T11:32:09.847 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/469 2024-03-24T11:32:09.847 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/469 2024-03-24T11:32:09.847 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:32:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:09.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:32:09.867 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-24T11:32:10.074 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:32:10.078 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:32:10.078 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:32:10.079 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:32:10.079 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:10.455 INFO:teuthology.orchestra.run.smithi072.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-24T11:32:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/470 2024-03-24T11:32:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/470 2024-03-24T11:32:10.458 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:32:10.461 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:32:10.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:32:10.474 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-24T11:32:10.659 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:32:10.662 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:32:10.663 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:32:10.664 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:32:10.664 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:01.373 INFO:teuthology.orchestra.run.smithi072.stdout:generic/471 51s 2024-03-24T11:33:01.378 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/471 2024-03-24T11:33:01.378 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:33:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:01.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:33:01.441 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-24T11:33:01.790 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:33:01.794 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:33:01.795 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:33:01.796 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:33:01.796 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:02.479 INFO:teuthology.orchestra.run.smithi072.stdout:generic/472 [not run] swapfiles are not supported 2024-03-24T11:33:02.482 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/472 2024-03-24T11:33:02.483 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/472 2024-03-24T11:33:02.483 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:33:02.485 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:02.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:33:02.503 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-24T11:33:02.693 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:33:02.697 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:33:02.697 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:33:02.698 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:33:02.698 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:02.968 INFO:teuthology.orchestra.run.smithi072.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-24T11:33:02.972 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/473 2024-03-24T11:33:02.972 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/473 2024-03-24T11:33:02.972 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:33:02.974 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:02.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:33:02.992 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-24T11:33:03.170 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:33:03.174 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:33:03.174 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:33:03.175 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:33:03.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:03.472 INFO:teuthology.orchestra.run.smithi072.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-24T11:33:03.481 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/474 2024-03-24T11:33:03.481 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/474 2024-03-24T11:33:03.481 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:33:03.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:03.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:33:03.495 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-24T11:33:03.680 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:33:03.684 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:33:03.684 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:33:03.685 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:33:03.685 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:03.927 INFO:teuthology.orchestra.run.smithi072.stdout:generic/475 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T11:33:03.931 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/475 2024-03-24T11:33:03.931 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/475 2024-03-24T11:33:03.931 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T11:33:03.933 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:03.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T11:33:03.946 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-24T11:33:04.120 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T11:33:04.124 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T11:33:04.124 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T11:33:04.125 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T11:33:04.125 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T11:33:06.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:33:06.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:33:06.770 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T11:33:06.770+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50366) UID: 0 2024-03-24T11:33:06.771 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T11:33:06.770+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50366) UID: 0 2024-03-24T11:33:07.794 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T11:33:07.794+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579311) UID: 0 2024-03-24T11:33:07.795 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T11:33:07.794+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579311) UID: 0 2024-03-24T11:33:07.795 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T11:33:07.794+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579311) UID: 0 2024-03-24T11:33:08.017 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T11:33:07.794+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579311) UID: 0 2024-03-24T11:40:35.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:40:35.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:40:35.608 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T11:40:35.607+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50508) UID: 0 2024-03-24T11:40:35.609 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T11:40:35.607+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50508) UID: 0 2024-03-24T11:40:35.610 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T11:40:35.607+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50508) UID: 0 2024-03-24T11:40:35.610 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T11:40:35.608+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50508) UID: 0 2024-03-24T11:40:35.919 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T11:40:35.918+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579581) UID: 0 2024-03-24T11:40:35.920 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T11:40:35.919+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579581) UID: 0 2024-03-24T11:40:35.921 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T11:40:35.918+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579581) UID: 0 2024-03-24T11:40:35.931 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T11:40:35.927+0000 7fb0e9de8640 -1 received signal: Hangup from (PID: 579581) UID: 0 2024-03-24T11:47:57.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:47:57.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:47:57.167 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T11:47:57.166+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579686) UID: 0 2024-03-24T11:47:57.167 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T11:47:57.166+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579686) UID: 0 2024-03-24T11:47:57.168 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T11:47:57.166+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579686) UID: 0 2024-03-24T11:47:57.168 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T11:47:57.166+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579686) UID: 0 2024-03-24T11:55:25.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:55:25.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T11:55:25.052 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T11:55:25.052+0000 7f4da498b640 -1 received signal: Hangup from (PID: 50656) UID: 0 2024-03-24T11:55:25.053 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T11:55:25.052+0000 7f0189492640 -1 received signal: Hangup from (PID: 50656) UID: 0 2024-03-24T12:01:35.236 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T12:01:35.236+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50709) UID: 0 2024-03-24T12:01:35.237 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T12:01:35.236+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50709) UID: 0 2024-03-24T12:01:35.237 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T12:01:35.236+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50709) UID: 0 2024-03-24T12:01:35.240 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T12:01:35.240+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50709) UID: 0 2024-03-24T12:13:56.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T12:13:56.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T12:13:56.505 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T12:13:56.506+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50846) UID: 0 2024-03-24T12:13:56.506 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T12:13:56.506+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50846) UID: 0 2024-03-24T12:13:56.814 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T12:13:56.815+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579992) UID: 0 2024-03-24T12:13:56.815 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T12:13:56.815+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579992) UID: 0 2024-03-24T12:13:56.815 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T12:13:56.815+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579992) UID: 0 2024-03-24T12:13:56.820 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T12:13:56.815+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579992) UID: 0 2024-03-24T12:21:12.488 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T12:21:12.487+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50927) UID: 0 2024-03-24T12:21:12.496 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T12:21:12.485+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50927) UID: 0 2024-03-24T12:21:12.499 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T12:21:12.493+0000 7f1f3eedb640 -1 Fail to open '/proc/50927/cmdline' error = (2) No such file or directory 2024-03-24T12:21:12.499 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T12:21:12.493+0000 7f1f3eedb640 -1 received signal: Hangup from (PID: 50927) UID: 0 2024-03-24T12:21:12.512 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T12:21:12.509+0000 7f5907ae3640 -1 Fail to open '/proc/50927/cmdline' error = (2) No such file or directory 2024-03-24T12:21:12.512 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T12:21:12.509+0000 7f5907ae3640 -1 received signal: Hangup from (PID: 50927) UID: 0 2024-03-24T12:27:35.205 INFO:teuthology.orchestra.run.smithi079.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-03-24T12:27:35.206 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: stdin: file size changed while zipping 2024-03-24T12:32:49.031 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T12:32:49.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T12:32:49.084 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T12:32:49.087+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51140) UID: 0 2024-03-24T12:32:49.084 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T12:32:49.088+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51140) UID: 0 2024-03-24T12:32:49.692 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T12:32:49.695+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580198) UID: 0 2024-03-24T12:32:49.692 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T12:32:49.695+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580198) UID: 0 2024-03-24T12:32:49.693 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T12:32:49.695+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580198) UID: 0 2024-03-24T12:32:49.693 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T12:32:49.695+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580198) UID: 0 2024-03-24T12:40:10.047 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T12:40:10.049+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51234) UID: 0 2024-03-24T12:40:10.048 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T12:40:10.052+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51234) UID: 0 2024-03-24T12:40:10.048 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T12:40:10.052+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51234) UID: 0 2024-03-24T12:40:10.048 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T12:40:10.052+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51234) UID: 0 2024-03-24T12:51:29.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T12:51:29.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T12:51:29.738 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T12:51:29.742+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51405) UID: 0 2024-03-24T12:51:29.738 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T12:51:29.742+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51405) UID: 0 2024-03-24T12:51:30.054 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T12:51:30.058+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580528) UID: 0 2024-03-24T12:51:30.055 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T12:51:30.059+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580528) UID: 0 2024-03-24T12:51:30.058 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T12:51:30.058+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580528) UID: 0 2024-03-24T12:51:30.060 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T12:51:30.059+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580528) UID: 0 2024-03-24T12:59:08.361 INFO:teuthology.orchestra.run.smithi072.stdout:generic/476 5164s 2024-03-24T12:59:08.461 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/476 2024-03-24T12:59:08.462 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T12:59:08.464 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T12:59:08.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T12:59:08.480 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-24T12:59:14.848 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T12:59:14.851 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T12:59:14.851 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T12:59:14.852 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T12:59:14.853 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:01:11.810 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T13:01:11.814+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51531) UID: 0 2024-03-24T13:01:11.811 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T13:01:11.815+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51531) UID: 0 2024-03-24T13:01:11.812 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T13:01:11.815+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51531) UID: 0 2024-03-24T13:01:11.812 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T13:01:11.815+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51531) UID: 0 2024-03-24T13:07:11.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:07:11.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:07:11.888 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T13:07:11.893+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51555) UID: 0 2024-03-24T13:07:11.889 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T13:07:11.894+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51555) UID: 0 2024-03-24T13:07:12.002 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T13:07:12.007+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581193) UID: 0 2024-03-24T13:07:12.003 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T13:07:12.007+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581193) UID: 0 2024-03-24T13:07:12.003 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T13:07:12.007+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581193) UID: 0 2024-03-24T13:07:12.003 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T13:07:12.007+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581193) UID: 0 2024-03-24T13:07:41.092 INFO:teuthology.orchestra.run.smithi072.stdout:generic/477 40s 2024-03-24T13:07:41.400 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/477 2024-03-24T13:07:41.400 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:07:41.402 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:41.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:07:41.766 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-24T13:07:46.199 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:07:46.203 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:07:46.204 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:07:46.205 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:07:46.205 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:56.896 INFO:teuthology.orchestra.run.smithi072.stdout:generic/478 10s 2024-03-24T13:07:56.902 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/478 2024-03-24T13:07:56.903 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:07:56.905 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:56.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:07:56.932 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-24T13:07:57.190 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:07:57.194 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:07:57.194 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:07:57.195 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:07:57.195 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:57.846 INFO:teuthology.orchestra.run.smithi072.stdout:generic/479 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:07:57.851 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/479 2024-03-24T13:07:57.851 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/479 2024-03-24T13:07:57.851 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:07:57.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:57.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:07:57.891 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-24T13:07:58.125 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:07:58.130 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:07:58.130 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:07:58.131 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:07:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:58.480 INFO:teuthology.orchestra.run.smithi072.stdout:generic/480 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:07:58.484 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/480 2024-03-24T13:07:58.484 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/480 2024-03-24T13:07:58.484 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:07:58.491 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:58.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:07:58.523 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-24T13:07:58.786 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:07:58.791 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:07:58.792 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:07:58.793 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:07:58.793 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:59.113 INFO:teuthology.orchestra.run.smithi072.stdout:generic/481 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:07:59.118 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/481 2024-03-24T13:07:59.118 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/481 2024-03-24T13:07:59.119 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:07:59.121 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:59.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:07:59.145 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-24T13:07:59.464 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:07:59.468 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:07:59.469 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:07:59.469 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:07:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:59.951 INFO:teuthology.orchestra.run.smithi072.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-24T13:07:59.956 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/482 2024-03-24T13:07:59.956 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/482 2024-03-24T13:07:59.956 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:07:59.961 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:07:59.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:07:59.994 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-24T13:08:00.242 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:00.247 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:00.247 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:00.248 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:00.248 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:00.616 INFO:teuthology.orchestra.run.smithi072.stdout:generic/483 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/483 2024-03-24T13:08:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/483 2024-03-24T13:08:00.623 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:00.628 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:00.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:00.648 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-24T13:08:00.928 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:00.933 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:00.937 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:00.938 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:00.938 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:01.286 INFO:teuthology.orchestra.run.smithi072.stdout:generic/484 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:01.291 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/484 2024-03-24T13:08:01.291 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/484 2024-03-24T13:08:01.291 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:01.295 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:01.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:01.318 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-24T13:08:01.580 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:01.586 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:01.586 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:01.587 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:01.908 INFO:teuthology.orchestra.run.smithi072.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T13:08:01.913 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/485 2024-03-24T13:08:01.913 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/485 2024-03-24T13:08:01.913 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:01.915 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:01.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:01.951 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-24T13:08:02.208 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:02.212 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:02.212 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:02.213 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:02.864 INFO:teuthology.orchestra.run.smithi072.stdout:generic/486 0s 2024-03-24T13:08:02.870 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/486 2024-03-24T13:08:02.870 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:02.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:02.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:02.882 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-24T13:08:03.134 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:03.138 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:03.138 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:03.139 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:03.139 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:03.482 INFO:teuthology.orchestra.run.smithi072.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-24T13:08:03.486 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/487 2024-03-24T13:08:03.486 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/487 2024-03-24T13:08:03.486 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:03.489 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:03.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:03.510 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-24T13:08:03.763 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:03.768 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:03.768 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:03.769 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:03.769 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:04.089 INFO:teuthology.orchestra.run.smithi072.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-24T13:08:04.094 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/488 2024-03-24T13:08:04.094 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/488 2024-03-24T13:08:04.094 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:04.096 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:04.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:04.122 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-24T13:08:04.370 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:04.374 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:04.374 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:04.375 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:04.376 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:04.692 INFO:teuthology.orchestra.run.smithi072.stdout:generic/489 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:04.697 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/489 2024-03-24T13:08:04.697 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/489 2024-03-24T13:08:04.698 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:04.700 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:04.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:04.719 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-24T13:08:04.952 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:04.957 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:04.957 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:04.958 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:04.959 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:07.738 INFO:teuthology.orchestra.run.smithi072.stdout:generic/490 2s 2024-03-24T13:08:07.765 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/490 2024-03-24T13:08:07.765 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:07.767 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:07.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:07.856 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-24T13:08:08.271 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:08.275 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:08.276 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:08.277 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:08.277 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:08.868 INFO:teuthology.orchestra.run.smithi072.stdout:generic/491 [not run] ceph does not support freezing 2024-03-24T13:08:08.872 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/491 2024-03-24T13:08:08.872 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/491 2024-03-24T13:08:08.872 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:08.874 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:08.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:08.894 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-24T13:08:09.130 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:09.135 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:09.136 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:09.137 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:09.137 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:09.464 INFO:teuthology.orchestra.run.smithi072.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-24T13:08:09.468 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/492 2024-03-24T13:08:09.469 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/492 2024-03-24T13:08:09.469 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:09.471 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:09.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:09.491 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-24T13:08:09.730 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:09.734 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:09.734 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:09.735 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:10.383 INFO:teuthology.orchestra.run.smithi072.stdout:generic/493 [not run] swapfiles are not supported 2024-03-24T13:08:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/493 2024-03-24T13:08:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/493 2024-03-24T13:08:10.387 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:10.392 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:10.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:10.418 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-24T13:08:10.652 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:10.660 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:10.660 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:10.661 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:10.662 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:11.206 INFO:teuthology.orchestra.run.smithi072.stdout:generic/494 [not run] swapfiles are not supported 2024-03-24T13:08:11.210 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/494 2024-03-24T13:08:11.210 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/494 2024-03-24T13:08:11.210 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:11.212 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:11.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:11.243 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-24T13:08:11.498 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:11.502 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:11.503 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:11.504 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:11.504 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:12.027 INFO:teuthology.orchestra.run.smithi072.stdout:generic/495 [not run] swapfiles are not supported 2024-03-24T13:08:12.036 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/495 2024-03-24T13:08:12.036 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/495 2024-03-24T13:08:12.036 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:12.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:12.079 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-24T13:08:12.319 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:12.324 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:12.324 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:12.325 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:12.325 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:12.876 INFO:teuthology.orchestra.run.smithi072.stdout:generic/496 [not run] swapfiles are not supported 2024-03-24T13:08:12.882 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/496 2024-03-24T13:08:12.882 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/496 2024-03-24T13:08:12.882 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:12.886 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:12.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:12.914 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-24T13:08:13.169 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:13.173 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:13.173 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:13.174 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:13.699 INFO:teuthology.orchestra.run.smithi072.stdout:generic/497 [not run] swapfiles are not supported 2024-03-24T13:08:13.704 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/497 2024-03-24T13:08:13.704 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/497 2024-03-24T13:08:13.704 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:13.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:13.744 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-24T13:08:13.990 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:13.994 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:13.995 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:13.996 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:13.996 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:14.344 INFO:teuthology.orchestra.run.smithi072.stdout:generic/498 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:14.348 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/498 2024-03-24T13:08:14.348 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/498 2024-03-24T13:08:14.348 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:14.350 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:14.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:14.388 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-24T13:08:14.638 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:14.644 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:14.645 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:14.646 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:14.646 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:14.955 INFO:teuthology.orchestra.run.smithi072.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T13:08:14.959 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/499 2024-03-24T13:08:14.959 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/499 2024-03-24T13:08:14.960 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:14.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:14.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:14.993 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-24T13:08:15.249 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:15.253 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:15.254 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:15.255 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:15.255 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:15.600 INFO:teuthology.orchestra.run.smithi072.stdout:generic/500 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:15.604 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/500 2024-03-24T13:08:15.604 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/500 2024-03-24T13:08:15.604 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:15.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:15.627 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-24T13:08:15.868 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:15.872 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:15.873 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:15.875 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:15.875 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:16.398 INFO:teuthology.orchestra.run.smithi072.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T13:08:16.412 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/501 2024-03-24T13:08:16.413 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/501 2024-03-24T13:08:16.413 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:16.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:16.561 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-24T13:08:16.864 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:16.869 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:16.869 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:16.871 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:17.231 INFO:teuthology.orchestra.run.smithi072.stdout:generic/502 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:17.235 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/502 2024-03-24T13:08:17.235 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/502 2024-03-24T13:08:17.235 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:17.238 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:17.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:17.273 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-24T13:08:17.516 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:17.521 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:17.521 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:17.522 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:17.856 INFO:teuthology.orchestra.run.smithi072.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T13:08:17.860 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/503 2024-03-24T13:08:17.860 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/503 2024-03-24T13:08:17.860 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:17.863 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:17.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:17.898 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-24T13:08:18.161 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:18.169 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:18.170 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:18.171 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:18.171 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:18.559 INFO:teuthology.orchestra.run.smithi072.stdout:generic/504 0s 2024-03-24T13:08:18.566 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/504 2024-03-24T13:08:18.566 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:18.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:18.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:18.598 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-24T13:08:18.865 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:18.869 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:18.870 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:18.873 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:18.873 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:19.282 INFO:teuthology.orchestra.run.smithi072.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-24T13:08:19.332 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/505 2024-03-24T13:08:19.332 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/505 2024-03-24T13:08:19.332 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:19.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:19.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:19.357 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-24T13:08:19.618 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:19.624 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:19.625 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:19.626 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:19.626 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:19.933 INFO:teuthology.orchestra.run.smithi072.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-24T13:08:19.937 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/506 2024-03-24T13:08:19.937 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/506 2024-03-24T13:08:19.938 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:19.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:19.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:19.969 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-24T13:08:20.219 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:20.223 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:20.224 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:20.224 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:20.593 INFO:teuthology.orchestra.run.smithi072.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-24T13:08:20.597 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/507 2024-03-24T13:08:20.597 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/507 2024-03-24T13:08:20.597 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:20.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:20.635 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-24T13:08:20.898 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:20.902 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:20.902 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:20.903 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:20.903 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:21.208 INFO:teuthology.orchestra.run.smithi072.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-24T13:08:21.212 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/508 2024-03-24T13:08:21.212 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/508 2024-03-24T13:08:21.212 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:21.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:21.241 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-24T13:08:21.500 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:21.505 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:21.506 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:21.507 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:21.813 INFO:teuthology.orchestra.run.smithi072.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-24T13:08:21.818 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/509 2024-03-24T13:08:21.818 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/509 2024-03-24T13:08:21.818 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:21.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:21.841 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-24T13:08:22.103 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:22.107 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:22.108 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:22.110 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:22.448 INFO:teuthology.orchestra.run.smithi072.stdout:generic/510 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:22.453 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/510 2024-03-24T13:08:22.453 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/510 2024-03-24T13:08:22.453 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:22.455 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:22.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:22.479 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-24T13:08:22.730 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:22.733 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:22.734 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:22.735 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:22.735 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:23.054 INFO:teuthology.orchestra.run.smithi072.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-24T13:08:23.058 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/511 2024-03-24T13:08:23.058 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/511 2024-03-24T13:08:23.058 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:23.061 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:23.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:23.107 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-24T13:08:23.342 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:23.347 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:23.347 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:23.348 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:23.348 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:23.684 INFO:teuthology.orchestra.run.smithi072.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T13:08:23.688 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/512 2024-03-24T13:08:23.688 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/512 2024-03-24T13:08:23.688 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:23.690 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:23.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:23.720 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-24T13:08:23.997 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:24.002 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:24.003 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:24.004 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:24.004 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:24.532 INFO:teuthology.orchestra.run.smithi072.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T13:08:24.538 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/513 2024-03-24T13:08:24.538 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/513 2024-03-24T13:08:24.538 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:24.542 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:24.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:24.629 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-24T13:08:24.969 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:24.973 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:24.974 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:24.974 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:24.975 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:25.576 INFO:teuthology.orchestra.run.smithi072.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T13:08:25.585 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/514 2024-03-24T13:08:25.585 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/514 2024-03-24T13:08:25.585 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:25.587 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:25.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:25.691 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-24T13:08:26.094 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:26.098 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:26.098 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:26.099 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:26.099 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:26.639 INFO:teuthology.orchestra.run.smithi072.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T13:08:26.646 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/515 2024-03-24T13:08:26.646 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/515 2024-03-24T13:08:26.646 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:26.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:26.751 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-24T13:08:27.102 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:27.106 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:27.106 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:27.107 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:27.107 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:27.475 INFO:teuthology.orchestra.run.smithi072.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-24T13:08:27.486 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/516 2024-03-24T13:08:27.486 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/516 2024-03-24T13:08:27.486 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:27.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:27.557 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-24T13:08:27.969 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:27.975 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:27.975 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:27.977 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:27.978 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:28.508 INFO:teuthology.orchestra.run.smithi072.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-24T13:08:28.559 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/517 2024-03-24T13:08:28.559 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/517 2024-03-24T13:08:28.559 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:28.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:28.643 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-24T13:08:29.007 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:29.011 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:29.012 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:29.013 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:29.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:29.588 INFO:teuthology.orchestra.run.smithi072.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T13:08:29.599 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/518 2024-03-24T13:08:29.599 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/518 2024-03-24T13:08:29.599 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:29.601 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:29.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:29.688 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-24T13:08:30.026 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:30.031 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:30.032 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:30.032 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:30.032 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:30.509 INFO:teuthology.orchestra.run.smithi072.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-24T13:08:30.513 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/519 2024-03-24T13:08:30.514 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/519 2024-03-24T13:08:30.514 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:30.516 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:30.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:30.595 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-24T13:08:31.036 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:31.039 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:31.040 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:31.041 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:31.041 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:31.385 INFO:teuthology.orchestra.run.smithi072.stdout:generic/520 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T13:08:31.389 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/520 2024-03-24T13:08:31.389 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/520 2024-03-24T13:08:31.389 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T13:08:31.391 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:08:31.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T13:08:31.413 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-24T13:08:31.635 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T13:08:31.639 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T13:08:31.640 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T13:08:31.641 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T13:08:31.641 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T13:16:30.701 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T13:16:30.706+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51564) UID: 0 2024-03-24T13:16:30.702 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T13:16:30.706+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51564) UID: 0 2024-03-24T13:16:30.702 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T13:16:30.706+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51564) UID: 0 2024-03-24T13:16:30.702 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T13:16:30.706+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51564) UID: 0 2024-03-24T13:25:22.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:25:22.565 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:25:22.607 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T13:25:22.613+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51592) UID: 0 2024-03-24T13:25:22.607 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T13:25:22.613+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51592) UID: 0 2024-03-24T13:25:22.608 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T13:25:22.613+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51592) UID: 0 2024-03-24T13:25:22.608 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T13:25:22.613+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51592) UID: 0 2024-03-24T13:25:23.036 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T13:25:23.042+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602472) UID: 0 2024-03-24T13:25:23.036 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T13:25:23.042+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602472) UID: 0 2024-03-24T13:25:23.036 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T13:25:23.042+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602472) UID: 0 2024-03-24T13:25:23.037 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T13:25:23.042+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602472) UID: 0 2024-03-24T13:46:43.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:46:43.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:46:43.869 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T13:46:43.868+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51624) UID: 0 2024-03-24T13:46:43.869 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T13:46:43.868+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51624) UID: 0 2024-03-24T13:46:43.869 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T13:46:43.868+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51624) UID: 0 2024-03-24T13:46:43.871 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T13:46:43.871+0000 7f5907ae3640 -1 Fail to open '/proc/51624/cmdline' error = (2) No such file or directory 2024-03-24T13:46:43.872 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T13:46:43.871+0000 7f5907ae3640 -1 received signal: Hangup from (PID: 51624) UID: 0 2024-03-24T13:46:44.149 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T13:46:44.148+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602519) UID: 0 2024-03-24T13:46:44.149 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T13:46:44.148+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602519) UID: 0 2024-03-24T13:46:44.149 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T13:46:44.148+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602519) UID: 0 2024-03-24T13:46:44.150 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T13:46:44.148+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602519) UID: 0 2024-03-24T13:50:29.631 INFO:teuthology.orchestra.run.smithi079.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-03-24T13:50:29.632 INFO:teuthology.orchestra.run.smithi079.stderr:gzip: stdin: file size changed while zipping 2024-03-24T13:54:47.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:54:47.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T13:54:47.102 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T13:54:47.100+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602564) UID: 0 2024-03-24T13:54:47.102 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T13:54:47.100+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602564) UID: 0 2024-03-24T13:54:47.103 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T13:54:47.100+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602564) UID: 0 2024-03-24T13:54:47.103 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T13:54:47.100+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602564) UID: 0 2024-03-24T14:06:38.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:06:38.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:06:38.052 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:06:38.049+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51691) UID: 0 2024-03-24T14:06:38.052 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:06:38.049+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51691) UID: 0 2024-03-24T14:06:38.052 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:06:38.049+0000 7f1f3eedb640 -1 Fail to open '/proc/51691/cmdline' error = (2) No such file or directory 2024-03-24T14:06:38.053 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:06:38.049+0000 7f1f3eedb640 -1 received signal: Hangup from (PID: 51691) UID: 0 2024-03-24T14:06:38.053 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:06:38.049+0000 7f5907ae3640 -1 Fail to open '/proc/51691/cmdline' error = (2) No such file or directory 2024-03-24T14:06:38.053 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:06:38.049+0000 7f5907ae3640 -1 received signal: Hangup from (PID: 51691) UID: 0 2024-03-24T14:06:38.364 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T14:06:38.361+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602609) UID: 0 2024-03-24T14:06:38.364 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T14:06:38.361+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602609) UID: 0 2024-03-24T14:06:38.365 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T14:06:38.361+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602609) UID: 0 2024-03-24T14:06:38.365 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:06:38.362+0000 7fb0e9de8640 -1 Fail to open '/proc/602609/cmdline' error = (2) No such file or directory 2024-03-24T14:06:38.365 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:06:38.362+0000 7fb0e9de8640 -1 received signal: Hangup from (PID: 602609) UID: 0 2024-03-24T14:15:27.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:15:27.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:15:27.152 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T14:15:27.150+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602642) UID: 0 2024-03-24T14:15:27.152 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T14:15:27.150+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602642) UID: 0 2024-03-24T14:15:27.153 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:15:27.150+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602642) UID: 0 2024-03-24T14:15:27.153 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T14:15:27.150+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 602642) UID: 0 2024-03-24T14:21:58.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:21:58.179 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:21:58.217 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T14:21:58.216+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51742) UID: 0 2024-03-24T14:21:58.217 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T14:21:58.216+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51742) UID: 0 2024-03-24T14:25:16.061 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:25:16.059+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51747) UID: 0 2024-03-24T14:25:16.062 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:25:16.059+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51747) UID: 0 2024-03-24T14:25:16.062 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:25:16.059+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51747) UID: 0 2024-03-24T14:25:16.062 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:25:16.060+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51747) UID: 0 2024-03-24T14:25:54.870 INFO:teuthology.orchestra.run.smithi072.stdout:generic/521 4643s 2024-03-24T14:25:55.321 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/521 2024-03-24T14:25:55.321 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T14:25:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T14:25:55.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T14:25:55.495 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-24T14:25:58.751 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T14:25:58.756 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T14:25:58.757 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T14:25:58.758 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T14:25:58.758 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T14:30:32.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:30:32.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:30:32.643 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:30:32.642+0000 7fcdec273640 -1 Fail to open '/proc/51771/cmdline' error = (2) No such file or directory 2024-03-24T14:30:32.643 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:30:32.642+0000 7f5907ae3640 -1 Fail to open '/proc/51771/cmdline' error = (2) No such file or directory 2024-03-24T14:30:32.643 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:30:32.642+0000 7f5907ae3640 -1 received signal: Hangup from (PID: 51771) UID: 0 2024-03-24T14:30:32.644 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:30:32.642+0000 7fcdec273640 -1 received signal: Hangup from (PID: 51771) UID: 0 2024-03-24T14:30:32.644 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:30:32.641+0000 7f3624102640 -1 Fail to open '/proc/51771/cmdline' error = (2) No such file or directory 2024-03-24T14:30:32.644 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:30:32.641+0000 7f3624102640 -1 received signal: Hangup from (PID: 51771) UID: 0 2024-03-24T14:30:32.645 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:30:32.642+0000 7f1f3eedb640 -1 Fail to open '/proc/51771/cmdline' error = (2) No such file or directory 2024-03-24T14:30:32.645 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:30:32.642+0000 7f1f3eedb640 -1 received signal: Hangup from (PID: 51771) UID: 0 2024-03-24T14:30:32.665 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T14:30:32.663+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603177) UID: 0 2024-03-24T14:30:32.666 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T14:30:32.664+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603177) UID: 0 2024-03-24T14:30:32.666 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T14:30:32.664+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603177) UID: 0 2024-03-24T14:30:32.666 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:30:32.664+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603177) UID: 0 2024-03-24T14:42:07.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:42:07.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:42:07.506 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:42:07.504+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51800) UID: 0 2024-03-24T14:42:07.506 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:42:07.504+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51800) UID: 0 2024-03-24T14:42:07.511 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:42:07.504+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51800) UID: 0 2024-03-24T14:42:07.511 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:42:07.504+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51800) UID: 0 2024-03-24T14:42:11.059 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T14:42:11.058+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603207) UID: 0 2024-03-24T14:42:11.060 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T14:42:11.058+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603207) UID: 0 2024-03-24T14:42:11.060 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T14:42:11.058+0000 7f70dc9d5640 -1 Fail to open '/proc/603207/cmdline' error = (2) No such file or directory 2024-03-24T14:42:11.060 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T14:42:11.058+0000 7f70dc9d5640 -1 received signal: Hangup from (PID: 603207) UID: 0 2024-03-24T14:42:11.061 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:42:11.058+0000 7fb0e9de8640 -1 Fail to open '/proc/603207/cmdline' error = (2) No such file or directory 2024-03-24T14:42:11.061 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:42:11.058+0000 7fb0e9de8640 -1 received signal: Hangup from (PID: 603207) UID: 0 2024-03-24T14:49:41.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:49:41.421 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:49:41.457 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:49:41.456+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51825) UID: 0 2024-03-24T14:49:41.457 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:49:41.456+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51825) UID: 0 2024-03-24T14:49:41.458 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:49:41.456+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51825) UID: 0 2024-03-24T14:49:41.458 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:49:41.456+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51825) UID: 0 2024-03-24T14:53:54.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:53:54.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:53:54.613 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T14:53:54.612+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51852) UID: 0 2024-03-24T14:53:54.614 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T14:53:54.613+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51852) UID: 0 2024-03-24T14:53:54.614 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T14:53:54.613+0000 7fcdec273640 -1 received signal: Hangup from (PID: 51852) UID: 0 2024-03-24T14:53:54.615 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:53:54.615+0000 7f1f3eedb640 -1 Fail to open '/proc/51852/cmdline' error = (2) No such file or directory 2024-03-24T14:53:54.615 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T14:53:54.615+0000 7f1f3eedb640 -1 received signal: Hangup from (PID: 51852) UID: 0 2024-03-24T14:57:54.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:57:54.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:58:25.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:58:25.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T14:58:25.398 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T14:58:25.397+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603291) UID: 0 2024-03-24T14:58:25.398 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T14:58:25.397+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603291) UID: 0 2024-03-24T14:58:25.399 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T14:58:25.398+0000 7f2824d68640 -1 Fail to open '/proc/603291/cmdline' error = (2) No such file or directory 2024-03-24T14:58:25.399 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T14:58:25.398+0000 7f2824d68640 -1 received signal: Hangup from (PID: 603291) UID: 0 2024-03-24T14:58:25.399 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T14:58:25.398+0000 7f8565601640 -1 Fail to open '/proc/603291/cmdline' error = (2) No such file or directory 2024-03-24T14:58:25.400 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T14:58:25.398+0000 7f8565601640 -1 received signal: Hangup from (PID: 603291) UID: 0 2024-03-24T15:03:13.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:03:13.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:03:13.846 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:03:13.844+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51924) UID: 0 2024-03-24T15:03:13.846 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:03:13.845+0000 7f5907ae3640 -1 Fail to open '/proc/51924/cmdline' error = (2) No such file or directory 2024-03-24T15:03:13.846 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:03:13.845+0000 7f5907ae3640 -1 received signal: Hangup from (PID: 51924) UID: 0 2024-03-24T15:03:13.848 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:03:13.845+0000 7f1f3eedb640 -1 received signal: Hangup from (PID: 51924) UID: 0 2024-03-24T15:03:13.849 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:03:13.845+0000 7f3624102640 -1 Fail to open '/proc/51924/cmdline' error = (2) No such file or directory 2024-03-24T15:03:13.849 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:03:13.845+0000 7f3624102640 -1 received signal: Hangup from (PID: 51924) UID: 0 2024-03-24T15:07:38.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:07:38.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:07:38.555 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T15:07:38.554+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603348) UID: 0 2024-03-24T15:07:38.555 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T15:07:38.554+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603348) UID: 0 2024-03-24T15:07:38.556 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:07:38.554+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603348) UID: 0 2024-03-24T15:07:38.556 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T15:07:38.554+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603348) UID: 0 2024-03-24T15:16:57.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:16:57.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:16:57.936 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:16:57.935+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51972) UID: 0 2024-03-24T15:16:57.936 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:16:57.935+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51972) UID: 0 2024-03-24T15:16:57.937 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:16:57.935+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51972) UID: 0 2024-03-24T15:16:57.937 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:16:57.935+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51972) UID: 0 2024-03-24T15:17:00.358 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T15:17:00.357+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603377) UID: 0 2024-03-24T15:17:00.359 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T15:17:00.358+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603377) UID: 0 2024-03-24T15:17:00.359 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T15:17:00.358+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603377) UID: 0 2024-03-24T15:17:00.360 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:17:00.358+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 603377) UID: 0 2024-03-24T15:22:13.178 INFO:teuthology.orchestra.run.smithi072.stdout:generic/522 3375s 2024-03-24T15:22:13.239 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/522 2024-03-24T15:22:13.239 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:13.242 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:13.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:13.282 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-24T15:22:13.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:22:13.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:22:13.552 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T15:22:13.551+0000 7f0189492640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51995) UID: 0 2024-03-24T15:22:13.552 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T15:22:13.551+0000 7f4da498b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51995) UID: 0 2024-03-24T15:22:14.008 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:14.012 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:14.012 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:14.013 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:14.636 INFO:teuthology.orchestra.run.smithi072.stdout:generic/523 0s 2024-03-24T15:22:14.643 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/523 2024-03-24T15:22:14.644 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:14.646 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:14.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:14.655 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-24T15:22:14.892 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:14.896 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:14.896 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:14.897 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:14.897 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:19.409 INFO:teuthology.orchestra.run.smithi072.stdout:generic/524 4s 2024-03-24T15:22:19.416 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/524 2024-03-24T15:22:19.416 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:19.419 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:19.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:19.430 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-24T15:22:19.664 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:19.669 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:19.669 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:19.670 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:19.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:20.101 INFO:teuthology.orchestra.run.smithi072.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-24T15:22:20.114 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/525 2024-03-24T15:22:20.115 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/525 2024-03-24T15:22:20.115 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:20.117 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:20.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:20.142 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-24T15:22:20.377 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:20.381 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:20.381 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:20.382 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:20.732 INFO:teuthology.orchestra.run.smithi072.stdout:generic/526 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T15:22:20.739 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/526 2024-03-24T15:22:20.739 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/526 2024-03-24T15:22:20.739 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:20.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:20.783 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-24T15:22:21.017 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:21.022 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:21.022 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:21.023 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:21.342 INFO:teuthology.orchestra.run.smithi072.stdout:generic/527 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T15:22:21.347 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/527 2024-03-24T15:22:21.347 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/527 2024-03-24T15:22:21.347 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:21.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:21.382 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-24T15:22:21.621 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:21.626 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:21.626 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:21.627 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:22.016 INFO:teuthology.orchestra.run.smithi072.stdout:generic/528 1s 2024-03-24T15:22:22.023 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/528 2024-03-24T15:22:22.023 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:22.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:22.077 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-24T15:22:22.492 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:22.496 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:22.496 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:22.497 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:22.497 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:23.036 INFO:teuthology.orchestra.run.smithi072.stdout:generic/529 1s 2024-03-24T15:22:23.044 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/529 2024-03-24T15:22:23.044 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:23.046 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:23.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:23.055 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-24T15:22:23.282 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:23.287 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:23.287 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:23.288 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:23.288 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:23.674 INFO:teuthology.orchestra.run.smithi072.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-24T15:22:23.690 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/530 2024-03-24T15:22:23.690 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/530 2024-03-24T15:22:23.691 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:23.693 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:23.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:23.713 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-24T15:22:23.967 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:23.972 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:23.972 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:23.973 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:23.973 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:24.248 INFO:teuthology.orchestra.run.smithi072.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-24T15:22:24.254 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/531 2024-03-24T15:22:24.254 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/531 2024-03-24T15:22:24.254 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:24.257 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:24.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:24.276 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-24T15:22:24.517 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:24.521 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:24.521 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:24.522 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:24.522 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:25.015 INFO:teuthology.orchestra.run.smithi072.stdout:generic/532 0s 2024-03-24T15:22:25.049 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/532 2024-03-24T15:22:25.049 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:25.052 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:25.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:25.073 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-24T15:22:25.321 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:25.325 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:25.326 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:25.327 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:25.327 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:26.497 INFO:teuthology.orchestra.run.smithi072.stdout:generic/533 1s 2024-03-24T15:22:26.505 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/533 2024-03-24T15:22:26.505 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:26.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:26.539 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-24T15:22:26.777 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:26.785 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:26.786 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:26.786 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:27.082 INFO:teuthology.orchestra.run.smithi072.stdout:generic/534 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T15:22:27.086 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/534 2024-03-24T15:22:27.086 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/534 2024-03-24T15:22:27.086 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:27.089 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:27.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:27.114 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-24T15:22:27.344 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:27.348 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:27.348 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:27.350 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:27.696 INFO:teuthology.orchestra.run.smithi072.stdout:generic/535 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T15:22:27.702 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/535 2024-03-24T15:22:27.702 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/535 2024-03-24T15:22:27.702 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:27.705 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:27.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:27.727 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-24T15:22:27.957 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:27.961 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:27.962 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:27.963 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:27.963 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:28.378 INFO:teuthology.orchestra.run.smithi072.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-24T15:22:28.396 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/536 2024-03-24T15:22:28.397 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/536 2024-03-24T15:22:28.397 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:28.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:28.417 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-24T15:22:28.733 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:28.738 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:28.738 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:28.739 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:29.321 INFO:teuthology.orchestra.run.smithi072.stdout:generic/537 [not run] FSTRIM not supported 2024-03-24T15:22:29.338 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/537 2024-03-24T15:22:29.339 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/537 2024-03-24T15:22:29.339 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:22:29.341 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:22:29.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:22:29.361 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-24T15:22:29.592 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:22:29.597 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:22:29.597 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:22:29.598 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:22:29.599 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:26:00.503 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:26:00.502+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52488) UID: 0 2024-03-24T15:26:00.504 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:26:00.503+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52488) UID: 0 2024-03-24T15:26:00.505 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:26:00.504+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52488) UID: 0 2024-03-24T15:26:00.505 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:26:00.504+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52488) UID: 0 2024-03-24T15:30:38.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:30:38.334 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:30:38.377 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:30:38.377+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-03-24T15:30:38.378 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:30:38.377+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-03-24T15:30:38.378 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:30:38.377+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-03-24T15:30:38.380 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:30:38.377+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52524) UID: 0 2024-03-24T15:30:45.306 INFO:teuthology.orchestra.run.smithi072.stdout:generic/538 496s 2024-03-24T15:30:45.325 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/538 2024-03-24T15:30:45.325 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:45.328 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:45.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:45.372 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-24T15:30:46.012 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:46.015 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:46.016 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:46.017 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:48.749 INFO:teuthology.orchestra.run.smithi072.stdout:generic/539 2s 2024-03-24T15:30:48.770 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/539 2024-03-24T15:30:48.771 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:48.773 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:48.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:48.811 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-24T15:30:49.395 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:49.399 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:49.400 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:49.401 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:49.401 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:50.045 INFO:teuthology.orchestra.run.smithi072.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T15:30:50.052 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/540 2024-03-24T15:30:50.052 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/540 2024-03-24T15:30:50.052 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:50.054 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:50.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:50.615 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-24T15:30:50.846 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:50.850 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:50.851 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:50.852 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:50.852 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:51.465 INFO:teuthology.orchestra.run.smithi072.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T15:30:51.472 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/541 2024-03-24T15:30:51.472 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/541 2024-03-24T15:30:51.472 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:51.474 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:52.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:52.047 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-24T15:30:52.451 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:52.455 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:52.456 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:52.457 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:52.457 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:52.998 INFO:teuthology.orchestra.run.smithi072.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T15:30:53.003 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/542 2024-03-24T15:30:53.003 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/542 2024-03-24T15:30:53.003 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:53.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:53.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:53.541 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-24T15:30:53.785 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:53.789 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:53.790 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:53.791 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:53.791 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:54.411 INFO:teuthology.orchestra.run.smithi072.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T15:30:54.416 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/543 2024-03-24T15:30:54.417 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/543 2024-03-24T15:30:54.417 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:54.420 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:55.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:55.041 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-24T15:30:55.262 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:55.267 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:55.267 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:55.268 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:55.796 INFO:teuthology.orchestra.run.smithi072.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-24T15:30:55.803 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/544 2024-03-24T15:30:55.803 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/544 2024-03-24T15:30:55.803 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:55.805 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:56.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:56.332 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-24T15:30:56.552 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:56.557 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:56.557 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:56.558 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:56.950 INFO:teuthology.orchestra.run.smithi072.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-24T15:30:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/545 2024-03-24T15:30:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/545 2024-03-24T15:30:56.955 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:56.957 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:57.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:57.007 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-24T15:30:57.244 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:57.248 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:57.248 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:57.249 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:57.249 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:57.577 INFO:teuthology.orchestra.run.smithi072.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-24T15:30:57.583 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/546 2024-03-24T15:30:57.583 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/546 2024-03-24T15:30:57.583 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:57.586 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:57.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:57.616 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-24T15:30:57.858 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:57.863 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:57.864 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:57.866 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:57.866 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:58.189 INFO:teuthology.orchestra.run.smithi072.stdout:generic/547 [not run] require 172.21.15.72:6789:/scratch to be valid block disk 2024-03-24T15:30:58.192 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/547 2024-03-24T15:30:58.192 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/547 2024-03-24T15:30:58.192 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:58.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:58.223 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-24T15:30:58.434 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:58.437 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:58.438 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:58.439 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:58.439 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:58.902 INFO:teuthology.orchestra.run.smithi072.stdout:generic/548 [not run] kernel does not support ceph encryption 2024-03-24T15:30:58.922 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/548 2024-03-24T15:30:58.922 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/548 2024-03-24T15:30:58.922 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:58.926 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:58.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:58.948 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-24T15:30:59.185 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:59.189 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:59.189 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:59.190 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:59.190 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:59.648 INFO:teuthology.orchestra.run.smithi072.stdout:generic/549 [not run] kernel does not support ceph encryption 2024-03-24T15:30:59.666 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/549 2024-03-24T15:30:59.666 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/549 2024-03-24T15:30:59.666 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:30:59.670 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:30:59.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:30:59.696 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-24T15:30:59.929 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:30:59.933 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:30:59.934 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:30:59.935 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:30:59.935 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:31:00.406 INFO:teuthology.orchestra.run.smithi072.stdout:generic/550 [not run] kernel does not support ceph encryption 2024-03-24T15:31:00.421 INFO:teuthology.orchestra.run.smithi072.stdout:Ran: generic/550 2024-03-24T15:31:00.421 INFO:teuthology.orchestra.run.smithi072.stdout:Not run: generic/550 2024-03-24T15:31:00.421 INFO:teuthology.orchestra.run.smithi072.stdout:Passed all 1 tests 2024-03-24T15:31:00.424 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:31:00.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-24T15:31:00.445 DEBUG:teuthology.orchestra.run.smithi072:> (cd /tmp/tmp.jRAetzsE4Sxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-24T15:31:00.671 INFO:teuthology.orchestra.run.smithi072.stdout:FSTYP -- ceph 2024-03-24T15:31:00.676 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM -- Linux/x86_64 smithi072 5.14.0-430.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Mar 14 17:54:49 UTC 2024 2024-03-24T15:31:00.677 INFO:teuthology.orchestra.run.smithi072.stdout:MKFS_OPTIONS -- 172.21.15.72:6789:/scratch 2024-03-24T15:31:00.678 INFO:teuthology.orchestra.run.smithi072.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDvAQBmmjLVJhAAsxV1WyrSpmW93OseEKSq2Q== -o context=system_u:object_r:root_t:s0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch 2024-03-24T15:31:00.678 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:34:59.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:34:59.189 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:34:59.238 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:34:59.237+0000 7f5907ae3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54647) UID: 0 2024-03-24T15:34:59.238 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:34:59.237+0000 7f1f3eedb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54647) UID: 0 2024-03-24T15:34:59.239 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:34:59.237+0000 7fcdec273640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54647) UID: 0 2024-03-24T15:34:59.239 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:34:59.237+0000 7f3624102640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54647) UID: 0 2024-03-24T15:35:00.119 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:35:00.118+0000 7f361a70c640 -1 bdev(0x55637ac3ae00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-24T15:35:00.120 INFO:tasks.ceph.osd.5.smithi079.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f361a70c640 time 2024-03-24T15:35:00.119693+0000 2024-03-24T15:35:00.120 INFO:tasks.ceph.osd.5.smithi079.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:35:00.120 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.120 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x556378626409] 2024-03-24T15:35:00.120 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.120 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:35:00.119+0000 7f361a70c640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f361a70c640 time 2024-03-24T15:35:00.119693+0000 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x556378626409] 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.121 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.122 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.122 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.122 INFO:tasks.ceph.osd.5.smithi079.stderr:*** Caught signal (Aborted) ** 2024-03-24T15:35:00.122 INFO:tasks.ceph.osd.5.smithi079.stderr: in thread 7f361a70c640 thread_name:bstore_aio 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3627654db0] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f36276a154c] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: raise() 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: abort() 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5563786264ca] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 7: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.123 INFO:tasks.ceph.osd.5.smithi079.stderr:2024-03-24T15:35:00.120+0000 7f361a70c640 -1 *** Caught signal (Aborted) ** 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: in thread 7f361a70c640 thread_name:bstore_aio 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3627654db0] 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f36276a154c] 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: raise() 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: abort() 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5563786264ca] 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 7: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.124 INFO:tasks.ceph.osd.5.smithi079.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.125 INFO:tasks.ceph.osd.5.smithi079.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.125 INFO:tasks.ceph.osd.5.smithi079.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-24T15:35:00.125 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.134 INFO:tasks.ceph.osd.5.smithi079.stderr: -4> 2024-03-24T15:35:00.118+0000 7f361a70c640 -1 bdev(0x55637ac3ae00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-24T15:35:00.134 INFO:tasks.ceph.osd.5.smithi079.stderr: -1> 2024-03-24T15:35:00.119+0000 7f361a70c640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f361a70c640 time 2024-03-24T15:35:00.119693+0000 2024-03-24T15:35:00.134 INFO:tasks.ceph.osd.5.smithi079.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:35:00.134 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.134 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x556378626409] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 0> 2024-03-24T15:35:00.120+0000 7f361a70c640 -1 *** Caught signal (Aborted) ** 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: in thread 7f361a70c640 thread_name:bstore_aio 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3627654db0] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f36276a154c] 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: raise() 2024-03-24T15:35:00.135 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: abort() 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5563786264ca] 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: 7: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-24T15:35:00.136 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: -40> 2024-03-24T15:35:00.118+0000 7f361a70c640 -1 bdev(0x55637ac3ae00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: -37> 2024-03-24T15:35:00.119+0000 7f361a70c640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f361a70c640 time 2024-03-24T15:35:00.119693+0000 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x556378626409] 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.144 INFO:tasks.ceph.osd.5.smithi079.stderr: -36> 2024-03-24T15:35:00.120+0000 7f361a70c640 -1 *** Caught signal (Aborted) ** 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: in thread 7f361a70c640 thread_name:bstore_aio 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f3627654db0] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f36276a154c] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 3: raise() 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 4: abort() 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5563786264ca] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x556378ff5f90] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 7: ceph-osd(+0xdc5101) [0x556378ff6101] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f362769f802] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f362763f450] 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-24T15:35:00.145 INFO:tasks.ceph.osd.5.smithi079.stderr: 2024-03-24T15:35:00.309 INFO:tasks.ceph.osd.5.smithi079.stderr:daemon-helper: command failed with exit status 5 2024-03-24T15:35:01.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-24T15:35:02.877 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T15:35:02.876+0000 7fb0e9de8640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626204) UID: 0 2024-03-24T15:35:02.934 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T15:35:02.877+0000 7f8565601640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626204) UID: 0 2024-03-24T15:35:02.934 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:35:02.875+0000 7f70dc9d5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626204) UID: 0 2024-03-24T15:35:02.934 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T15:35:02.876+0000 7f2824d68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 626204) UID: 0 2024-03-24T15:35:08.105 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2024-03-24T15:35:14.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2024-03-24T15:35:21.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-03-24T15:35:27.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~27s 2024-03-24T15:35:34.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2024-03-24T15:35:41.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-03-24T15:35:47.783 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2024-03-24T15:35:54.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2024-03-24T15:36:01.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-03-24T15:36:07.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2024-03-24T15:36:14.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2024-03-24T15:36:20.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2024-03-24T15:36:27.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2024-03-24T15:36:34.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2024-03-24T15:36:40.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2024-03-24T15:36:47.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2024-03-24T15:36:53.917 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~113s 2024-03-24T15:37:00.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2024-03-24T15:37:07.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2024-03-24T15:37:13.757 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2024-03-24T15:37:20.371 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2024-03-24T15:37:26.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~146s 2024-03-24T15:37:33.600 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2024-03-24T15:37:40.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2024-03-24T15:37:46.825 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-03-24T15:37:53.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2024-03-24T15:38:00.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2024-03-24T15:38:04.592 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:38:04.591+0000 7f70d2fdf640 -1 bdev(0x56167cc5ce00 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-24T15:38:04.793 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:38:04.662+0000 7f70d27cd640 -1 bdev(0x56167cc5d180 /var/lib/ceph/osd/ceph-2/block) _aio_thread got r=-28 ((28) No space left on device) 2024-03-24T15:38:04.880 INFO:tasks.ceph.osd.2.smithi072.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f70d2fdf640 time 2024-03-24T15:38:04.592515+0000 2024-03-24T15:38:04.880 INFO:tasks.ceph.osd.2.smithi072.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:38:04.880 INFO:tasks.ceph.osd.2.smithi072.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f70d27cd640 time 2024-03-24T15:38:04.793420+0000 2024-03-24T15:38:04.880 INFO:tasks.ceph.osd.2.smithi072.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x56167944f409] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x561679e1ef90] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 3: ceph-osd(+0xdc5101) [0x561679e1f101] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f70dfe9f802] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f70dfe3f450] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x56167944f409] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x561679e1ef90] 2024-03-24T15:38:04.954 INFO:tasks.ceph.osd.2.smithi072.stderr: 3: ceph-osd(+0xdc5101) [0x561679e1f101] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f70dfe9f802] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f70dfe3f450] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:38:04.953+0000 7f70d2fdf640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f70d27cd640 time 2024-03-24T15:38:04.793420+0000 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x56167944f409] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x561679e1ef90] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 3: ceph-osd(+0xdc5101) [0x561679e1f101] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f70dfe9f802] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f70dfe3f450] 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr: 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:38:04.953+0000 7f70d27cd640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f70d27cd640 time 2024-03-24T15:38:04.793420+0000 2024-03-24T15:38:04.955 INFO:tasks.ceph.osd.2.smithi072.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1855-g21b3bd67/rpm/el9/BUILD/ceph-19.0.0-1855-g21b3bd67/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x56167944f409] 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 2: (KernelDevice::_aio_thread()+0x11e0) [0x561679e1ef90] 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 3: ceph-osd(+0xdc5101) [0x561679e1f101] 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f70dfe9f802] 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f70dfe3f450] 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr:*** Caught signal (Aborted) ** 2024-03-24T15:38:04.956 INFO:tasks.ceph.osd.2.smithi072.stderr: in thread 7f70d27cd640 thread_name:bstore_aio 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f70dfe54db0] 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f70dfea154c] 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 3: raise() 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 4: abort() 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x56167944f4ca] 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x561679e1ef90] 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 7: ceph-osd(+0xdc5101) [0x561679e1f101] 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f70dfe9f802] 2024-03-24T15:38:04.957 INFO:tasks.ceph.osd.2.smithi072.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f70dfe3f450] 2024-03-24T15:38:04.963 INFO:tasks.ceph.osd.2.smithi072.stderr:2024-03-24T15:38:04.963+0000 7f70d27cd640 -1 *** Caught signal (Aborted) ** 2024-03-24T15:38:04.963 INFO:tasks.ceph.osd.2.smithi072.stderr: in thread 7f70d27cd640 thread_name:bstore_aio 2024-03-24T15:38:04.963 INFO:tasks.ceph.osd.2.smithi072.stderr: 2024-03-24T15:38:04.963 INFO:tasks.ceph.osd.2.smithi072.stderr: ceph version 19.0.0-1855-g21b3bd67 (21b3bd672163092b4e542f772797fcba02d3d4de) squid (dev) 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f70dfe54db0] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f70dfea154c] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 3: raise() 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 4: abort() 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x56167944f4ca] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 6: (KernelDevice::_aio_thread()+0x11e0) [0x561679e1ef90] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 7: ceph-osd(+0xdc5101) [0x561679e1f101] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f70dfe9f802] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f70dfe3f450] 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-24T15:38:04.964 INFO:tasks.ceph.osd.2.smithi072.stderr: 2024-03-24T15:38:06.669 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-03-24T15:38:13.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2024-03-24T15:38:19.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2024-03-24T15:38:26.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-03-24T15:38:33.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2024-03-24T15:38:39.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2024-03-24T15:38:46.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-03-24T15:38:52.966 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~232s 2024-03-24T15:38:59.578 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2024-03-24T15:39:06.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-03-24T15:39:12.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2024-03-24T15:39:14.851 INFO:tasks.ceph.osd.2.smithi072.stderr:daemon-helper: command crashed with signal 6 2024-03-24T15:39:19.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-24T15:39:19.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2024-03-24T15:39:25.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~7s 2024-03-24T15:39:25.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2024-03-24T15:39:32.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~13s 2024-03-24T15:39:32.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2024-03-24T15:39:38.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~20s 2024-03-24T15:39:38.859 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2024-03-24T15:39:45.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~26s 2024-03-24T15:39:45.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2024-03-24T15:39:51.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~33s 2024-03-24T15:39:51.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2024-03-24T15:39:58.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~39s 2024-03-24T15:39:58.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~297s 2024-03-24T15:40:04.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~46s 2024-03-24T15:40:04.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2024-03-24T15:40:04.908 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-03-24T15:40:04.909 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T15:40:04.909 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T15:40:05.023 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T15:40:05.023 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T15:40:05.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-24T15:40:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.656+0000 7f4066f5e640 1 Processor -- start 2024-03-24T15:40:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.656+0000 7f4066f5e640 1 -- start start 2024-03-24T15:40:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f4066f5e640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4060072bd0 0x7f40600ae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f4066f5e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406016e710 0x7f406016ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:07.683 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f4066f5e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406006e6c0 con 0x7f406008b680 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f4066f5e640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f406006dd90 con 0x7f4060072bd0 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f4066f5e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f406006e070 con 0x7f406016e710 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f405ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4060072bd0 0x7f40600ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f405ffff640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4060072bd0 0x7f40600ae420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48868/0 (socket says 172.21.15.72:48868) 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f405ffff640 1 -- 172.21.15.72:0/500238608 learned_addr learned my addr 172.21.15.72:0/500238608 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f40654fb640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406016e710 0x7f406016ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.657+0000 7f405f7fe640 1 -- 172.21.15.72:0/500238608 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788278779 0 0) 0x7f406006e6c0 con 0x7f406008b680 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f405f7fe640 1 -- 172.21.15.72:0/500238608 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4048003500 con 0x7f406008b680 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f405f7fe640 1 -- 172.21.15.72:0/500238608 <== mon.1 v1:172.21.15.79:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3614954145 0 0) 0x7f4048003500 con 0x7f406008b680 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f405ffff640 1 -- 172.21.15.72:0/500238608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406016e710 msgr2=0x7f406016ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f405ffff640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406016e710 0x7f406016ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f405ffff640 1 -- 172.21.15.72:0/500238608 >> v1:172.21.15.79:6789/0 conn(0x7f406008b680 legacy=0x7f40600add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f405ffff640 1 -- 172.21.15.72:0/500238608 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406006e350 con 0x7f4060072bd0 2024-03-24T15:40:07.684 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.682+0000 7f40654fb640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406016e710 0x7f406016ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T15:40:07.685 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.683+0000 7f405ffff640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4060072bd0 0x7f40600ae420 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7f405400b920 tx=0x7f405402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d91481763e443de server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.683+0000 7f405f7fe640 1 -- 172.21.15.72:0/500238608 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050001670 con 0x7f4060072bd0 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.683+0000 7f405f7fe640 1 -- 172.21.15.72:0/500238608 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405402c8b0 con 0x7f4060072bd0 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.683+0000 7f405f7fe640 1 -- 172.21.15.72:0/500238608 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405402cc20 con 0x7f4060072bd0 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 -- 172.21.15.72:0/500238608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4060072bd0 msgr2=0x7f40600ae420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4060072bd0 0x7f40600ae420 secure :-1 s=READY pgs=2571 cs=0 l=1 rev1=1 crypto rx=0x7f405400b920 tx=0x7f405402bd80 comp rx=0 tx=0).stop 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 -- 172.21.15.72:0/500238608 shutdown_connections 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406016e710 0x7f406016ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 --2- 172.21.15.72:0/500238608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4060072bd0 0x7f40600ae420 unknown :-1 s=CLOSED pgs=2571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 -- 172.21.15.72:0/500238608 >> 172.21.15.72:0/500238608 conn(0x7f40600b1920 msgr2=0x7f40600b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 -- 172.21.15.72:0/500238608 shutdown_connections 2024-03-24T15:40:07.686 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.684+0000 7f4066f5e640 1 -- 172.21.15.72:0/500238608 wait complete. 2024-03-24T15:40:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.685+0000 7f4066f5e640 1 Processor -- start 2024-03-24T15:40:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.685+0000 7f4066f5e640 1 -- start start 2024-03-24T15:40:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.686+0000 7f4066f5e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4060072bd0 0x7f406008a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.686+0000 7f4066f5e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406008b680 0x7f406009a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.686+0000 7f4066f5e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 0x7f40600afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:07.688 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.686+0000 7f4066f5e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f4060154df0 con 0x7f406016e710 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.686+0000 7f4066f5e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f406009b320 con 0x7f4060072bd0 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.686+0000 7f4066f5e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f406009b600 con 0x7f406008b680 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 0x7f40600afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 0x7f40600afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48884/0 (socket says 172.21.15.72:48884) 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 -- 172.21.15.72:0/82899310 learned_addr learned my addr 172.21.15.72:0/82899310 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f405ffff640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406008b680 0x7f406009a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f4064cfa640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4060072bd0 0x7f406008a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 -- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406008b680 msgr2=0x7f406009a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406008b680 0x7f406009a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 -- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4060072bd0 msgr2=0x7f406008a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4060072bd0 0x7f406008a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 -- 172.21.15.72:0/82899310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40580077c0 con 0x7f406016e710 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f40654fb640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 0x7f40600afec0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f405800ff00 tx=0x7f405800d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058007ac0 con 0x7f406016e710 2024-03-24T15:40:07.689 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4058003990 con 0x7f406016e710 2024-03-24T15:40:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405400b580 con 0x7f406016e710 2024-03-24T15:40:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058003d20 con 0x7f406016e710 2024-03-24T15:40:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.687+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f406009bbc0 con 0x7f406016e710 2024-03-24T15:40:07.690 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.689+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f405800b040 con 0x7f406016e710 2024-03-24T15:40:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.689+0000 7f405d7fa640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f404c06b840 0x7f404c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.690+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6130+0+0 (secure 0 0 0) 0x7f405808afe0 con 0x7f406016e710 2024-03-24T15:40:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.690+0000 7f4064cfa640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f404c06b840 0x7f404c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:07.691 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.690+0000 7f4064cfa640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f404c06b840 0x7f404c06dd00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f40500017a0 tx=0x7f4050001230 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:07.692 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.691+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406004f550 con 0x7f406016e710 2024-03-24T15:40:07.698 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.696+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f4058055900 con 0x7f406016e710 2024-03-24T15:40:07.878 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.878+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f406006e8b0 con 0x7f406016e710 2024-03-24T15:40:07.879 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.879+0000 7f405d7fa640 1 -- 172.21.15.72:0/82899310 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16768 (secure 0 0 0) 0x7f4058058fc0 con 0x7f406016e710 2024-03-24T15:40:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: 2024-03-24T15:40:07.880 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":45,"fsid":"0cd6a1e7-49c4-4ce2-8320-31fe22775d9b","created":"2024-03-24T10:36:01.918785+0000","modified":"2024-03-24T15:38:08.419353+0000","last_up_change":"2024-03-24T15:38:07.413479+0000","last_in_change":"2024-03-24T10:36:04.164041+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-24T10:36:14.179794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-24T10:37:36.623646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.6), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-24T10:37:37.211680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.31), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"658c0c97-d37e-4108-a44d-a1bffd4431f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6812","nonce":1231953304}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6816","nonce":1231953304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6822","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6823","nonce":1231953304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6819","nonce":1231953304},{"type":"v1","addr":"172.21.15.72:6821","nonce":1231953304}]},"public_addr":"172.21.15.72:6812/1231953304","cluster_addr":"172.21.15.72:6816/1231953304","heartbeat_back_addr":"172.21.15.72:6823/1231953304","heartbeat_front_addr":"172.21.15.72:6821/1231953304","state":["exists","up"]},{"osd":1,"uuid":"26bee6bd-24f4-454d-ab96-a1a3dfa826a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6801","nonce":1209031598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6803","nonce":1209031598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6807","nonce":1209031598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1209031598},{"type":"v1","addr":"172.21.15.72:6805","nonce":1209031598}]},"public_addr":"172.21.15.72:6801/1209031598","cluster_addr":"172.21.15.72:6803/1209031598","heartbeat_back_addr":"172.21.15.72:6807/1209031598","heartbeat_front_addr":"172.21.15.72:6805/1209031598","state":["exists","up"]},{"osd":2,"uuid":"0e134ac2-19d3-4b80-8c0c-dce8820921ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6825","nonce":3225387403}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6827","nonce":3225387403}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6831","nonce":3225387403}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6828","nonce":3225387403},{"type":"v1","addr":"172.21.15.72:6829","nonce":3225387403}]},"public_addr":"172.21.15.72:6825/3225387403","cluster_addr":"172.21.15.72:6827/3225387403","heartbeat_back_addr":"172.21.15.72:6831/3225387403","heartbeat_front_addr":"172.21.15.72:6829/3225387403","state":["exists"]},{"osd":3,"uuid":"fda3f5fb-e909-4388-8d88-6a8a9c3be100","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6809","nonce":3747177009}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6811","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6813","nonce":3747177009}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6820","nonce":3747177009}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6815","nonce":3747177009},{"type":"v1","addr":"172.21.15.72:6817","nonce":3747177009}]},"public_addr":"172.21.15.72:6809/3747177009","cluster_addr":"172.21.15.72:6813/3747177009","heartbeat_back_addr":"172.21.15.72:6820/3747177009","heartbeat_front_addr":"172.21.15.72:6817/3747177009","state":["exists","up"]},{"osd":4,"uuid":"279d98ea-b780-42e2-bee9-f8c8fcf2ff71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6801","nonce":4199586883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6803","nonce":4199586883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6807","nonce":4199586883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":4199586883},{"type":"v1","addr":"172.21.15.79:6805","nonce":4199586883}]},"public_addr":"172.21.15.79:6801/4199586883","cluster_addr":"172.21.15.79:6803/4199586883","heartbeat_back_addr":"172.21.15.79:6807/4199586883","heartbeat_front_addr":"172.21.15.79:6805/4199586883","state":["exists","up"]},{"osd":5,"uuid":"1edfb40d-8263-4a85-95dd-d52b081ccf66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6809","nonce":2108585497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6811","nonce":2108585497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6815","nonce":2108585497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":2108585497},{"type":"v1","addr":"172.21.15.79:6813","nonce":2108585497}]},"public_addr":"172.21.15.79:6809/2108585497","cluster_addr":"172.21.15.79:6811/2108585497","heartbeat_back_addr":"172.21.15.79:6815/2108585497","heartbeat_front_addr":"172.21.15.79:6813/2108585497","state":["exists"]},{"osd":6,"uuid":"718f88af-7338-4954-9f6d-5d1bf3dc7057","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6825","nonce":1786021323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6827","nonce":1786021323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6831","nonce":1786021323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1786021323},{"type":"v1","addr":"172.21.15.79:6829","nonce":1786021323}]},"public_addr":"172.21.15.79:6825/1786021323","cluster_addr":"172.21.15.79:6827/1786021323","heartbeat_back_addr":"172.21.15.79:6831/1786021323","heartbeat_front_addr":"172.21.15.79:6829/1786021323","state":["exists","up"]},{"osd":7,"uuid":"56a24579-366a-4688-8980-5c14159578ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6817","nonce":1471205760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6819","nonce":1471205760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6823","nonce":1471205760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1471205760},{"type":"v1","addr":"172.21.15.79:6821","nonce":1471205760}]},"public_addr":"172.21.15.79:6817/1471205760","cluster_addr":"172.21.15.79:6819/1471205760","heartbeat_back_addr":"172.21.15.79:6823/1471205760","heartbeat_front_addr":"172.21.15.79:6821/1471205760","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.290373+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.239684+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.332318+0000","dead_epoch":44},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.365575+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.235635+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.348878+0000","dead_epoch":42},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.330271+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-24T10:36:09.277277+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.37","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.881+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f404c06b840 msgr2=0x7f404c06dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.881+0000 7f4066f5e640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f404c06b840 0x7f404c06dd00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f40500017a0 tx=0x7f4050001230 comp rx=0 tx=0).stop 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.881+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 msgr2=0x7f40600afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.881+0000 7f4066f5e640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 0x7f40600afec0 secure :-1 s=READY pgs=2572 cs=0 l=1 rev1=1 crypto rx=0x7f405800ff00 tx=0x7f405800d740 comp rx=0 tx=0).stop 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 shutdown_connections 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f404c06b840 0x7f404c06dd00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f406016e710 0x7f40600afec0 unknown :-1 s=CLOSED pgs=2572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f406008b680 0x7f406009a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 --2- 172.21.15.72:0/82899310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4060072bd0 0x7f406008a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 >> 172.21.15.72:0/82899310 conn(0x7f40600b1920 msgr2=0x7f40600af440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 shutdown_connections 2024-03-24T15:40:07.883 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:07.882+0000 7f4066f5e640 1 -- 172.21.15.72:0/82899310 wait complete. 2024-03-24T15:40:07.897 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-24T10:36:14.179794+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-24T10:37:36.623646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.6), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-03-24T10:37:37.211680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.31), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}] 2024-03-24T15:40:07.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-24T15:40:08.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.001+0000 7fbc1840e640 1 Processor -- start 2024-03-24T15:40:08.002 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.001+0000 7fbc1840e640 1 -- start start 2024-03-24T15:40:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc1840e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006ecb0 0x7fbc100b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc1840e640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc1015f440 0x7fbc10144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc1840e640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc100b30f0 con 0x7fbc1006e8d0 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc1840e640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fbc100b48a0 con 0x7fbc1015f440 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc1840e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbc100b33d0 con 0x7fbc1006ecb0 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc161aa640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fbc1006e8d0 0x7fbc100b4190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:58154/0 (socket says 172.21.15.72:58154) 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc161aa640 1 -- 172.21.15.72:0/2014013620 learned_addr learned my addr 172.21.15.72:0/2014013620 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc169ab640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fbc1015f440 0x7fbc10144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.002+0000 7fbc159a9640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006ecb0 0x7fbc100b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc151a8640 1 -- 172.21.15.72:0/2014013620 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802657452 0 0) 0x7fbc100b30f0 con 0x7fbc1006e8d0 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc151a8640 1 -- 172.21.15.72:0/2014013620 --> v1:172.21.15.79:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbfc003520 con 0x7fbc1006e8d0 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc169ab640 1 -- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006ecb0 msgr2=0x7fbc100b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc169ab640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006ecb0 0x7fbc100b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc169ab640 1 -- 172.21.15.72:0/2014013620 >> v1:172.21.15.79:6789/0 conn(0x7fbc1006e8d0 legacy=0x7fbc100b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc169ab640 1 -- 172.21.15.72:0/2014013620 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc100b36b0 con 0x7fbc1015f440 2024-03-24T15:40:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.003+0000 7fbc159a9640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006ecb0 0x7fbc100b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc169ab640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1015f440 0x7fbc10144150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009d90 tx=0x7fbc0802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8df41da973c0aca6 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc151a8640 1 -- 172.21.15.72:0/2014013620 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0802cbc0 con 0x7fbc1015f440 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc151a8640 1 -- 172.21.15.72:0/2014013620 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0802cd20 con 0x7fbc1015f440 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc151a8640 1 -- 172.21.15.72:0/2014013620 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08034640 con 0x7fbc1015f440 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 -- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1015f440 msgr2=0x7fbc10144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1015f440 0x7fbc10144150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009d90 tx=0x7fbc0802be10 comp rx=0 tx=0).stop 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 -- 172.21.15.72:0/2014013620 shutdown_connections 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1015f440 0x7fbc10144150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 --2- 172.21.15.72:0/2014013620 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006ecb0 0x7fbc100b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 -- 172.21.15.72:0/2014013620 >> 172.21.15.72:0/2014013620 conn(0x7fbc100b1810 msgr2=0x7fbc100b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 -- 172.21.15.72:0/2014013620 shutdown_connections 2024-03-24T15:40:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.004+0000 7fbc1840e640 1 -- 172.21.15.72:0/2014013620 wait complete. 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 Processor -- start 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 -- start start 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006e8d0 0x7fbc1015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1006ecb0 0x7fbc10132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 0x7fbc101333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fbc101315b0 con 0x7fbc1015f440 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbc10133910 con 0x7fbc1006ecb0 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc1840e640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fbc10133df0 con 0x7fbc1006e8d0 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc169ab640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 0x7fbc101333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc169ab640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 0x7fbc101333d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48894/0 (socket says 172.21.15.72:48894) 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc169ab640 1 -- 172.21.15.72:0/3627598095 learned_addr learned my addr 172.21.15.72:0/3627598095 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc161aa640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006e8d0 0x7fbc1015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.006+0000 7fbc159a9640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1006ecb0 0x7fbc10132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc169ab640 1 -- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006e8d0 msgr2=0x7fbc1015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc169ab640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006e8d0 0x7fbc1015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc169ab640 1 -- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1006ecb0 msgr2=0x7fbc10132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc169ab640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1006ecb0 0x7fbc10132e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc169ab640 1 -- 172.21.15.72:0/3627598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c009400 con 0x7fbc1015f440 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc169ab640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 0x7fbc101333d0 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009d90 tx=0x7fbc08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc08007000 con 0x7fbc1015f440 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0802ce90 con 0x7fbc1015f440 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080408b0 con 0x7fbc1015f440 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc08009a70 con 0x7fbc1015f440 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.007+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc10133b10 con 0x7fbc1015f440 2024-03-24T15:40:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.008+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1004f470 con 0x7fbc1015f440 2024-03-24T15:40:08.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.009+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fbc08040a10 con 0x7fbc1015f440 2024-03-24T15:40:08.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.009+0000 7fbc06ffd640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbbf406b810 0x7fbbf406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.009+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6130+0+0 (secure 0 0 0) 0x7fbc080acdd0 con 0x7fbc1015f440 2024-03-24T15:40:08.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.010+0000 7fbc161aa640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbbf406b810 0x7fbbf406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.011 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.010+0000 7fbc161aa640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbbf406b810 0x7fbbf406dcd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005880 tx=0x7fbc00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.014+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fbc080777c0 con 0x7fbc1015f440 2024-03-24T15:40:08.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.191+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbc10072060 con 0x7fbc1015f440 2024-03-24T15:40:08.192 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.191+0000 7fbc06ffd640 1 -- 172.21.15.72:0/3627598095 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) ==== 93+0+10 (secure 0 0 0) 0x7fbc08009450 con 0x7fbc1015f440 2024-03-24T15:40:08.192 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2024-03-24T15:40:08.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbbf406b810 msgr2=0x7fbbf406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbbf406b810 0x7fbbf406dcd0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbc00005880 tx=0x7fbc00009040 comp rx=0 tx=0).stop 2024-03-24T15:40:08.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 msgr2=0x7fbc101333d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 0x7fbc101333d0 secure :-1 s=READY pgs=2573 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009d90 tx=0x7fbc08004a40 comp rx=0 tx=0).stop 2024-03-24T15:40:08.194 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 shutdown_connections 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fbbf406b810 0x7fbbf406dcd0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbc1015f440 0x7fbc101333d0 unknown :-1 s=CLOSED pgs=2573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbc1006ecb0 0x7fbc10132e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 --2- 172.21.15.72:0/3627598095 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fbc1006e8d0 0x7fbc1015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 >> 172.21.15.72:0/3627598095 conn(0x7fbc100b1810 msgr2=0x7fbc100b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 shutdown_connections 2024-03-24T15:40:08.195 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.193+0000 7fbc1840e640 1 -- 172.21.15.72:0/3627598095 wait complete. 2024-03-24T15:40:08.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-24T15:40:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.309+0000 7f3cb45a1640 1 Processor -- start 2024-03-24T15:40:08.310 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.309+0000 7f3cb45a1640 1 -- start start 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb45a1640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cac15e240 0x7f3cac0d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb45a1640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f3cac0cfa50 0x7f3cac0d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb45a1640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cac0d4950 con 0x7f3cac0d0f70 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb45a1640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f3cac0d2270 con 0x7f3cac15e240 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb45a1640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f3cac0cfe60 con 0x7f3cac0cfa50 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb233d640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cac15e240 0x7f3cac0d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.311 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb1b3c640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3cac0d0f70 0x7f3cac0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47158/0 (socket says 172.21.15.72:47158) 2024-03-24T15:40:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb1b3c640 1 -- 172.21.15.72:0/207716631 learned_addr learned my addr 172.21.15.72:0/207716631 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T15:40:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb2b3e640 1 --2- 172.21.15.72:0/207716631 >> v2:172.21.15.79:3300/0 conn(0x7f3cac0cfa50 0x7f3cac0d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb233d640 1 -- 172.21.15.72:0/207716631 >> v2:172.21.15.79:3300/0 conn(0x7f3cac0cfa50 msgr2=0x7f3cac0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T15:40:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb233d640 1 --2- 172.21.15.72:0/207716631 >> v2:172.21.15.79:3300/0 conn(0x7f3cac0cfa50 0x7f3cac0d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb233d640 1 -- 172.21.15.72:0/207716631 >> v1:172.21.15.72:6789/0 conn(0x7f3cac0d0f70 legacy=0x7f3cac0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.312 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.310+0000 7f3cb233d640 1 -- 172.21.15.72:0/207716631 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac0b38c0 con 0x7f3cac15e240 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.311+0000 7f3cb233d640 1 --2- 172.21.15.72:0/207716631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac15e240 0x7f3cac0d2410 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0ce410 tx=0x7f3c9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8660806f39a04277 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.311+0000 7f3cb133b640 1 -- 172.21.15.72:0/207716631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c02e070 con 0x7f3cac15e240 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.311+0000 7f3cb133b640 1 -- 172.21.15.72:0/207716631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c9c0315a0 con 0x7f3cac15e240 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.311+0000 7f3cb133b640 1 -- 172.21.15.72:0/207716631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c031930 con 0x7f3cac15e240 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 -- 172.21.15.72:0/207716631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac15e240 msgr2=0x7f3cac0d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/207716631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac15e240 0x7f3cac0d2410 secure :-1 s=READY pgs=2575 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0ce410 tx=0x7f3c9c02b840 comp rx=0 tx=0).stop 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 -- 172.21.15.72:0/207716631 shutdown_connections 2024-03-24T15:40:08.313 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/207716631 >> v2:172.21.15.79:3300/0 conn(0x7f3cac0cfa50 0x7f3cac0d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/207716631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac15e240 0x7f3cac0d2410 unknown :-1 s=CLOSED pgs=2575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 -- 172.21.15.72:0/207716631 >> 172.21.15.72:0/207716631 conn(0x7f3cac0d3e30 msgr2=0x7f3cac0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 -- 172.21.15.72:0/207716631 shutdown_connections 2024-03-24T15:40:08.314 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.312+0000 7f3cb45a1640 1 -- 172.21.15.72:0/207716631 wait complete. 2024-03-24T15:40:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.314+0000 7f3cb45a1640 1 Processor -- start 2024-03-24T15:40:08.317 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.314+0000 7f3cb45a1640 1 -- start start 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb45a1640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cac0cfa50 0x7f3cac14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb45a1640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 0x7f3cac157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb45a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cac15e240 0x7f3cac0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb45a1640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac0c9e80 con 0x7f3cac0d0f70 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb45a1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac1f3c30 con 0x7f3cac15e240 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb45a1640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f3cac0c9200 con 0x7f3cac0cfa50 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 0x7f3cac157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 0x7f3cac157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48908/0 (socket says 172.21.15.72:48908) 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 -- 172.21.15.72:0/817785788 learned_addr learned my addr 172.21.15.72:0/817785788 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb233d640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cac0cfa50 0x7f3cac14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.320 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb2b3e640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cac15e240 0x7f3cac0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 -- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cac0cfa50 msgr2=0x7f3cac14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cac0cfa50 0x7f3cac14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 -- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cac15e240 msgr2=0x7f3cac0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cac15e240 0x7f3cac0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 -- 172.21.15.72:0/817785788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9c009400 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.315+0000 7f3cb1b3c640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 0x7f3cac157010 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800c400 tx=0x7f3ca800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.316+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8005ce0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.316+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8005e40 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.316+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac0c94e0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.316+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca80072d0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.316+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac0c9aa0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.317+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac04f470 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.318+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f3ca80074f0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.318+0000 7f3ca2ffd640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3c9006b810 0x7f3c9006dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.321 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.318+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6130+0+0 (secure 0 0 0) 0x7f3ca80898e0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.318+0000 7f3cb233d640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3c9006b810 0x7f3c9006dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.322 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.319+0000 7f3cb233d640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3c9006b810 0x7f3c9006dcd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c036000 tx=0x7f3c9c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.326 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.326+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f3ca8054210 con 0x7f3cac0d0f70 2024-03-24T15:40:08.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.503+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3cac0d2c40 con 0x7f3cac0d0f70 2024-03-24T15:40:08.504 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.503+0000 7f3ca2ffd640 1 -- 172.21.15.72:0/817785788 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v45) ==== 104+0+11 (secure 0 0 0) 0x7f3ca80578d0 con 0x7f3cac0d0f70 2024-03-24T15:40:08.504 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2024-03-24T15:40:08.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3c9006b810 msgr2=0x7f3c9006dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.506 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3c9006b810 0x7f3c9006dcd0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c036000 tx=0x7f3c9c03d040 comp rx=0 tx=0).stop 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 msgr2=0x7f3cac157010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 0x7f3cac157010 secure :-1 s=READY pgs=2576 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800c400 tx=0x7f3ca800c8c0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 shutdown_connections 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f3c9006b810 0x7f3c9006dcd0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3cac15e240 0x7f3cac0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cac0d0f70 0x7f3cac157010 unknown :-1 s=CLOSED pgs=2576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 --2- 172.21.15.72:0/817785788 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f3cac0cfa50 0x7f3cac14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 >> 172.21.15.72:0/817785788 conn(0x7f3cac0d3e30 msgr2=0x7f3cac06bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 shutdown_connections 2024-03-24T15:40:08.507 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.505+0000 7f3cb45a1640 1 -- 172.21.15.72:0/817785788 wait complete. 2024-03-24T15:40:08.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-24T15:40:08.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.620+0000 7fe8fe7f7640 1 Processor -- start 2024-03-24T15:40:08.621 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.620+0000 7fe8fe7f7640 1 -- start start 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fe7f7640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8f80d2b20 0x7fe8f80cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fe7f7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 0x7fe8f80cef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fe7f7640 1 -- --> v1:172.21.15.79:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f80d4950 con 0x7fe8f815e240 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fe7f7640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f80d2270 con 0x7fe8f80d2b20 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fe7f7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80b38c0 con 0x7fe8f80d0f70 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8f77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8f80d2b20 0x7fe8f80cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fcd94640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 0x7fe8f80cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8f7fff640 1 --1- >> v1:172.21.15.79:6789/0 conn(0x7fe8f815e240 0x7fe8f80d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.79:6789/0 says I am v1:172.21.15.72:58160/0 (socket says 172.21.15.72:58160) 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8f77fe640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7fe8f80d2b20 0x7fe8f80cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:56540/0 (socket says 172.21.15.72:56540) 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8fcd94640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 0x7fe8f80cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3301/0 says I am v2:172.21.15.72:45564/0 (socket says 172.21.15.72:45564) 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.621+0000 7fe8f77fe640 1 -- 172.21.15.72:0/2452358352 learned_addr learned my addr 172.21.15.72:0/2452358352 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:08.623 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8f77fe640 1 -- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 msgr2=0x7fe8f80cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T15:40:08.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8f77fe640 1 --2- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 0x7fe8f80cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8f77fe640 1 -- 172.21.15.72:0/2452358352 >> v1:172.21.15.79:6789/0 conn(0x7fe8f815e240 legacy=0x7fe8f80d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8f6ffd640 1 -- 172.21.15.72:0/2452358352 <== mon.1 v1:172.21.15.79:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744452259 0 0) 0x7fe8f80d4950 con 0x7fe8f815e240 2024-03-24T15:40:08.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8f77fe640 1 -- 172.21.15.72:0/2452358352 --> v2:172.21.15.79:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f80b3550 con 0x7fe8f80d2b20 2024-03-24T15:40:08.624 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8fcd94640 1 --2- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 0x7fe8f80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T15:40:08.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.622+0000 7fe8f77fe640 1 --2- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d2b20 0x7fe8f80cea40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009870 tx=0x7fe8e802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2a77bb3f8ba3630 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8f6ffd640 1 -- 172.21.15.72:0/2452358352 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8031640 con 0x7fe8f80d2b20 2024-03-24T15:40:08.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8f6ffd640 1 -- 172.21.15.72:0/2452358352 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8e80317a0 con 0x7fe8f80d2b20 2024-03-24T15:40:08.625 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8f6ffd640 1 -- 172.21.15.72:0/2452358352 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e8031b30 con 0x7fe8f80d2b20 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d2b20 msgr2=0x7fe8f80cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d2b20 0x7fe8f80cea40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8009870 tx=0x7fe8e802b8f0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2452358352 shutdown_connections 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d0f70 0x7fe8f80cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2452358352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d2b20 0x7fe8f80cea40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2452358352 >> 172.21.15.72:0/2452358352 conn(0x7fe8f80d3e30 msgr2=0x7fe8f80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2452358352 shutdown_connections 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.623+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2452358352 wait complete. 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.624+0000 7fe8fe7f7640 1 Processor -- start 2024-03-24T15:40:08.626 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.624+0000 7fe8fe7f7640 1 -- start start 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fe7f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 0x7fe8f81f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fe7f7640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d2b20 0x7fe8f8160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fe7f7640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 0x7fe8f81f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fe7f7640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f81616a0 con 0x7fe8f815e240 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fe7f7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f81f4cc0 con 0x7fe8f80d0f70 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fe7f7640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f81607d0 con 0x7fe8f80d2b20 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 0x7fe8f81f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fcd94640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 0x7fe8f81f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8f77fe640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d2b20 0x7fe8f8160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8f7fff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 0x7fe8f81f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.72:56546/0 (socket says 172.21.15.72:56546) 2024-03-24T15:40:08.628 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8fcd94640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 0x7fe8f81f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48910/0 (socket says 172.21.15.72:48910) 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.625+0000 7fe8f7fff640 1 -- 172.21.15.72:0/2506132270 learned_addr learned my addr 172.21.15.72:0/2506132270 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f7fff640 1 -- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d2b20 msgr2=0x7fe8f8160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f7fff640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d2b20 0x7fe8f8160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f7fff640 1 -- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 msgr2=0x7fe8f81f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f7fff640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 0x7fe8f81f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f7fff640 1 -- 172.21.15.72:0/2506132270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f0009a70 con 0x7fe8f80d0f70 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8fcd94640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 0x7fe8f81f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f7fff640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 0x7fe8f81f4780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c4d0 tx=0x7fe8ec00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec0074e0 con 0x7fe8f80d0f70 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec007640 con 0x7fe8f80d0f70 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec004a20 con 0x7fe8f80d0f70 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e80094d0 con 0x7fe8f80d0f70 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.626+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f8160d00 con 0x7fe8f80d0f70 2024-03-24T15:40:08.629 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.627+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f804f470 con 0x7fe8f80d0f70 2024-03-24T15:40:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.628+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7fe8ec004b80 con 0x7fe8f80d0f70 2024-03-24T15:40:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.628+0000 7fe8f4ff9640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8e406b810 0x7fe8e406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.630 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.628+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6130+0+0 (secure 0 0 0) 0x7fe8ec08a0a0 con 0x7fe8f80d0f70 2024-03-24T15:40:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.628+0000 7fe8f77fe640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8e406b810 0x7fe8e406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.631 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.629+0000 7fe8f77fe640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8e406b810 0x7fe8e406dcd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8036000 tx=0x7fe8e803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.633 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.633+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7fe8ec0549a0 con 0x7fe8f80d0f70 2024-03-24T15:40:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.806+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe8f80b3180 con 0x7fe8f80d0f70 2024-03-24T15:40:08.807 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.807+0000 7fe8f4ff9640 1 -- 172.21.15.72:0/2506132270 <== mon.1 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v45) ==== 100+0+11 (secure 0 0 0) 0x7fe8ec058060 con 0x7fe8f80d0f70 2024-03-24T15:40:08.808 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8e406b810 msgr2=0x7fe8e406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8e406b810 0x7fe8e406dcd0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe8e8036000 tx=0x7fe8e803c040 comp rx=0 tx=0).stop 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 msgr2=0x7fe8f81f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 0x7fe8f81f4780 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec00c4d0 tx=0x7fe8ec00c8d0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 shutdown_connections 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7fe8e406b810 0x7fe8e406dcd0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8f815e240 0x7fe8f81f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7fe8f80d2b20 0x7fe8f8160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 --2- 172.21.15.72:0/2506132270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe8f80d0f70 0x7fe8f81f4780 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.810 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 >> 172.21.15.72:0/2506132270 conn(0x7fe8f80d3e30 msgr2=0x7fe8f806c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 shutdown_connections 2024-03-24T15:40:08.811 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.809+0000 7fe8fe7f7640 1 -- 172.21.15.72:0/2506132270 wait complete. 2024-03-24T15:40:08.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-24T15:40:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.922+0000 7f8c475fd640 1 Processor -- start 2024-03-24T15:40:08.923 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.922+0000 7f8c475fd640 1 -- start start 2024-03-24T15:40:08.924 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c475fd640 1 --2- >> v2:172.21.15.79:3300/0 conn(0x7f8c40161910 0x7f8c400d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c475fd640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c400d2600 0x7f8c400cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c475fd640 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c4006c160 con 0x7f8c4006bcb0 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c475fd640 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 -- 0x7f8c4006d030 con 0x7f8c400d2600 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c475fd640 1 -- --> v2:172.21.15.79:3300/0 -- mon_getmap magic: 0 -- 0x7f8c400d3be0 con 0x7f8c40161910 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c45b9a640 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8c400d2600 0x7f8c400cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c44b98640 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8c4006bcb0 0x7f8c400d1ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:47170/0 (socket says 172.21.15.72:47170) 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.923+0000 7f8c44b98640 1 -- 172.21.15.72:0/131100303 learned_addr learned my addr 172.21.15.72:0/131100303 (peer_addr_for_me v1:172.21.15.72:0/0) 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.924+0000 7f8c45399640 1 --2- 172.21.15.72:0/131100303 >> v2:172.21.15.79:3300/0 conn(0x7f8c40161910 0x7f8c400d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.924+0000 7f8c45b9a640 1 -- 172.21.15.72:0/131100303 >> v2:172.21.15.79:3300/0 conn(0x7f8c40161910 msgr2=0x7f8c400d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.924+0000 7f8c45b9a640 1 --2- 172.21.15.72:0/131100303 >> v2:172.21.15.79:3300/0 conn(0x7f8c40161910 0x7f8c400d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.924+0000 7f8c45b9a640 1 -- 172.21.15.72:0/131100303 >> v1:172.21.15.72:6789/0 conn(0x7f8c4006bcb0 legacy=0x7f8c400d1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.924+0000 7f8c37fff640 1 -- 172.21.15.72:0/131100303 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973954827 0 0) 0x7f8c4006c160 con 0x7f8c4006bcb0 2024-03-24T15:40:08.925 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.924+0000 7f8c45b9a640 1 -- 172.21.15.72:0/131100303 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4006c3b0 con 0x7f8c400d2600 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c45b9a640 1 --2- 172.21.15.72:0/131100303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c400d2600 0x7f8c400cefa0 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f8c400688e0 tx=0x7f8c3802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aec0c6b7297ed06 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c37fff640 1 -- 172.21.15.72:0/131100303 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3802cbf0 con 0x7f8c400d2600 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c37fff640 1 -- 172.21.15.72:0/131100303 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3802cd50 con 0x7f8c400d2600 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c37fff640 1 -- 172.21.15.72:0/131100303 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38034660 con 0x7f8c400d2600 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 -- 172.21.15.72:0/131100303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c400d2600 msgr2=0x7f8c400cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 --2- 172.21.15.72:0/131100303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c400d2600 0x7f8c400cefa0 secure :-1 s=READY pgs=2578 cs=0 l=1 rev1=1 crypto rx=0x7f8c400688e0 tx=0x7f8c3802be40 comp rx=0 tx=0).stop 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 -- 172.21.15.72:0/131100303 shutdown_connections 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 --2- 172.21.15.72:0/131100303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c400d2600 0x7f8c400cefa0 unknown :-1 s=CLOSED pgs=2578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 --2- 172.21.15.72:0/131100303 >> v2:172.21.15.79:3300/0 conn(0x7f8c40161910 0x7f8c400d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 -- 172.21.15.72:0/131100303 >> 172.21.15.72:0/131100303 conn(0x7f8c400d3ff0 msgr2=0x7f8c400d4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 -- 172.21.15.72:0/131100303 shutdown_connections 2024-03-24T15:40:08.932 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.925+0000 7f8c475fd640 1 -- 172.21.15.72:0/131100303 wait complete. 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.926+0000 7f8c475fd640 1 Processor -- start 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.926+0000 7f8c475fd640 1 -- start start 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c475fd640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 0x7f8c401552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c475fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c400d2600 0x7f8c400b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c475fd640 1 --2- >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c40161910 0x7f8c400b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c475fd640 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400cd6a0 con 0x7f8c4006bcb0 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c475fd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400b8ae0 con 0x7f8c400d2600 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c475fd640 1 -- --> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] -- mon_getmap magic: 0 -- 0x7f8c400b8dc0 con 0x7f8c40161910 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c45399640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 0x7f8c401552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c45399640 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 0x7f8c401552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:48940/0 (socket says 172.21.15.72:48940) 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c45399640 1 -- 172.21.15.72:0/331892636 learned_addr learned my addr 172.21.15.72:0/331892636 (peer_addr_for_me v2:172.21.15.72:0/0) 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c44b98640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c400d2600 0x7f8c400b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.927+0000 7f8c45b9a640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c40161910 0x7f8c400b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c45399640 1 -- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c40161910 msgr2=0x7f8c400b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c45399640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c40161910 0x7f8c400b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.933 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c45399640 1 -- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c400d2600 msgr2=0x7f8c400b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c45399640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c400d2600 0x7f8c400b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c45399640 1 -- 172.21.15.72:0/331892636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c38009a70 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c45399640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 0x7f8c401552e0 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000e870 tx=0x7f8c3000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c300094f0 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3000c940 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c400b90a0 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000ccf0 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.928+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c400b9660 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.929+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c40073d50 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.929+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) ==== 89780+0+0 (secure 0 0 0) 0x7f8c30013470 con 0x7f8c4006bcb0 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.930+0000 7f8c35ffb640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8c2406b810 0x7f8c2406dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-24T15:40:08.934 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.930+0000 7f8c44b98640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8c2406b810 0x7f8c2406dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-24T15:40:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.930+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6130+0+0 (secure 0 0 0) 0x7f8c3008a2f0 con 0x7f8c4006bcb0 2024-03-24T15:40:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.930+0000 7f8c44b98640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8c2406b810 0x7f8c2406dcd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8c400d4ed0 tx=0x7f8c3c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-24T15:40:08.935 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:08.934+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183808 (secure 0 0 0) 0x7f8c30054ca0 con 0x7f8c4006bcb0 2024-03-24T15:40:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.124+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8c400d0e20 con 0x7f8c4006bcb0 2024-03-24T15:40:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.124+0000 7f8c35ffb640 1 -- 172.21.15.72:0/331892636 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f8c30058360 con 0x7f8c4006bcb0 2024-03-24T15:40:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2024-03-24T15:40:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8c2406b810 msgr2=0x7f8c2406dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8c2406b810 0x7f8c2406dcd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8c400d4ed0 tx=0x7f8c3c007d50 comp rx=0 tx=0).stop 2024-03-24T15:40:09.127 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 msgr2=0x7f8c401552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 0x7f8c401552e0 secure :-1 s=READY pgs=2579 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000e870 tx=0x7f8c3000ed30 comp rx=0 tx=0).stop 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 shutdown_connections 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:6832/4015618511,v1:172.21.15.72:6833/4015618511] conn(0x7f8c2406b810 0x7f8c2406dcd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f8c40161910 0x7f8c400b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8c400d2600 0x7f8c400b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 --2- 172.21.15.72:0/331892636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8c4006bcb0 0x7f8c401552e0 unknown :-1 s=CLOSED pgs=2579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 >> 172.21.15.72:0/331892636 conn(0x7f8c400d3ff0 msgr2=0x7f8c400b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 shutdown_connections 2024-03-24T15:40:09.128 INFO:teuthology.orchestra.run.smithi072.stderr:2024-03-24T15:40:09.126+0000 7f8c475fd640 1 -- 172.21.15.72:0/331892636 wait complete. 2024-03-24T15:40:09.138 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-24T15:40:09.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T15:40:09.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-24T15:40:09.198 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T15:40:09.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T15:40:09.198 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-24T15:40:09.303 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2024-03-24T15:40:09.303 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T15:40:09.318 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056328,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497624k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=284 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248808k,nr_inodes=812202,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497624k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.72:6789:/test /tmp/tmp.yyEMJv2iLxtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=0cd6a1e7-49c4-4ce2-8320-31fe22775d9b,acl 0 0 172.21.15.72:6789:/scratch /tmp/tmp.BUwrcUzctNscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=0cd6a1e7-49c4-4ce2-8320-31fe22775d9b,acl 0 0 2024-03-24T15:40:09.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2024-03-24T15:40:09.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T15:40:09.318 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-24T15:40:09.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T15:40:09.373 INFO:teuthology.orchestra.run.smithi072.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-24T15:40:09.374 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T15:40:09.374 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T15:40:09.400 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056371,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19591 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-24T15:40:09.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T15:40:09.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T15:40:09.401 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-24T15:40:09.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T15:40:09.458 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-24T15:40:09.458 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-03-24T15:40:09.458 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-24T15:40:09.512 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056371,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19591 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-24T15:40:09.513 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi079.front.sepia.ceph.com 2024-03-24T15:40:09.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-24T15:40:09.513 DEBUG:teuthology.orchestra.run.smithi079:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-24T15:40:09.567 INFO:teuthology.orchestra.run.smithi079.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-24T15:40:09.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-24T15:40:11.078 INFO:tasks.ceph.osd.0:Sent signal 15 2024-03-24T15:40:11.079 INFO:tasks.ceph.osd.1:Sent signal 15 2024-03-24T15:40:11.079 INFO:tasks.ceph.osd.3:Sent signal 15 2024-03-24T15:40:11.079 INFO:tasks.ceph.osd.4:Sent signal 15 2024-03-24T15:40:11.079 INFO:tasks.ceph.osd.6:Sent signal 15 2024-03-24T15:40:11.079 INFO:tasks.ceph.osd.7:Sent signal 15 2024-03-24T15:40:11.080 INFO:tasks.ceph.mds.a:Sent signal 15 2024-03-24T15:40:11.080 INFO:tasks.ceph.mds.c:Sent signal 15 2024-03-24T15:40:11.080 INFO:tasks.ceph.mds.b:Sent signal 15 2024-03-24T15:40:11.080 INFO:tasks.ceph.mds.d:Sent signal 15 2024-03-24T15:40:11.080 INFO:tasks.ceph.mon.a:Sent signal 15 2024-03-24T15:40:11.081 INFO:tasks.ceph.mon.b:Sent signal 15 2024-03-24T15:40:11.081 INFO:tasks.ceph.mon.c:Sent signal 15 2024-03-24T15:40:11.081 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-03-24T15:40:11.081 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-03-24T15:40:11.082 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:40:11.079+0000 7f5907ae3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 37615) UID: 0 2024-03-24T15:40:11.082 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:40:11.079+0000 7f5907ae3640 -1 osd.4 45 *** Got signal Terminated *** 2024-03-24T15:40:11.082 INFO:tasks.ceph.osd.4.smithi079.stderr:2024-03-24T15:40:11.079+0000 7f5907ae3640 -1 osd.4 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-24T15:40:11.082 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:40:11.079+0000 7fcdec273640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37619) UID: 0 2024-03-24T15:40:11.083 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:40:11.079+0000 7fcdec273640 -1 osd.6 45 *** Got signal Terminated *** 2024-03-24T15:40:11.083 INFO:tasks.ceph.osd.6.smithi079.stderr:2024-03-24T15:40:11.079+0000 7fcdec273640 -1 osd.6 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-24T15:40:11.083 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f1f3eedb640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 37621) UID: 0 2024-03-24T15:40:11.083 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f1f3eedb640 -1 osd.7 45 *** Got signal Terminated *** 2024-03-24T15:40:11.083 INFO:tasks.ceph.osd.7.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f1f3eedb640 -1 osd.7 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-24T15:40:11.083 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f4da498b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44622) UID: 0 2024-03-24T15:40:11.084 INFO:tasks.ceph.mds.b.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f4da498b640 -1 mds.b *** got signal Terminated *** 2024-03-24T15:40:11.084 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f0189492640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 44621) UID: 0 2024-03-24T15:40:11.084 INFO:tasks.ceph.mds.d.smithi079.stderr:2024-03-24T15:40:11.080+0000 7f0189492640 -1 mds.d *** got signal Terminated *** 2024-03-24T15:40:11.084 INFO:tasks.ceph.mon.b.smithi079.stderr:2024-03-24T15:40:11.081+0000 7fe4aa5f7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 37045) UID: 0 2024-03-24T15:40:11.084 INFO:tasks.ceph.mon.b.smithi079.stderr:2024-03-24T15:40:11.081+0000 7fe4aa5f7640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-03-24T15:40:11.085 INFO:tasks.ceph.mon.c.smithi079.stderr:2024-03-24T15:40:11.081+0000 7f7f0e1ad640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 37048) UID: 0 2024-03-24T15:40:11.085 INFO:tasks.ceph.mon.c.smithi079.stderr:2024-03-24T15:40:11.081+0000 7f7f0e1ad640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-03-24T15:40:11.085 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T15:40:11.078+0000 7f2824d68640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37559) UID: 0 2024-03-24T15:40:11.085 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T15:40:11.078+0000 7f2824d68640 -1 osd.0 45 *** Got signal Terminated *** 2024-03-24T15:40:11.085 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T15:40:11.079+0000 7f8565601640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37566) UID: 0 2024-03-24T15:40:11.086 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T15:40:11.079+0000 7f8565601640 -1 osd.1 45 *** Got signal Terminated *** 2024-03-24T15:40:11.086 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T15:40:11.079+0000 7fb0e9de8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37585) UID: 0 2024-03-24T15:40:11.086 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T15:40:11.079+0000 7fb0e9de8640 -1 osd.3 45 *** Got signal Terminated *** 2024-03-24T15:40:11.116 INFO:tasks.ceph.mon.a.smithi072.stderr:2024-03-24T15:40:11.116+0000 7fa5ba611640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-24T15:40:11.117 INFO:tasks.ceph.mon.a.smithi072.stderr:2024-03-24T15:40:11.116+0000 7fa5bfe1c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 37300) UID: 0 2024-03-24T15:40:11.117 INFO:tasks.ceph.mon.a.smithi072.stderr:2024-03-24T15:40:11.116+0000 7fa5bfe1c640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-24T15:40:11.132 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T15:40:11.131+0000 7f8cf9217640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 37337) UID: 0 2024-03-24T15:40:11.132 INFO:tasks.ceph.mgr.y.smithi072.stderr:2024-03-24T15:40:11.131+0000 7f8cf9217640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-24T15:40:11.143 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-03-24T15:40:11.109+0000 7f019399d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 51842) UID: 0 2024-03-24T15:40:11.143 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-03-24T15:40:11.116+0000 7fc48eaf1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 51843) UID: 0 2024-03-24T15:40:11.169 INFO:tasks.ceph.osd.0.smithi072.stderr:2024-03-24T15:40:11.169+0000 7f2824d68640 -1 osd.0 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-24T15:40:11.170 INFO:tasks.ceph.osd.1.smithi072.stderr:2024-03-24T15:40:11.169+0000 7f8565601640 -1 osd.1 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-24T15:40:11.170 INFO:tasks.ceph.osd.3.smithi072.stderr:2024-03-24T15:40:11.169+0000 7fb0e9de8640 -1 osd.3 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-24T15:40:11.195 INFO:tasks.ceph.mds.a.smithi072.stderr:2024-03-24T15:40:11.142+0000 7f019399d640 -1 mds.a *** got signal Terminated *** 2024-03-24T15:40:11.195 INFO:tasks.ceph.mds.c.smithi072.stderr:2024-03-24T15:40:11.142+0000 7fc48eaf1640 -1 mds.c *** got signal Terminated *** 2024-03-24T15:40:11.283 INFO:tasks.ceph.mgr.x.smithi079.stderr:daemon-helper: command crashed with signal 15 2024-03-24T15:41:14.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:41:14.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:41:14.563 INFO:teuthology.orchestra.run.smithi072.stderr:ceph-osd: no process found 2024-03-24T15:46:46.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:46:46.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:47:16.396 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:47:16.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:47:46.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:47:46.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:48:16.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:48:16.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:48:47.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:48:47.143 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:49:17.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:49:17.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:49:47.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:49:47.365 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:50:17.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:50:17.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:50:47.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:50:47.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:51:17.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:51:17.719 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:51:47.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:51:47.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:52:17.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:52:17.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:52:48.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:52:48.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:53:18.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:53:18.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:53:48.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:53:48.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:54:18.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:54:18.474 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:54:48.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:54:48.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:55:18.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:55:18.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:55:48.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:55:48.814 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:56:19.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:56:19.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:56:49.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:56:49.087 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:57:19.252 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:57:19.256 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:57:49.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:57:49.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:58:19.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:58:19.477 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:58:49.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:58:49.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:59:19.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:59:19.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:59:49.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T15:59:49.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:00:19.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:00:19.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:00:50.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:00:50.082 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:01:20.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:01:20.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:01:50.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:01:50.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:02:20.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:02:20.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:02:50.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:02:50.583 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:03:20.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:03:20.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:03:50.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:03:50.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:04:20.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:04:20.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:04:51.007 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:04:51.010 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:05:21.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:05:21.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:05:51.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:05:51.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:06:21.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:06:21.368 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:06:51.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:06:51.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:07:21.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:07:21.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:07:51.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:07:51.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:08:21.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:08:21.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:08:52.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:08:52.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:09:22.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:09:22.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:09:52.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:09:52.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:10:22.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:10:22.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:10:52.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:10:52.550 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:11:22.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:11:22.769 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:11:52.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:11:52.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:12:23.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:12:23.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:12:53.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:12:53.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:13:23.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:13:23.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:13:53.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:13:53.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:14:23.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:14:23.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:14:54.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:14:54.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:15:24.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:15:24.109 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:15:54.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:15:54.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:16:24.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:16:24.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:16:54.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:16:54.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:17:24.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:17:24.575 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:17:54.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:17:54.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:18:24.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:18:24.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:18:55.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:18:55.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:19:25.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:19:25.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:19:55.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:19:55.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:20:25.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:20:25.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:20:55.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:20:55.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:21:25.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:21:25.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:21:55.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:21:55.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:22:25.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:22:25.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:22:56.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:22:56.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:23:26.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:23:26.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:23:56.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:23:56.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:24:26.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:24:26.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:24:56.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:24:56.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:25:26.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:25:26.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:25:56.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:25:56.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:26:26.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:26:26.889 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:26:57.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:26:57.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:27:27.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:27:27.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:27:57.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:27:57.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:28:27.397 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:28:27.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:28:57.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:28:57.561 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:29:27.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:29:27.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:29:57.778 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:29:57.782 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:30:27.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:30:27.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:30:58.118 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:30:58.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:31:28.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:31:28.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:31:58.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:31:58.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:32:28.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:32:28.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:32:58.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:32:58.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:33:28.631 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:33:28.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:33:58.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:33:58.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:34:29.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:34:29.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:34:59.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:34:59.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:35:29.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:35:29.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:35:59.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:35:59.689 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:36:29.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:36:29.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:36:59.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:36:59.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:37:30.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:37:30.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:38:00.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:38:00.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:38:30.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:38:30.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:39:00.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:39:00.345 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:39:30.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:39:30.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:40:00.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:40:00.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:40:30.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:40:30.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:41:00.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:41:00.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:41:30.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:41:30.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:42:01.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:42:01.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:42:31.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:42:31.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:43:01.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:43:01.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:43:31.456 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:43:31.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:44:01.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:44:01.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:44:31.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:44:31.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:45:01.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:45:01.818 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:45:31.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:45:31.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:46:02.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:46:02.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:46:32.289 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:46:32.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:47:02.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:47:02.427 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:47:32.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:47:32.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:48:02.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:48:02.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:48:32.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:48:32.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:49:02.956 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:49:02.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:49:33.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:49:33.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:50:03.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:50:03.161 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:50:33.228 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:50:33.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:51:03.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:51:03.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:51:33.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:51:33.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:52:03.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:52:03.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:52:33.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:52:33.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:53:04.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:53:04.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:53:34.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:53:34.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:54:04.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:54:04.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:54:34.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:54:34.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:55:04.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:55:04.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:55:34.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:55:34.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:56:04.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:56:04.874 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:56:34.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:56:34.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:57:05.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:57:05.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:57:35.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:57:35.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:58:05.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:58:05.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:58:35.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:58:35.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:59:05.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:59:05.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:59:35.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T16:59:35.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:00:05.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:00:05.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:00:35.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:00:35.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:01:05.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:01:05.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:01:36.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:01:36.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:02:06.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:02:06.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:02:36.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:02:36.389 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:03:06.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:03:06.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:03:36.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:03:36.531 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:04:06.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:04:06.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:04:36.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:04:36.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:05:06.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:05:06.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:05:37.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:05:37.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:06:07.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:06:07.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:06:37.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:06:37.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:07:07.452 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:07:07.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:07:37.571 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:07:37.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:08:07.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:08:07.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:08:37.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:08:37.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:09:07.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:09:07.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:09:38.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:09:38.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:10:08.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:10:08.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:10:38.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:10:38.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:11:08.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:11:08.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:11:38.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:11:38.513 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:12:08.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:12:08.609 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:12:38.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:12:38.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:13:08.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:13:08.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:13:38.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:13:38.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:14:09.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:14:09.026 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:14:39.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:14:39.154 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:15:09.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:15:09.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:15:39.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:15:39.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:16:09.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:16:09.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:16:39.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:16:39.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:17:09.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:17:09.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:17:39.783 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:17:39.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:18:09.918 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:18:09.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:18:40.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:18:40.090 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:19:10.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:19:10.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:19:40.368 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:19:40.371 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:20:10.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:20:10.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:20:40.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:20:40.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:21:11.025 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:21:11.028 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:21:41.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:21:41.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:22:11.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:22:11.225 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:22:41.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:22:41.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:23:11.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:23:11.467 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:23:41.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:23:41.608 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:24:11.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:24:11.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:24:41.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:24:41.821 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:25:11.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:25:11.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:25:42.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:25:42.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:26:12.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:26:12.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:26:42.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:26:42.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:27:12.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:27:12.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:27:42.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:27:42.443 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:28:12.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:28:12.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:28:42.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:28:42.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:29:12.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:29:12.743 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:29:42.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:29:42.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:30:12.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:30:12.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:30:43.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:30:43.034 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:31:13.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:31:13.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:31:43.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:31:43.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:32:13.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:32:13.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:32:43.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:32:43.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:33:14.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:33:14.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:33:44.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:33:44.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:34:14.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:34:14.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:34:44.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:34:44.346 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:35:14.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:35:14.481 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:35:44.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:35:44.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:36:14.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:36:14.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:36:44.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:36:44.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:37:14.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:37:14.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:37:45.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:37:45.112 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:38:15.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:38:15.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:38:45.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:38:45.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:39:15.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:39:15.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:39:45.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:39:45.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:40:15.819 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:40:15.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:40:45.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:40:45.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:41:16.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:41:16.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:41:46.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:41:46.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:42:16.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:42:16.408 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:42:46.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:42:46.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:43:16.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:43:16.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:43:46.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:43:46.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:44:16.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:44:16.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:44:47.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:44:47.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:45:17.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:45:17.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:45:47.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:45:47.425 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:46:17.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:46:17.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:46:47.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:46:47.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:47:17.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:47:17.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:47:47.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:47:47.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:48:18.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:48:18.043 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:48:48.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:48:48.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:49:18.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:49:18.289 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:49:48.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:49:48.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:50:18.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:50:18.544 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:50:48.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:50:48.664 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:51:18.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:51:18.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:51:48.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:51:48.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:52:19.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:52:19.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:52:49.187 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:52:49.218 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:53:19.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:53:19.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:53:49.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:53:49.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:54:19.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:54:19.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:54:49.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:54:49.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:55:19.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:55:19.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:55:50.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:55:50.078 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:56:20.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:56:20.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:56:50.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:56:50.374 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:57:20.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:57:20.529 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:57:50.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:57:50.654 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:58:20.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:58:20.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:58:50.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:58:50.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:59:21.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:59:21.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:59:51.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T17:59:51.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:00:21.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:00:21.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:00:51.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:00:51.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:01:21.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:01:21.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:01:51.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:01:51.847 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:02:21.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:02:21.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:02:52.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:02:52.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:03:22.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:03:22.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:03:52.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:03:52.327 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:04:22.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:04:22.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:04:52.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:04:52.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:05:22.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:05:22.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:05:52.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:05:52.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:06:23.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:06:23.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:06:53.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:06:53.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:07:23.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:07:23.377 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:07:53.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:07:53.512 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:08:23.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:08:23.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:08:53.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:08:53.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:09:23.991 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:09:23.995 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:09:54.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:09:54.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:10:24.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:10:24.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:10:54.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:10:54.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:11:24.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:11:24.555 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:11:54.670 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:11:54.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:12:24.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:12:24.794 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:12:54.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:12:54.934 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:13:25.061 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:13:25.065 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:13:55.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:13:55.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:14:25.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:14:25.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:14:55.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:14:55.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:15:25.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:15:25.628 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:15:55.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:15:55.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:16:25.910 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:16:25.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:16:56.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:16:56.040 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:17:26.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:17:26.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:17:56.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:17:56.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:18:26.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:18:26.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:18:56.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:18:56.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:19:26.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:19:26.745 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:19:56.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:19:56.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:20:27.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:20:27.016 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:20:57.181 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:20:57.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:21:27.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:21:27.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:21:57.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:21:57.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:22:27.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:22:27.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:22:57.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:22:57.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:23:27.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:23:27.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:23:58.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:23:58.008 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:24:28.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:24:28.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:24:58.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:24:58.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:25:28.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:25:28.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:25:58.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:25:58.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:26:28.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:26:28.720 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:26:58.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:26:58.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:27:28.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:27:28.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:27:59.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:27:59.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:28:29.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:28:29.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:28:59.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:28:59.365 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:29:29.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:29:29.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:29:59.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:29:59.637 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:30:29.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:30:29.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:30:59.921 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:30:59.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:31:30.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:31:30.014 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:32:00.134 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:32:00.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:32:30.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:32:30.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:33:00.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:33:00.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:33:30.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:33:30.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:34:00.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:34:00.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:34:30.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:34:30.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:35:00.990 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:35:00.993 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:35:31.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:35:31.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:36:01.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:36:01.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:36:31.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:36:31.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:37:01.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:37:01.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:37:31.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:37:31.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:38:01.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:38:01.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:38:31.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:38:31.986 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:39:02.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:39:02.121 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:39:32.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:39:32.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:40:02.380 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:40:02.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:40:32.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:40:32.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:41:02.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:41:02.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:41:32.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:41:32.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:42:02.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:42:02.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:42:33.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:42:33.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:43:03.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:43:03.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:43:33.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:43:33.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:44:03.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:44:03.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:44:34.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:44:34.027 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:45:04.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:45:04.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:45:34.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:45:34.308 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:46:04.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:46:04.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:46:34.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:46:34.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:47:04.721 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:47:04.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:47:34.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:47:34.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:48:04.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:48:04.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:48:35.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:48:35.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:49:05.312 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:49:05.315 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:49:35.447 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:49:35.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:50:05.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:50:05.610 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:50:35.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:50:35.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:51:05.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:51:05.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:51:36.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:51:36.059 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:52:06.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:52:06.194 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:52:36.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:52:36.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:53:06.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:53:06.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:53:36.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:53:36.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:54:06.758 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:54:06.762 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:54:36.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:54:36.906 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:55:07.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:55:07.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:55:37.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:55:37.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:56:07.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:56:07.363 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:56:37.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:56:37.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:57:07.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:57:07.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:57:37.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:57:37.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:58:07.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:58:07.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:58:38.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:58:38.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:59:08.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:59:08.247 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:59:38.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T18:59:38.326 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:00:08.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:00:08.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:00:38.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:00:38.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:01:08.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:01:08.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:01:38.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:01:38.790 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:02:08.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:02:08.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:02:39.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:02:39.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:03:09.201 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:03:09.212 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:03:39.363 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:03:39.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:04:09.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:04:09.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:04:39.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:04:39.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:05:09.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:05:09.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:05:39.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:05:39.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:06:09.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:06:09.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:06:40.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:06:40.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:07:10.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:07:10.173 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:07:40.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:07:40.292 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:08:10.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:08:10.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:08:40.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:08:40.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:09:10.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:09:10.741 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:09:40.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:09:40.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:10:10.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:10:10.985 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:10:41.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:10:41.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:11:11.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:11:11.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:11:41.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:11:41.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:12:11.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:12:11.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:12:41.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:12:41.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:13:11.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:13:11.783 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:13:41.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:13:41.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:14:12.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:14:12.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:14:42.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:14:42.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:15:12.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:15:12.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:15:42.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:15:42.469 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:16:12.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:16:12.613 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:16:42.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:16:42.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:17:12.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:17:12.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:17:43.016 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:17:43.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:18:13.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:18:13.163 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:18:43.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:18:43.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:19:13.431 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:19:13.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:19:43.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:19:43.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:20:13.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:20:13.713 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:20:43.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:20:43.832 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:21:13.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:21:13.952 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:21:44.066 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:21:44.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:22:14.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:22:14.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:22:44.371 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:22:44.375 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:23:14.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:23:14.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:23:44.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:23:44.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:24:14.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:24:14.808 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:24:44.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:24:44.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:25:15.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:25:15.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:25:45.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:25:45.229 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:26:15.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:26:15.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:26:45.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:26:45.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:27:15.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:27:15.604 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:27:45.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:27:45.732 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:28:15.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:28:15.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:28:45.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:28:45.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:29:16.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:29:16.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:29:46.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:29:46.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:30:16.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:30:16.342 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:30:46.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:30:46.478 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:31:16.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:31:16.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:31:46.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:31:46.707 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:32:16.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:32:16.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:32:46.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:32:46.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:33:17.128 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:33:17.132 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:33:47.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:33:47.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:34:17.407 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:34:17.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:34:47.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:34:47.538 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:35:17.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:35:17.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:35:47.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:35:47.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:36:17.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:36:17.978 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:36:48.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:36:48.123 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:37:18.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:37:18.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:37:48.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:37:48.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:38:18.566 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:38:18.570 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:38:48.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:38:48.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:39:18.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:39:18.901 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:39:49.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:39:49.060 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:40:19.184 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:40:19.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:40:49.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:40:49.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:41:19.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:41:19.501 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:41:49.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:41:49.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:42:19.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:42:19.764 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:42:49.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:42:49.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:43:20.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:43:20.070 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:43:50.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:43:50.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:44:20.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:44:20.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:44:50.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:44:50.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:45:20.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:45:20.577 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:45:50.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:45:50.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:46:20.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:46:20.899 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:46:51.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:46:51.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:47:21.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:47:21.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:47:51.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:47:51.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:48:21.529 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:48:21.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:48:51.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:48:51.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:49:21.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:49:21.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:49:51.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:49:51.956 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:50:22.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:50:22.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:50:52.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:50:52.201 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:51:22.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:51:22.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:51:52.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:51:52.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:52:22.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:52:22.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:52:52.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:52:52.718 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:53:22.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:53:22.854 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:53:52.986 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:53:52.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:54:23.130 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:54:23.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:54:53.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:54:53.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:55:23.384 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:55:23.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:55:53.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:55:53.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:56:23.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:56:23.659 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:56:53.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:56:53.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:57:23.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:57:23.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:57:54.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:57:54.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:58:24.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:58:24.217 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:58:54.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:58:54.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:59:24.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:59:24.496 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:59:54.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T19:59:54.625 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:00:24.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:00:24.777 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:00:54.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:00:54.937 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:01:25.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:01:25.044 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:01:55.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:01:55.160 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:02:25.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:02:25.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:02:55.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:02:55.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:03:25.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:03:25.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:03:55.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:03:55.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:04:25.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:04:25.845 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:04:55.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:04:55.999 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:05:26.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:05:26.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:05:56.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:05:56.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:06:26.393 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:06:26.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:06:56.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:06:56.549 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:07:26.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:07:26.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:07:56.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:07:56.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:08:26.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:08:26.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:08:57.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:08:57.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:09:27.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:09:27.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:09:57.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:09:57.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:10:27.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:10:27.538 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:10:57.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:10:57.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:11:27.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:11:27.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:11:57.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:11:57.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:12:28.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:12:28.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:12:58.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:12:58.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:13:28.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:13:28.387 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:13:58.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:13:58.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:14:28.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:14:28.690 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:14:58.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:14:58.834 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:15:28.958 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:15:28.962 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:15:59.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:15:59.105 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:16:29.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:16:29.240 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:16:59.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:16:59.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:17:29.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:17:29.537 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:17:59.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:17:59.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:18:29.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:18:29.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:18:59.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:18:59.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:19:30.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:19:30.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:20:00.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:20:00.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:20:30.346 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:20:30.350 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:21:00.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:21:00.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:21:30.660 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:21:30.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:22:00.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:22:00.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:22:30.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:22:30.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:23:01.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:23:01.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:23:31.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:23:31.248 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:24:01.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:24:01.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:24:31.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:24:31.535 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:25:01.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:25:01.688 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:25:31.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:25:31.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:26:01.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:26:01.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:26:32.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:26:32.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:27:02.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:27:02.271 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:27:32.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:27:32.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:28:02.522 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:28:02.525 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:28:32.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:28:32.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:29:02.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:29:02.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:29:32.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:29:32.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:30:03.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:30:03.076 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:30:33.200 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:30:33.204 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:31:03.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:31:03.364 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:31:33.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:31:33.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:32:03.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:32:03.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:32:33.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:32:33.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:33:03.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:33:03.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:33:33.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:33:33.984 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:34:04.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:34:04.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:34:34.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:34:34.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:35:04.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:35:04.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:35:34.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:35:34.508 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:36:04.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:36:04.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:36:34.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:36:34.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:37:04.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:37:04.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:37:35.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:37:35.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:38:05.258 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:38:05.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:38:35.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:38:35.430 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:39:05.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:39:05.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:39:35.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:39:35.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:40:05.842 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:40:05.845 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:40:35.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:40:35.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:41:06.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:41:06.124 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:41:36.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:41:36.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:42:06.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:42:06.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:42:36.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:42:36.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:43:06.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:43:06.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:43:36.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:43:36.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:44:06.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:44:06.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:44:37.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:44:37.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:45:07.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:45:07.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:45:37.394 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:45:37.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:46:07.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:46:07.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:46:37.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:46:37.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:47:07.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:47:07.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:47:37.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:47:37.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:48:08.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:48:08.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:48:38.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:48:38.228 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:49:08.375 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:49:08.378 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:49:38.528 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:49:38.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:50:08.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:50:08.642 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:50:38.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:50:38.770 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:51:08.927 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:51:08.930 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:51:39.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:51:39.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:52:09.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:52:09.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:52:39.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:52:39.353 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:53:09.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:53:09.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:53:39.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:53:39.634 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:54:09.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:54:09.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:54:39.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:54:39.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:55:09.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:55:09.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:55:40.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:55:40.084 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:56:10.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:56:10.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:56:40.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:56:40.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:57:10.495 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:57:10.499 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:57:40.639 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:57:40.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:58:10.792 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:58:10.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:58:40.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:58:40.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:59:11.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:59:11.057 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:59:41.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T20:59:41.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:00:11.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:00:11.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:00:41.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:00:41.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:01:11.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:01:11.600 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:01:41.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:01:41.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:02:11.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:02:11.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:02:42.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:02:42.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:03:12.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:03:12.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:03:42.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:03:42.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:04:12.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:04:12.380 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:04:42.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:04:42.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:05:12.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:05:12.668 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:05:42.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:05:42.795 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:06:12.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:06:12.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:06:43.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:06:43.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:07:13.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:07:13.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:07:43.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:07:43.287 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:08:13.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:08:13.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:08:43.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:08:43.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:09:13.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:09:13.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:09:43.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:09:43.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:10:14.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:10:14.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:10:44.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:10:44.177 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:11:14.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:11:14.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:11:44.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:11:44.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:12:14.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:12:14.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:12:44.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:12:44.723 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:13:14.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:13:14.905 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:13:45.028 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:13:45.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:14:15.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:14:15.175 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:14:45.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:14:45.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:15:15.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:15:15.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:15:45.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:15:45.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:16:15.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:16:15.692 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:16:45.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:16:45.819 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:17:15.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:17:15.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:17:46.112 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:17:46.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:18:16.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:18:16.276 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:18:46.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:18:47.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:19:17.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:19:17.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:19:47.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:19:47.515 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:20:17.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:20:17.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:20:47.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:20:47.812 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:21:17.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:21:17.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:21:48.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:21:48.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:22:18.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:22:18.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:22:48.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:22:48.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:23:18.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:23:18.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:23:48.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:23:48.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:24:18.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:24:18.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:24:48.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:24:48.973 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:25:19.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:25:19.117 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:25:49.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:25:49.269 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:26:19.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:26:19.413 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:26:49.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:26:49.573 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:27:19.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:27:19.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:27:49.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:27:49.943 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:28:20.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:28:20.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:28:50.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:28:50.216 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:29:20.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:29:20.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:29:50.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:29:50.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:30:20.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:30:20.644 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:30:50.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:30:50.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:31:20.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:31:20.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:31:51.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:31:51.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:32:21.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:32:21.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:32:51.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:32:51.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:33:21.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:33:21.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:33:51.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:33:51.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:34:21.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:34:21.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:34:51.929 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:34:51.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:35:22.064 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:35:22.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:35:52.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:35:52.203 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:36:22.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:36:22.340 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:36:52.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:36:52.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:37:22.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:37:22.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:37:52.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:37:52.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:38:22.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:38:22.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:38:52.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:38:52.963 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:39:23.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:39:23.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:39:53.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:39:53.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:40:23.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:40:23.376 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:40:53.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:40:53.495 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:41:23.644 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:41:23.647 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:41:53.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:41:53.791 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:42:23.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:42:23.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:42:54.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:42:54.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:43:24.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:43:24.196 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:43:54.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:43:54.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:44:24.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:44:24.384 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:44:54.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:44:54.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:45:24.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:45:24.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:45:54.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:45:54.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:46:24.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:46:24.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:46:55.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:46:55.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:47:25.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:47:25.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:47:55.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:47:55.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:48:25.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:48:25.554 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:48:55.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:48:55.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:49:25.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:49:25.804 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:49:55.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:49:55.955 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:50:26.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:50:26.099 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:50:56.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:50:56.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:51:26.312 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:51:26.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:51:56.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:51:56.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:52:26.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:52:26.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:52:56.739 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:52:56.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:53:26.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:53:26.904 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:53:57.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:53:57.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:54:27.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:54:27.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:54:57.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:54:57.317 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:55:27.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:55:27.437 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:55:57.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:55:57.564 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:56:27.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:56:27.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:56:57.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:56:57.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:57:27.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:57:27.988 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:57:58.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:57:58.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:58:28.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:58:28.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:58:58.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:58:58.402 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:59:28.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:59:28.528 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:59:58.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T21:59:58.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:00:28.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:00:28.815 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:00:58.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:00:58.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:01:29.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:01:29.036 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:01:59.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:01:59.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:02:29.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:02:29.323 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:02:59.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:02:59.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:03:29.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:03:29.606 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:03:59.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:03:59.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:04:29.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:04:29.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:05:00.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:05:00.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:05:30.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:05:30.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:06:00.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:06:00.339 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:06:30.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:06:30.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:07:00.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:07:00.587 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:07:30.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:07:30.734 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:08:00.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:08:00.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:08:31.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:08:31.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:09:01.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:09:01.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:09:31.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:09:31.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:10:01.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:10:01.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:10:31.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:10:31.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:11:01.768 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:11:01.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:11:31.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:11:31.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:12:02.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:12:02.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:12:32.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:12:32.162 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:13:02.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:13:02.307 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:13:32.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:13:32.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:14:02.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:14:02.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:14:32.729 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:14:32.733 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:15:02.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:15:02.884 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:15:33.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:15:33.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:16:03.162 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:16:03.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:16:33.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:16:33.284 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:17:03.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:17:03.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:17:33.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:17:33.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:18:03.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:18:03.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:18:33.849 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:18:33.853 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:19:03.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:19:03.998 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:19:34.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:19:34.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:20:04.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:20:04.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:20:34.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:20:34.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:21:04.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:21:04.541 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:21:34.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:21:34.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:22:04.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:22:04.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:22:34.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:22:34.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:23:05.114 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:23:05.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:23:35.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:23:35.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:24:05.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:24:05.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:24:35.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:24:35.568 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:25:05.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:25:05.702 DEBUG:teuthology.orchestra.run.smithi079:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-24T22:25:30.068 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-03-24T22:25:30.069 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2024-03-24T22:25:30.070 DEBUG:teuthology.task.console_log:Killing console logger for smithi079 2024-03-24T22:25:30.070 DEBUG:teuthology.exit:Finished running handlers